[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:38.222875 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:45205
I20260709 13:05:38.224347 20036 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:38.225410 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:38.242162 20043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.242203 20042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.243827 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:38.242252 20045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.444578 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.444805 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.444964 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602339444948 us; error 0 us; skew 500 ppm
I20260709 13:05:39.445737 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.450956 20036 webserver.cc:533] Webserver started at http://127.19.145.62:44999/ using document root <none> and password file <none>
I20260709 13:05:39.451817 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.452026 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.452411 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.458022 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "d504daabe3e243e7a83291d9c803c3f8"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-cd6k"
I20260709 13:05:39.465700 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:39.470721 20051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.471894 20036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:05:39.472187 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "d504daabe3e243e7a83291d9c803c3f8"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-cd6k"
I20260709 13:05:39.472483 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.529328 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.530817 20036 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:39.531273 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.601666 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:45205
I20260709 13:05:39.601732 20102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:45205 every 8 connection(s)
I20260709 13:05:39.609643 20103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.631043 20103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: Bootstrap starting.
I20260709 13:05:39.636734 20103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.638427 20103 log.cc:826] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:39.642918 20103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: No bootstrap required, opened a new log
I20260709 13:05:39.663493 20103 raft_consensus.cc:359] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER }
I20260709 13:05:39.664033 20103 raft_consensus.cc:385] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.664228 20103 raft_consensus.cc:740] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d504daabe3e243e7a83291d9c803c3f8, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.665030 20103 consensus_queue.cc:260] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER }
I20260709 13:05:39.665501 20103 raft_consensus.cc:399] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:39.665745 20103 raft_consensus.cc:493] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:39.666026 20103 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.670028 20103 raft_consensus.cc:515] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER }
I20260709 13:05:39.670812 20103 leader_election.cc:304] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d504daabe3e243e7a83291d9c803c3f8; no voters: 
I20260709 13:05:39.672585 20103 leader_election.cc:290] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:39.673048 20106 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.675603 20106 raft_consensus.cc:697] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 1 LEADER]: Becoming Leader. State: Replica: d504daabe3e243e7a83291d9c803c3f8, State: Running, Role: LEADER
I20260709 13:05:39.676425 20106 consensus_queue.cc:237] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER }
I20260709 13:05:39.677022 20103 sys_catalog.cc:565] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:39.688946 20107 sys_catalog.cc:455] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d504daabe3e243e7a83291d9c803c3f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER } }
I20260709 13:05:39.689754 20107 sys_catalog.cc:458] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.689018 20108 sys_catalog.cc:455] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d504daabe3e243e7a83291d9c803c3f8. Latest consensus state: current_term: 1 leader_uuid: "d504daabe3e243e7a83291d9c803c3f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d504daabe3e243e7a83291d9c803c3f8" member_type: VOTER } }
I20260709 13:05:39.690251 20108 sys_catalog.cc:458] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.693039 20116 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:39.704986 20116 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:39.707404 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:39.723093 20116 catalog_manager.cc:1383] Generated new cluster ID: 49cb2ca044aa438098cb3fd2e5d86684
I20260709 13:05:39.723419 20116 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.736317 20116 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.738381 20116 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.754684 20116 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: Generated new TSK 0
I20260709 13:05:39.755761 20116 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.774096 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.784132 20125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.790158 20126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.798786 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:39.799175 20128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.800359 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.800671 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.800908 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602339800887 us; error 0 us; skew 500 ppm
I20260709 13:05:39.808163 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.813001 20036 webserver.cc:533] Webserver started at http://127.19.145.1:33929/ using document root <none> and password file <none>
I20260709 13:05:39.813752 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.814075 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.814458 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.816051 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "dfe77076b7ae4c69b750fa2c548ac213"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-cd6k"
I20260709 13:05:39.822857 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:39.827980 20133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.828845 20036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:05:39.829190 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "dfe77076b7ae4c69b750fa2c548ac213"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-cd6k"
I20260709 13:05:39.829572 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.867934 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.869668 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.872424 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.877914 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.878239 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.878556 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.878777 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.972326 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:39585
I20260709 13:05:39.972391 20195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:39585 every 8 connection(s)
I20260709 13:05:39.980289 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.989552 20200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.998014 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:39.998974 20201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:40.002840 20203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:40.003986 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:40.004251 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:40.004264 20196 heartbeater.cc:344] Connected to a master server at 127.19.145.62:45205
I20260709 13:05:40.004539 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602340004519 us; error 0 us; skew 500 ppm
I20260709 13:05:40.004807 20196 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:40.005427 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:40.006122 20196 heartbeater.cc:507] Master 127.19.145.62:45205 requested a full tablet report, sending...
I20260709 13:05:40.008626 20036 webserver.cc:533] Webserver started at http://127.19.145.2:38599/ using document root <none> and password file <none>
I20260709 13:05:40.009261 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:40.009474 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:40.009924 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:40.010022 20068 ts_manager.cc:194] Registered new tserver with Master: dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585)
I20260709 13:05:40.011032 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
format_stamp: "Formatted at 2026-07-09 13:05:40 on dist-test-slave-cd6k"
I20260709 13:05:40.013049 20068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46920
I20260709 13:05:40.017454 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:40.021792 20208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.022799 20036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:40.023152 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
format_stamp: "Formatted at 2026-07-09 13:05:40 on dist-test-slave-cd6k"
I20260709 13:05:40.023569 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:40.044680 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:40.046094 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:40.048328 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:40.051898 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:40.052129 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.052397 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:40.052574 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.151372 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:36905
I20260709 13:05:40.151499 20270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:36905 every 8 connection(s)
I20260709 13:05:40.160943 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:40.170543 20274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:40.183528 20271 heartbeater.cc:344] Connected to a master server at 127.19.145.62:45205
I20260709 13:05:40.184000 20271 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:40.184962 20271 heartbeater.cc:507] Master 127.19.145.62:45205 requested a full tablet report, sending...
I20260709 13:05:40.186105 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:40.187580 20277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:40.188854 20068 ts_manager.cc:194] Registered new tserver with Master: 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
W20260709 13:05:40.188956 20275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:40.190184 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:40.190481 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:40.190666 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602340190649 us; error 0 us; skew 500 ppm
I20260709 13:05:40.190758 20068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46936
I20260709 13:05:40.191473 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:40.194818 20036 webserver.cc:533] Webserver started at http://127.19.145.3:44943/ using document root <none> and password file <none>
I20260709 13:05:40.195482 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:40.195737 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:40.196046 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:40.197131 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "97c118dde76a4be48a4f0cd86eac309a"
format_stamp: "Formatted at 2026-07-09 13:05:40 on dist-test-slave-cd6k"
I20260709 13:05:40.203542 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:40.207665 20282 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.208565 20036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:40.208851 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "97c118dde76a4be48a4f0cd86eac309a"
format_stamp: "Formatted at 2026-07-09 13:05:40 on dist-test-slave-cd6k"
I20260709 13:05:40.209144 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:40.221925 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:40.223115 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:40.224968 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:40.228317 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:40.228499 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.228781 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:40.228950 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:40.328328 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:44209
I20260709 13:05:40.328569 20344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:44209 every 8 connection(s)
I20260709 13:05:40.344837 20345 heartbeater.cc:344] Connected to a master server at 127.19.145.62:45205
I20260709 13:05:40.345254 20345 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:40.346210 20345 heartbeater.cc:507] Master 127.19.145.62:45205 requested a full tablet report, sending...
I20260709 13:05:40.348410 20068 ts_manager.cc:194] Registered new tserver with Master: 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:40.349088 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014274376s
I20260709 13:05:40.350155 20068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46948
I20260709 13:05:40.400213 20068 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46954:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:40.403780 20068 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:40.504151 20310 tablet_service.cc:1511] Processing CreateTablet for tablet f7060d7a4d73419386b2a0a47c49c00d (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.504232 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 59335a678c874c1dbf65969b9a5b14c2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.506091 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7060d7a4d73419386b2a0a47c49c00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.506796 20306 tablet_service.cc:1511] Processing CreateTablet for tablet a13cdf5819024a6bbd18925349f5d0df (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.505726 20305 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5947a4bee49c4b53470d5d45791b0 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.508224 20305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5947a4bee49c4b53470d5d45791b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.508991 20307 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9d048a3e74bbe881e95b755d283b2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.510288 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9d048a3e74bbe881e95b755d283b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.511482 20306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cdf5819024a6bbd18925349f5d0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.512614 20308 tablet_service.cc:1511] Processing CreateTablet for tablet d65635bcd76f456a8718536b7af67b9c (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.514070 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65635bcd76f456a8718536b7af67b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.515789 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59335a678c874c1dbf65969b9a5b14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.527241 20304 tablet_service.cc:1511] Processing CreateTablet for tablet cc95b42d746047cf946b56721a9694ab (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.528640 20304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95b42d746047cf946b56721a9694ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.536269 20303 tablet_service.cc:1511] Processing CreateTablet for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.538970 20303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.545750 20236 tablet_service.cc:1511] Processing CreateTablet for tablet f7060d7a4d73419386b2a0a47c49c00d (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.550305 20234 tablet_service.cc:1511] Processing CreateTablet for tablet d65635bcd76f456a8718536b7af67b9c (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.547746 20235 tablet_service.cc:1511] Processing CreateTablet for tablet 59335a678c874c1dbf65969b9a5b14c2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.564815 20231 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5947a4bee49c4b53470d5d45791b0 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.562992 20230 tablet_service.cc:1511] Processing CreateTablet for tablet cc95b42d746047cf946b56721a9694ab (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.564993 20161 tablet_service.cc:1511] Processing CreateTablet for tablet f7060d7a4d73419386b2a0a47c49c00d (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.567356 20160 tablet_service.cc:1511] Processing CreateTablet for tablet 59335a678c874c1dbf65969b9a5b14c2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.571071 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7060d7a4d73419386b2a0a47c49c00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.574226 20232 tablet_service.cc:1511] Processing CreateTablet for tablet a13cdf5819024a6bbd18925349f5d0df (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.575866 20160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59335a678c874c1dbf65969b9a5b14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.578708 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7060d7a4d73419386b2a0a47c49c00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.587713 20302 tablet_service.cc:1511] Processing CreateTablet for tablet d996d83c87b9401980d7153490ae6553 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.590009 20302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d996d83c87b9401980d7153490ae6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.582294 20233 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9d048a3e74bbe881e95b755d283b2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.590704 20231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5947a4bee49c4b53470d5d45791b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.597323 20230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95b42d746047cf946b56721a9694ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.602370 20229 tablet_service.cc:1511] Processing CreateTablet for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.613546 20158 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9d048a3e74bbe881e95b755d283b2 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.615023 20159 tablet_service.cc:1511] Processing CreateTablet for tablet d65635bcd76f456a8718536b7af67b9c (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.616386 20233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9d048a3e74bbe881e95b755d283b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.620484 20157 tablet_service.cc:1511] Processing CreateTablet for tablet a13cdf5819024a6bbd18925349f5d0df (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.618165 20158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9d048a3e74bbe881e95b755d283b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.618150 20228 tablet_service.cc:1511] Processing CreateTablet for tablet d996d83c87b9401980d7153490ae6553 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.623108 20229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.623430 20156 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5947a4bee49c4b53470d5d45791b0 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.631196 20155 tablet_service.cc:1511] Processing CreateTablet for tablet cc95b42d746047cf946b56721a9694ab (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.632084 20159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65635bcd76f456a8718536b7af67b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.633643 20157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cdf5819024a6bbd18925349f5d0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.637372 20155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95b42d746047cf946b56721a9694ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.632190 20234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65635bcd76f456a8718536b7af67b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.645231 20154 tablet_service.cc:1511] Processing CreateTablet for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.654683 20228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d996d83c87b9401980d7153490ae6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.654963 20156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5947a4bee49c4b53470d5d45791b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.665076 20153 tablet_service.cc:1511] Processing CreateTablet for tablet d996d83c87b9401980d7153490ae6553 (DEFAULT_TABLE table=test-workload [id=5985c297f91543a09900b9dbbbad6ba1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.666642 20154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2508ea12c9cd4dcea7ea1ca9ab818d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.668915 20363 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:40.676542 20153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d996d83c87b9401980d7153490ae6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.677167 20235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59335a678c874c1dbf65969b9a5b14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.681010 20232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cdf5819024a6bbd18925349f5d0df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:40.699586 20115 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.793330 20364 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:40.817648 20365 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:40.823137 20363 tablet_bootstrap.cc:654] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.855069 20365 tablet_bootstrap.cc:654] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.854722 20363 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:40.855793 20363 ts_tablet_manager.cc:1403] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.006s
I20260709 13:05:40.857543 20364 tablet_bootstrap.cc:654] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.860608 20363 raft_consensus.cc:359] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.861397 20363 raft_consensus.cc:385] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.861703 20363 raft_consensus.cc:740] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.862475 20363 consensus_queue.cc:260] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.868988 20365 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:40.869606 20365 ts_tablet_manager.cc:1403] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.000s
I20260709 13:05:40.873543 20365 raft_consensus.cc:359] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.875538 20365 raft_consensus.cc:385] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.875931 20365 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.876854 20365 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.879673 20345 heartbeater.cc:499] Master 127.19.145.62:45205 was elected leader, sending a full tablet report...
I20260709 13:05:40.882138 20365 ts_tablet_manager.cc:1434] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:05:40.882570 20363 ts_tablet_manager.cc:1434] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.019s
I20260709 13:05:40.883090 20365 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:40.883569 20363 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:40.883617 20271 heartbeater.cc:499] Master 127.19.145.62:45205 was elected leader, sending a full tablet report...
I20260709 13:05:40.890268 20365 tablet_bootstrap.cc:654] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.890668 20363 tablet_bootstrap.cc:654] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.902721 20364 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:40.903219 20364 ts_tablet_manager.cc:1403] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.023s
I20260709 13:05:40.903434 20365 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:40.904619 20365 ts_tablet_manager.cc:1403] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:05:40.908069 20364 raft_consensus.cc:359] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.909364 20363 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
W20260709 13:05:40.910214 20272 tablet.cc:2406] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:40.909894 20363 ts_tablet_manager.cc:1403] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.016s
I20260709 13:05:40.911700 20365 raft_consensus.cc:359] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.912245 20365 raft_consensus.cc:385] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.912500 20365 raft_consensus.cc:740] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.913260 20365 consensus_queue.cc:260] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.915117 20365 ts_tablet_manager.cc:1434] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.003s
I20260709 13:05:40.916093 20365 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:40.918231 20363 raft_consensus.cc:359] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.919405 20363 raft_consensus.cc:385] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.919814 20363 raft_consensus.cc:740] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.918962 20364 raft_consensus.cc:385] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.920671 20364 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.921638 20364 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.922627 20365 tablet_bootstrap.cc:654] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.922617 20363 consensus_queue.cc:260] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.926601 20363 ts_tablet_manager.cc:1434] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:40.927423 20363 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:40.936015 20363 tablet_bootstrap.cc:654] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.941773 20196 heartbeater.cc:499] Master 127.19.145.62:45205 was elected leader, sending a full tablet report...
I20260709 13:05:40.946190 20364 ts_tablet_manager.cc:1434] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.008s
I20260709 13:05:40.947379 20364 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:40.948482 20365 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:40.949465 20365 ts_tablet_manager.cc:1403] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.006s
I20260709 13:05:40.952749 20365 raft_consensus.cc:359] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.953500 20365 raft_consensus.cc:385] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.953902 20364 tablet_bootstrap.cc:654] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.953819 20365 raft_consensus.cc:740] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.954824 20365 consensus_queue.cc:260] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.957368 20365 ts_tablet_manager.cc:1434] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:40.958323 20365 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:40.964136 20363 tablet_bootstrap.cc:492] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:40.964613 20363 ts_tablet_manager.cc:1403] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 13:05:40.965827 20365 tablet_bootstrap.cc:654] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.967450 20363 raft_consensus.cc:359] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.968158 20363 raft_consensus.cc:385] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.968446 20363 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.969132 20363 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.970669 20369 raft_consensus.cc:493] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.971144 20369 raft_consensus.cc:515] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:40.976576 20370 raft_consensus.cc:493] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.977095 20370 raft_consensus.cc:515] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:40.977887 20363 ts_tablet_manager.cc:1434] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:40.978823 20363 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:40.979738 20370 leader_election.cc:290] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209), dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585)
I20260709 13:05:40.976598 20369 leader_election.cc:290] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:40.998983 20363 tablet_bootstrap.cc:654] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.012044 20369 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.012707 20369 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.014701 20369 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.026050 20364 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.026739 20364 ts_tablet_manager.cc:1403] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.009s
I20260709 13:05:41.027540 20370 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.028147 20370 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.029335 20365 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.029796 20365 ts_tablet_manager.cc:1403] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.020s
I20260709 13:05:41.030958 20370 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.032936 20365 raft_consensus.cc:359] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.034052 20365 raft_consensus.cc:385] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.034328 20365 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.034766 20364 raft_consensus.cc:359] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.036198 20364 raft_consensus.cc:385] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.036579 20364 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.037834 20365 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.037585 20364 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.040072 20365 ts_tablet_manager.cc:1434] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:05:41.040829 20364 ts_tablet_manager.cc:1434] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:05:41.040992 20365 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:41.041709 20364 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.053670 20370 raft_consensus.cc:493] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.054169 20370 raft_consensus.cc:515] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.056236 20370 leader_election.cc:290] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.068904 20365 tablet_bootstrap.cc:654] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.071048 20364 tablet_bootstrap.cc:654] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.078570 20363 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.080001 20363 ts_tablet_manager.cc:1403] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.000s
I20260709 13:05:41.080104 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.081315 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
W20260709 13:05:41.085199 20283 leader_election.cc:343] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.085673 20363 raft_consensus.cc:359] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.086458 20363 raft_consensus.cc:385] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.086817 20363 raft_consensus.cc:740] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
W20260709 13:05:41.086023 20283 leader_election.cc:343] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.087785 20363 consensus_queue.cc:260] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.090158 20363 ts_tablet_manager.cc:1434] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:41.091116 20363 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:41.098999 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.098907 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
W20260709 13:05:41.107009 20209 leader_election.cc:343] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.107501 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.104629 20171 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 0.
I20260709 13:05:41.107551 20320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.110209 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.110349 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.110317 20320 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 0.
I20260709 13:05:41.112380 20209 leader_election.cc:304] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.112407 20319 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 0.
I20260709 13:05:41.113809 20370 raft_consensus.cc:2804] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:41.113906 20209 leader_election.cc:343] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.114228 20370 raft_consensus.cc:493] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.114571 20370 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.121199 20365 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.121722 20365 ts_tablet_manager.cc:1403] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.003s
I20260709 13:05:41.121641 20211 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: dfe77076b7ae4c69b750fa2c548ac213
W20260709 13:05:41.129669 20211 leader_election.cc:343] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.130158 20211 leader_election.cc:304] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2; no voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.130867 20363 tablet_bootstrap.cc:654] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.128178 20370 raft_consensus.cc:515] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:41.134518 20365 raft_consensus.cc:359] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.137562 20365 raft_consensus.cc:385] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.137678 20373 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.137893 20365 raft_consensus.cc:740] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.136070 20364 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.138355 20373 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.139438 20364 ts_tablet_manager.cc:1403] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.009s
I20260709 13:05:41.138702 20365 consensus_queue.cc:260] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.144476 20373 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.146756 20387 raft_consensus.cc:2749] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.148501 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.147926 20370 leader_election.cc:290] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Requested vote from peers 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209), dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585)
I20260709 13:05:41.149155 20318 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.149096 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:41.149914 20171 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.155767 20364 raft_consensus.cc:359] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.158566 20386 raft_consensus.cc:2804] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.159631 20364 raft_consensus.cc:385] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.162056 20364 raft_consensus.cc:740] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.162977 20364 consensus_queue.cc:260] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.161350 20386 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.183947 20364 ts_tablet_manager.cc:1434] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:05:41.187119 20364 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.184109 20386 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.191145 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.193048 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
W20260709 13:05:41.199111 20283 leader_election.cc:343] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.199729 20283 leader_election.cc:304] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a; no voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.200999 20369 raft_consensus.cc:2749] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.205423 20363 tablet_bootstrap.cc:492] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.205888 20363 ts_tablet_manager.cc:1403] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.013s
I20260709 13:05:41.206909 20318 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 1.
I20260709 13:05:41.214325 20211 leader_election.cc:304] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:41.210786 20171 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 1.
I20260709 13:05:41.216099 20363 raft_consensus.cc:359] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.218482 20388 raft_consensus.cc:2804] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.220458 20365 ts_tablet_manager.cc:1434] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.098s	user 0.010s	sys 0.027s
I20260709 13:05:41.220739 20388 raft_consensus.cc:697] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:41.221810 20365 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:41.220481 20363 raft_consensus.cc:385] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.225013 20363 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.231729 20369 raft_consensus.cc:493] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.232013 20364 tablet_bootstrap.cc:654] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.232270 20369 raft_consensus.cc:515] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.226876 20363 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.233371 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.234264 20246 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.232165 20388 consensus_queue.cc:237] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:41.237646 20134 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.238418 20369 leader_election.cc:290] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.240851 20373 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.240353 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.241282 20373 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.241636 20373 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.240353 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
W20260709 13:05:41.242808 20283 leader_election.cc:343] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:41.243562 20283 leader_election.cc:343] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.244768 20283 leader_election.cc:304] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a; no voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.246807 20369 raft_consensus.cc:2749] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.250795 20365 tablet_bootstrap.cc:654] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.256688 20373 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.265839 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.266803 20246 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.270195 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.271795 20318 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.275381 20386 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.276907 20245 raft_consensus.cc:2393] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97c118dde76a4be48a4f0cd86eac309a in current term 1: Already voted for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in this term.
I20260709 13:05:41.278666 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.279232 20318 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.278980 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
W20260709 13:05:41.281014 20209 leader_election.cc:343] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.287082 20386 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.290223 20246 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.290933 20283 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a; no voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.291734 20134 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.287554 20363 ts_tablet_manager.cc:1434] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.081s	user 0.020s	sys 0.009s
I20260709 13:05:41.294379 20363 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:41.293838 20373 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.295921 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.296435 20373 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.297676 20373 raft_consensus.cc:697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:41.298447 20373 consensus_queue.cc:237] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.303089 20319 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.296208 20067 catalog_manager.cc:5697] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.311829 20363 tablet_bootstrap.cc:654] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.308243 20365 tablet_bootstrap.cc:492] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.313103 20365 ts_tablet_manager.cc:1403] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.005s
I20260709 13:05:41.314917 20318 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 1.
I20260709 13:05:41.316478 20393 raft_consensus.cc:2749] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.320888 20211 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.321311 20365 raft_consensus.cc:359] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.321983 20386 raft_consensus.cc:2804] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.322489 20386 raft_consensus.cc:697] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:41.323503 20386 consensus_queue.cc:237] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.321985 20365 raft_consensus.cc:385] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.324878 20365 raft_consensus.cc:740] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.326414 20365 consensus_queue.cc:260] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.323977 20319 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.330206 20365 ts_tablet_manager.cc:1434] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:05:41.331883 20365 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:41.338689 20363 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.339241 20363 ts_tablet_manager.cc:1403] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.003s
I20260709 13:05:41.340904 20364 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.341454 20364 ts_tablet_manager.cc:1403] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.016s
I20260709 13:05:41.342016 20363 raft_consensus.cc:359] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.342671 20363 raft_consensus.cc:385] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.342944 20363 raft_consensus.cc:740] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.343686 20363 consensus_queue.cc:260] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.344672 20364 raft_consensus.cc:359] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.345356 20364 raft_consensus.cc:385] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.345634 20364 raft_consensus.cc:740] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.346073 20363 ts_tablet_manager.cc:1434] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:41.346323 20364 consensus_queue.cc:260] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.346983 20363 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:41.351449 20365 tablet_bootstrap.cc:654] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.358500 20364 ts_tablet_manager.cc:1434] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:05:41.359472 20364 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.360379 20397 raft_consensus.cc:493] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.360539 20363 tablet_bootstrap.cc:654] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.363121 20397 raft_consensus.cc:515] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.385321 20365 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.385812 20365 ts_tablet_manager.cc:1403] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.013s
I20260709 13:05:41.388608 20397 leader_election.cc:290] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.388877 20364 tablet_bootstrap.cc:654] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.389891 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.390322 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.390985 20319 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.391109 20246 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.393242 20136 leader_election.cc:304] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.395112 20365 raft_consensus.cc:359] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.395833 20365 raft_consensus.cc:385] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.396095 20365 raft_consensus.cc:740] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.396802 20365 consensus_queue.cc:260] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.397761 20397 raft_consensus.cc:2804] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.398337 20397 raft_consensus.cc:493] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.400414 20365 ts_tablet_manager.cc:1434] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:05:41.401563 20397 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.402154 20365 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:41.418586 20386 raft_consensus.cc:493] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.419338 20386 raft_consensus.cc:515] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.422127 20365 tablet_bootstrap.cc:654] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.423182 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
W20260709 13:05:41.425320 20209 leader_election.cc:343] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.427134 20386 leader_election.cc:290] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.427791 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
W20260709 13:05:41.429287 20211 leader_election.cc:343] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.429690 20211 leader_election.cc:304] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2; no voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:41.430318 20364 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.430750 20386 raft_consensus.cc:2749] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.430774 20364 ts_tablet_manager.cc:1403] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.072s	user 0.001s	sys 0.014s
I20260709 13:05:41.432078 20397 raft_consensus.cc:515] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.434046 20397 leader_election.cc:290] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.434114 20364 raft_consensus.cc:359] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.434556 20068 catalog_manager.cc:5697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 0 to 1, leader changed from <none> to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.435453 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.436029 20246 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.436376 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.436918 20319 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.437378 20363 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.437825 20363 ts_tablet_manager.cc:1403] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.013s
I20260709 13:05:41.440620 20363 raft_consensus.cc:359] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.441264 20363 raft_consensus.cc:385] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.441556 20363 raft_consensus.cc:740] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.442494 20246 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.434896 20364 raft_consensus.cc:385] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.443451 20364 raft_consensus.cc:740] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.443889 20134 leader_election.cc:304] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.444351 20397 raft_consensus.cc:493] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.444164 20364 consensus_queue.cc:260] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.444968 20373 raft_consensus.cc:2804] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.442427 20363 consensus_queue.cc:260] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.444828 20397 raft_consensus.cc:515] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.446259 20319 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.448868 20363 ts_tablet_manager.cc:1434] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:41.449851 20397 leader_election.cc:290] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.451746 20363 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:41.457614 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.458439 20373 raft_consensus.cc:697] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:41.459709 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.460427 20318 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.460160 20373 consensus_queue.cc:237] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.462010 20136 leader_election.cc:304] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
W20260709 13:05:41.463785 20134 leader_election.cc:343] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.472146 20365 tablet_bootstrap.cc:492] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.472602 20365 ts_tablet_manager.cc:1403] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.002s
I20260709 13:05:41.464986 20397 raft_consensus.cc:2804] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.472168 20363 tablet_bootstrap.cc:654] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.474717 20364 ts_tablet_manager.cc:1434] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.009s
I20260709 13:05:41.475140 20397 raft_consensus.cc:493] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.477756 20397 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.484035 20364 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.485877 20365 raft_consensus.cc:359] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.486337 20365 raft_consensus.cc:385] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.486521 20365 raft_consensus.cc:740] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.487612 20068 catalog_manager.cc:5697] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.491627 20365 consensus_queue.cc:260] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.495086 20365 ts_tablet_manager.cc:1434] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 13:05:41.496049 20365 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: Bootstrap starting.
I20260709 13:05:41.501056 20397 raft_consensus.cc:515] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.503350 20364 tablet_bootstrap.cc:654] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.503509 20363 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.503899 20363 ts_tablet_manager.cc:1403] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.010s
I20260709 13:05:41.508998 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.509613 20246 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.511888 20363 raft_consensus.cc:359] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.512564 20363 raft_consensus.cc:385] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.512828 20363 raft_consensus.cc:740] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.513459 20363 consensus_queue.cc:260] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.516041 20363 ts_tablet_manager.cc:1434] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:05:41.516885 20363 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: Bootstrap starting.
I20260709 13:05:41.517230 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.517575 20397 leader_election.cc:290] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.517992 20318 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.521130 20365 tablet_bootstrap.cc:654] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.515560 20066 catalog_manager.cc:5697] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 0 to 1, leader changed from <none> to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.531730 20246 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.533160 20318 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.544076 20136 leader_election.cc:304] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.546423 20397 raft_consensus.cc:2804] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.547065 20397 raft_consensus.cc:697] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:41.548168 20397 consensus_queue.cc:237] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.556999 20365 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: No bootstrap required, opened a new log
I20260709 13:05:41.558228 20365 ts_tablet_manager.cc:1403] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.011s
I20260709 13:05:41.560041 20364 tablet_bootstrap.cc:492] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.560669 20364 ts_tablet_manager.cc:1403] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.028s
I20260709 13:05:41.561033 20365 raft_consensus.cc:359] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.561750 20365 raft_consensus.cc:385] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.562117 20365 raft_consensus.cc:740] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.562884 20365 consensus_queue.cc:260] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.560128 20363 tablet_bootstrap.cc:654] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.564798 20365 ts_tablet_manager.cc:1434] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:41.571764 20067 catalog_manager.cc:5697] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 0 to 1, leader changed from <none> to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.575786 20364 raft_consensus.cc:359] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.576638 20364 raft_consensus.cc:385] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.576993 20364 raft_consensus.cc:740] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.577816 20364 consensus_queue.cc:260] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.581915 20364 ts_tablet_manager.cc:1434] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:05:41.584264 20364 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.586630 20363 tablet_bootstrap.cc:492] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: No bootstrap required, opened a new log
I20260709 13:05:41.587153 20363 ts_tablet_manager.cc:1403] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.015s
I20260709 13:05:41.590545 20363 raft_consensus.cc:359] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.591367 20363 raft_consensus.cc:385] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.591709 20363 raft_consensus.cc:740] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.592449 20363 consensus_queue.cc:260] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.594950 20364 tablet_bootstrap.cc:654] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.595149 20363 ts_tablet_manager.cc:1434] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:05:41.600525 20364 tablet_bootstrap.cc:492] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.603389 20364 ts_tablet_manager.cc:1403] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:05:41.605922 20364 raft_consensus.cc:359] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.606482 20364 raft_consensus.cc:385] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.606746 20364 raft_consensus.cc:740] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.607442 20364 consensus_queue.cc:260] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.609544 20364 ts_tablet_manager.cc:1434] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:41.610486 20364 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.616515 20364 tablet_bootstrap.cc:654] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.620656 20364 tablet_bootstrap.cc:492] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.621399 20364 ts_tablet_manager.cc:1403] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:05:41.623163 20364 raft_consensus.cc:359] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.623781 20364 raft_consensus.cc:385] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.624047 20364 raft_consensus.cc:740] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.624629 20364 consensus_queue.cc:260] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.626276 20364 ts_tablet_manager.cc:1434] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:41.627214 20364 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: Bootstrap starting.
I20260709 13:05:41.632993 20364 tablet_bootstrap.cc:654] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.637859 20364 tablet_bootstrap.cc:492] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: No bootstrap required, opened a new log
I20260709 13:05:41.638296 20364 ts_tablet_manager.cc:1403] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:05:41.640100 20364 raft_consensus.cc:359] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.640611 20364 raft_consensus.cc:385] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.640842 20364 raft_consensus.cc:740] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.641305 20364 consensus_queue.cc:260] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.642690 20364 ts_tablet_manager.cc:1434] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:41.693910 20393 raft_consensus.cc:493] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.694417 20393 raft_consensus.cc:515] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.696504 20393 leader_election.cc:290] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.697683 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.697681 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.698474 20171 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 0.
I20260709 13:05:41.698485 20246 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 0.
I20260709 13:05:41.699699 20283 leader_election.cc:304] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:41.700394 20393 raft_consensus.cc:2804] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.700735 20393 raft_consensus.cc:493] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.701058 20393 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.704216 20386 raft_consensus.cc:493] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.704425 20115 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:41.704707 20386 raft_consensus.cc:515] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.706585 20386 leader_election.cc:290] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.707378 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.707974 20171 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 0.
I20260709 13:05:41.708039 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.708760 20318 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 0.
I20260709 13:05:41.708716 20393 raft_consensus.cc:515] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.709456 20209 leader_election.cc:304] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.710471 20386 raft_consensus.cc:2804] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.710856 20386 raft_consensus.cc:493] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.711064 20393 leader_election.cc:290] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.712028 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.711994 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:41.712693 20246 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.712749 20171 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.711199 20386 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.719337 20171 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 1.
I20260709 13:05:41.719337 20246 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 1.
I20260709 13:05:41.720615 20283 leader_election.cc:304] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.721534 20393 raft_consensus.cc:2804] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.722043 20393 raft_consensus.cc:697] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:41.722084 20386 raft_consensus.cc:515] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.722934 20393 consensus_queue.cc:237] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.725108 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:41.725167 20386 leader_election.cc:290] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.725404 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.725989 20171 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.726087 20318 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.732899 20171 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 1.
I20260709 13:05:41.732956 20318 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 1.
I20260709 13:05:41.734342 20209 leader_election.cc:304] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.735875 20386 raft_consensus.cc:2804] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.736358 20386 raft_consensus.cc:697] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:41.737145 20386 consensus_queue.cc:237] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.741429 20373 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.740981 20067 catalog_manager.cc:5697] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 1 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.741896 20373 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.743424 20397 raft_consensus.cc:493] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.743863 20397 raft_consensus.cc:515] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.744925 20373 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.745808 20397 leader_election.cc:290] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.748026 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.749336 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.749908 20245 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.751962 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.751528 20068 catalog_manager.cc:5697] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.752629 20318 raft_consensus.cc:2393] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfe77076b7ae4c69b750fa2c548ac213 in current term 1: Already voted for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in this term.
I20260709 13:05:41.752765 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a" is_pre_election: true
I20260709 13:05:41.753387 20319 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 0.
I20260709 13:05:41.754671 20134 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfe77076b7ae4c69b750fa2c548ac213; no voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a
I20260709 13:05:41.755123 20136 leader_election.cc:304] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.756081 20397 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.756345 20373 raft_consensus.cc:2804] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.756706 20373 raft_consensus.cc:493] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.757115 20373 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.763446 20397 raft_consensus.cc:2749] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.763993 20373 raft_consensus.cc:515] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.766757 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.767009 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:41.767473 20245 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.767591 20319 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.771883 20373 leader_election.cc:290] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:41.772107 20319 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.773170 20136 leader_election.cc:304] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.773813 20373 raft_consensus.cc:2804] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.774014 20245 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 1.
I20260709 13:05:41.774255 20373 raft_consensus.cc:697] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:41.775178 20373 consensus_queue.cc:237] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.783013 20068 catalog_manager.cc:5697] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 0 to 1, leader changed from <none> to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.804092 20386 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.806221 20373 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.813890 20393 raft_consensus.cc:493] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.814384 20393 raft_consensus.cc:515] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.816431 20393 leader_election.cc:290] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.821358 20386 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.822046 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213" is_pre_election: true
I20260709 13:05:41.822662 20171 raft_consensus.cc:2468] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 0.
I20260709 13:05:41.825186 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" is_pre_election: true
I20260709 13:05:41.825958 20245 raft_consensus.cc:2468] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 0.
I20260709 13:05:41.826733 20283 leader_election.cc:304] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:41.827862 20393 raft_consensus.cc:2804] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.828202 20393 raft_consensus.cc:493] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.828519 20393 raft_consensus.cc:3060] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.835376 20386 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.836081 20393 raft_consensus.cc:515] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.845239 20430 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.849503 20393 leader_election.cc:290] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:41.860715 20169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:41.861692 20169 raft_consensus.cc:3060] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.851127 20246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d996d83c87b9401980d7153490ae6553" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:41.864753 20246 raft_consensus.cc:3060] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.876668 20246 raft_consensus.cc:2468] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 1.
I20260709 13:05:41.877771 20283 leader_election.cc:304] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:41.878422 20169 raft_consensus.cc:2468] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 1.
I20260709 13:05:41.878736 20393 raft_consensus.cc:2804] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.879554 20393 raft_consensus.cc:697] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:41.877791 20397 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:41.880460 20393 consensus_queue.cc:237] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:41.897529 20409 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:05:41.930290 20410 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.941628 20409 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.961983 20067 catalog_manager.cc:5697] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 1 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.971575 20397 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.049628 20246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:42.050380 20246 raft_consensus.cc:606] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:42.055445 20246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:42.056052 20246 raft_consensus.cc:606] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:42.072580 20318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:05:42.073187 20318 raft_consensus.cc:606] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:42.086869 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:42.087507 20171 raft_consensus.cc:606] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:42.094748 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:42.095376 20171 raft_consensus.cc:606] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:42.100147 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:42.100729 20171 raft_consensus.cc:606] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:42.160331 20386 consensus_queue.cc:1048] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.170017 20386 consensus_queue.cc:1048] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.194952 20393 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.208290 20393 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.212182 20410 raft_consensus.cc:993] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.212625 20410 raft_consensus.cc:1081] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.219131 20246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:42.219779 20246 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.220155 20246 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.221163 20446 raft_consensus.cc:993] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.221560 20369 raft_consensus.cc:1081] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.223295 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50966
I20260709 13:05:42.223816 20170 raft_consensus.cc:493] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.224148 20170 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.227427 20246 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.229264 20170 raft_consensus.cc:515] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.230518 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:42.230748 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.231113 20171 raft_consensus.cc:3055] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.231376 20318 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.231519 20171 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.232630 20171 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.233815 20171 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.237632 20318 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.238919 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:42.239504 20245 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.239652 20170 leader_election.cc:290] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:42.240475 20171 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.241578 20209 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:42.242328 20386 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.242790 20386 raft_consensus.cc:697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:42.243628 20386 consensus_queue.cc:237] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.244359 20320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.244874 20320 raft_consensus.cc:3055] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.245182 20320 raft_consensus.cc:740] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:42.245965 20320 consensus_queue.cc:260] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.247159 20320 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.249094 20246 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:42.251368 20245 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.252475 20134 leader_election.cc:304] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:42.253188 20373 raft_consensus.cc:2804] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.253636 20373 raft_consensus.cc:697] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.254348 20373 consensus_queue.cc:237] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.255309 20320 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.252338 20068 catalog_manager.cc:5697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 1 to 2, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.263298 20067 catalog_manager.cc:5697] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 1 to 2, leader changed from 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.322728 20373 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.337308 20373 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.347213 20409 raft_consensus.cc:993] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.347679 20409 raft_consensus.cc:1081] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.349303 20245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:42.349913 20245 raft_consensus.cc:493] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.350350 20245 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.356956 20245 raft_consensus.cc:515] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.359025 20245 leader_election.cc:290] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:42.360932 20320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.361101 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:42.361510 20320 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.361855 20171 raft_consensus.cc:3055] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.362236 20171 raft_consensus.cc:740] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.363173 20171 consensus_queue.cc:260] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.364426 20171 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.368184 20320 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.370074 20211 leader_election.cc:304] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:42.370904 20386 raft_consensus.cc:2804] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.371204 20171 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.371469 20386 raft_consensus.cc:697] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:42.373783 20386 consensus_queue.cc:237] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.380422 20068 catalog_manager.cc:5697] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 1 to 2, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.452849 20393 consensus_queue.cc:1048] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.464666 20373 raft_consensus.cc:993] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.465107 20373 raft_consensus.cc:1081] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:42.466568 20425 raft_consensus.cc:993] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.466974 20425 raft_consensus.cc:1081] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.467736 20246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:42.468271 20246 raft_consensus.cc:493] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.468607 20246 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.468794 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50980
I20260709 13:05:42.469297 20171 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.469655 20171 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.473778 20369 consensus_queue.cc:1048] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.478188 20171 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.481683 20430 raft_consensus.cc:993] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.482113 20430 raft_consensus.cc:1081] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:42.482282 20320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.482899 20320 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.484560 20169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50980
I20260709 13:05:42.485076 20169 raft_consensus.cc:493] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.485436 20169 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.485766 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:42.486831 20245 raft_consensus.cc:3055] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.487633 20245 raft_consensus.cc:740] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:42.481698 20171 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:42.495653 20245 consensus_queue.cc:260] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.497013 20245 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.499420 20320 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.500658 20136 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:42.501528 20409 raft_consensus.cc:2804] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.501967 20409 raft_consensus.cc:697] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.502749 20409 consensus_queue.cc:237] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.504892 20169 raft_consensus.cc:515] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:42.508230 20244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:42.508872 20244 raft_consensus.cc:3055] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.509222 20244 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:42.508953 20246 raft_consensus.cc:515] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.509991 20244 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:42.511996 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:42.509057 20320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.512614 20171 raft_consensus.cc:3055] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.512955 20171 raft_consensus.cc:740] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.513003 20320 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.513815 20171 consensus_queue.cc:260] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.514880 20171 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.517446 20067 catalog_manager.cc:5697] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 1 to 2, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.512123 20245 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.511092 20244 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.507076 20169 leader_election.cc:290] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Requested vote from peers 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:42.527159 20320 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.528059 20171 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.529321 20136 leader_election.cc:304] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:42.529446 20244 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:42.530231 20409 raft_consensus.cc:2804] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.530714 20409 raft_consensus.cc:697] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:42.531369 20209 leader_election.cc:304] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:42.531577 20409 consensus_queue.cc:237] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:42.532167 20425 raft_consensus.cc:2804] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.532627 20425 raft_consensus.cc:697] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:42.532920 20246 leader_election.cc:290] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:42.533409 20425 consensus_queue.cc:237] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:42.538028 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:42.538611 20318 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.543304 20068 catalog_manager.cc:5697] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 1 to 2, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.547039 20318 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:42.546492 20066 catalog_manager.cc:5697] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 1 to 2, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.673069 20318 raft_consensus.cc:1275] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.674331 20373 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.685521 20246 raft_consensus.cc:1275] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.687007 20373 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.710346 20171 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.711781 20425 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.723143 20318 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.725127 20386 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.820552 20320 raft_consensus.cc:1275] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.821835 20386 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.829011 20171 raft_consensus.cc:1275] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.830557 20430 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.917788 20320 raft_consensus.cc:1275] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.919190 20373 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.927095 20246 raft_consensus.cc:1275] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.928620 20409 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.989773 20320 raft_consensus.cc:1275] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.991061 20430 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.999150 20171 raft_consensus.cc:1275] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.000857 20386 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.053933 20244 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.228565 20409 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.957582 20320 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.959956 20373 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:44.775689 20192 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 20039
W20260709 13:05:44.776448 20192 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 20102
W20260709 13:05:44.777189 20192 debug-util.cc:398] Leaking SignalData structure 0x7b0800192bc0 after lost signal to thread 20195
W20260709 13:05:44.777855 20192 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7d80 after lost signal to thread 20270
W20260709 13:05:44.778493 20192 debug-util.cc:398] Leaking SignalData structure 0x7b080019bb80 after lost signal to thread 20344
I20260709 13:05:45.320163 20036 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:45.321275 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.358388 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:45.359062 20245 raft_consensus.cc:606] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Received request to transfer leadership to TS 97c118dde76a4be48a4f0cd86eac309a
I20260709 13:05:45.370848 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:51868
I20260709 13:05:45.371439 20170 raft_consensus.cc:606] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Received request to transfer leadership to TS 97c118dde76a4be48a4f0cd86eac309a
I20260709 13:05:45.372550 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:45.372991 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:45.540993 20468 raft_consensus.cc:993] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:45.541460 20425 raft_consensus.cc:1081] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Signalling peer 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:45.542886 20318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:52268
I20260709 13:05:45.543401 20318 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.543697 20318 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.548310 20318 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:45.550020 20318 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:45.551098 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:45.551515 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:45.551780 20170 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.552088 20245 raft_consensus.cc:3055] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.552438 20245 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:45.553315 20245 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:45.554502 20245 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.558797 20170 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:45.560173 20283 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:45.561015 20369 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.561246 20245 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:45.562883 20369 raft_consensus.cc:697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:45.563784 20369 consensus_queue.cc:237] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:45.573722 20409 raft_consensus.cc:993] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:45.574213 20471 raft_consensus.cc:1081] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Signalling peer 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:45.575361 20068 catalog_manager.cc:5697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 2 to 3, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 3 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.576040 20318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:52274
I20260709 13:05:45.576645 20318 raft_consensus.cc:493] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.577047 20318 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.584640 20318 raft_consensus.cc:515] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:45.587347 20318 leader_election.cc:290] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585)
I20260709 13:05:45.588063 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:45.588341 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:45.588639 20245 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.588860 20170 raft_consensus.cc:3055] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.589162 20170 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:45.589936 20170 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:45.591102 20170 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.595325 20245 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:45.596513 20283 leader_election.cc:304] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:45.597309 20369 raft_consensus.cc:2804] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.597816 20369 raft_consensus.cc:697] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:45.597841 20170 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:45.598798 20369 consensus_queue.cc:237] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:45.607743 20068 catalog_manager.cc:5697] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 2 to 3, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 3 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.995092 20245 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.996562 20369 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.021953 20170 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.023932 20369 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.127203 20243 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.128583 20469 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.141929 20170 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.143894 20484 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:46.373775 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:46.383363 20318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:05:46.383869 20318 raft_consensus.cc:606] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:46.389135 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:46.389808 20170 raft_consensus.cc:606] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:46.394913 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:46.395594 20170 raft_consensus.cc:606] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:46.400372 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:05:46.400971 20170 raft_consensus.cc:606] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:46.414330 20318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
mode: GRACEFUL
new_leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:05:46.414851 20318 raft_consensus.cc:606] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Received request to transfer leadership to TS 6521fb3de1674f9fb0a3437d77fc2ea2
I20260709 13:05:46.424201 20486 raft_consensus.cc:993] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.424715 20471 raft_consensus.cc:1081] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.426090 20243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:46.426529 20243 raft_consensus.cc:493] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.426826 20243 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.431103 20243 raft_consensus.cc:515] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.432840 20243 leader_election.cc:290] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:46.433615 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:46.433947 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:46.434270 20170 raft_consensus.cc:3055] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:46.434609 20318 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.434641 20170 raft_consensus.cc:740] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:46.435667 20170 consensus_queue.cc:260] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.436964 20170 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.439097 20318 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:46.440148 20211 leader_election.cc:304] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:46.440788 20425 raft_consensus.cc:2804] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:46.441246 20425 raft_consensus.cc:697] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:46.442045 20425 consensus_queue.cc:237] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.444123 20170 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 2.
I20260709 13:05:46.450016 20067 catalog_manager.cc:5697] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 1 to 2, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.540145 20469 raft_consensus.cc:993] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.540592 20469 raft_consensus.cc:1081] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.543210 20243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44802
I20260709 13:05:46.543512 20486 raft_consensus.cc:993] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.543834 20243 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.543993 20471 raft_consensus.cc:1081] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.544315 20243 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.545463 20245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:46.545971 20245 raft_consensus.cc:493] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.546325 20245 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.550527 20245 raft_consensus.cc:515] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.551592 20243 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.553125 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:46.553308 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9d048a3e74bbe881e95b755d283b2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:46.553678 20170 raft_consensus.cc:3055] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:46.553897 20243 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 4 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:46.554081 20170 raft_consensus.cc:740] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:46.553735 20318 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.555084 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:46.554982 20170 consensus_queue.cc:260] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.555680 20319 raft_consensus.cc:3055] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.555996 20319 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:46.556129 20170 raft_consensus.cc:3060] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.556752 20319 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.557880 20319 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.559338 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:46.559878 20171 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.562343 20318 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 3.
I20260709 13:05:46.564122 20211 leader_election.cc:304] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, 97c118dde76a4be48a4f0cd86eac309a; no voters: 
I20260709 13:05:46.565003 20425 raft_consensus.cc:2804] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.565501 20425 raft_consensus.cc:697] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:46.566355 20171 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 4.
I20260709 13:05:46.566301 20425 consensus_queue.cc:237] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.567656 20209 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:46.568063 20170 raft_consensus.cc:2468] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 3.
I20260709 13:05:46.568543 20482 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.571791 20482 raft_consensus.cc:697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:46.572286 20245 leader_election.cc:290] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 3 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:46.572748 20482 consensus_queue.cc:237] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.576067 20319 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 4.
I20260709 13:05:46.581101 20067 catalog_manager.cc:5697] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 2 to 3, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.593271 20067 catalog_manager.cc:5697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 3 to 4, leader changed from 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.719025 20469 raft_consensus.cc:993] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.719568 20369 raft_consensus.cc:1081] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.721138 20245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44802
I20260709 13:05:46.721645 20245 raft_consensus.cc:493] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.721973 20245 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.727209 20245 raft_consensus.cc:515] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:46.728868 20245 leader_election.cc:290] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 4 election: Requested vote from peers 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209), dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585)
I20260709 13:05:46.729758 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:46.729992 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7060d7a4d73419386b2a0a47c49c00d" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:46.730445 20319 raft_consensus.cc:3055] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.730579 20171 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.730837 20319 raft_consensus.cc:740] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:46.731846 20319 consensus_queue.cc:260] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:46.733155 20319 raft_consensus.cc:3060] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.735400 20171 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 4.
I20260709 13:05:46.736400 20209 leader_election.cc:304] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:46.737071 20425 raft_consensus.cc:2804] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.737504 20425 raft_consensus.cc:697] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:46.738318 20425 consensus_queue.cc:237] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } }
I20260709 13:05:46.740757 20319 raft_consensus.cc:2468] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 4.
I20260709 13:05:46.745126 20067 catalog_manager.cc:5697] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 3 to 4, leader changed from 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.817974 20486 raft_consensus.cc:993] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: : Instructing follower 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.818411 20471 raft_consensus.cc:1081] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Signalling peer 6521fb3de1674f9fb0a3437d77fc2ea2 to start an election
I20260709 13:05:46.820140 20245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
 from {username='slave'} at 127.0.0.1:44814
I20260709 13:05:46.820752 20245 raft_consensus.cc:493] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.821142 20245 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.828655 20245 raft_consensus.cc:515] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.830790 20245 leader_election.cc:290] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 3 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:46.831506 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:46.831959 20319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59335a678c874c1dbf65969b9a5b14c2" candidate_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:46.832558 20171 raft_consensus.cc:3055] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:46.832615 20319 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.833002 20171 raft_consensus.cc:740] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:46.833725 20171 consensus_queue.cc:260] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.834621 20171 raft_consensus.cc:3060] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.839005 20171 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 3.
I20260709 13:05:46.839816 20319 raft_consensus.cc:2468] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6521fb3de1674f9fb0a3437d77fc2ea2 in term 3.
I20260709 13:05:46.839960 20209 leader_election.cc:304] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6521fb3de1674f9fb0a3437d77fc2ea2, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:46.840911 20425 raft_consensus.cc:2804] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.841333 20425 raft_consensus.cc:697] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 LEADER]: Becoming Leader. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:46.842139 20425 consensus_queue.cc:237] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:46.850011 20067 catalog_manager.cc:5697] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 reported cstate change: term changed from 2 to 3, leader changed from dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1) to 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.862696 20171 raft_consensus.cc:1275] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.863984 20425 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.875995 20319 raft_consensus.cc:1275] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.877429 20482 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.979174 20318 raft_consensus.cc:1275] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.980597 20482 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.989315 20171 raft_consensus.cc:1275] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.990927 20482 consensus_queue.cc:1048] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.037096 20318 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:47.038376 20482 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.049300 20171 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:47.050853 20425 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.229305 20171 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:47.230476 20425 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.239792 20318 raft_consensus.cc:1275] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:47.242204 20491 consensus_queue.cc:1048] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.298029 20318 raft_consensus.cc:1275] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.299419 20482 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.311026 20171 raft_consensus.cc:1275] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Refusing update from remote peer 6521fb3de1674f9fb0a3437d77fc2ea2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.312510 20482 consensus_queue.cc:1048] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.420326 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.427987 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:49.428653 20245 raft_consensus.cc:606] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Received request to transfer leadership to TS 97c118dde76a4be48a4f0cd86eac309a
I20260709 13:05:49.431248 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:49.431697 20245 raft_consensus.cc:606] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:49.433681 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:49.434080 20245 raft_consensus.cc:606] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:49.436225 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:49.436601 20245 raft_consensus.cc:606] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Received request to transfer leadership to TS dfe77076b7ae4c69b750fa2c548ac213
I20260709 13:05:49.438577 20245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c"
dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
mode: GRACEFUL
new_leader_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:05:49.438962 20245 raft_consensus.cc:606] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Received request to transfer leadership to TS 97c118dde76a4be48a4f0cd86eac309a
I20260709 13:05:49.439901 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:49.440268 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:49.468858 20425 raft_consensus.cc:993] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:49.469368 20482 raft_consensus.cc:1081] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Signalling peer 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:49.470671 20318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:52268
I20260709 13:05:49.471110 20318 raft_consensus.cc:493] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.471455 20318 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.475919 20318 raft_consensus.cc:515] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.477705 20318 leader_election.cc:290] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:49.478751 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:49.478935 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65635bcd76f456a8718536b7af67b9c" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:49.479521 20171 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.479604 20245 raft_consensus.cc:3055] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.479990 20245 raft_consensus.cc:740] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:49.480719 20245 consensus_queue.cc:260] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.481633 20245 raft_consensus.cc:3060] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.483760 20171 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:49.484860 20283 leader_election.cc:304] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:49.485642 20369 raft_consensus.cc:2804] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.486578 20245 raft_consensus.cc:2468] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 3.
I20260709 13:05:49.486619 20369 raft_consensus.cc:697] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:49.487725 20369 consensus_queue.cc:237] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.494761 20066 catalog_manager.cc:5697] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 2 to 3, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 3 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.537525 20425 raft_consensus.cc:993] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:49.537941 20482 raft_consensus.cc:1081] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Signalling peer 97c118dde76a4be48a4f0cd86eac309a to start an election
I20260709 13:05:49.539216 20318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b"
dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
 from {username='slave'} at 127.0.0.1:52268
I20260709 13:05:49.539641 20318 raft_consensus.cc:493] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.539914 20318 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.543913 20318 raft_consensus.cc:515] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.545245 20318 leader_election.cc:290] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 5 election: Requested vote from peers dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585), 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905)
I20260709 13:05:49.546015 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
I20260709 13:05:49.546377 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2508ea12c9cd4dcea7ea1ca9ab818d5b" candidate_uuid: "97c118dde76a4be48a4f0cd86eac309a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:49.546615 20171 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.546842 20245 raft_consensus.cc:3055] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.547132 20245 raft_consensus.cc:740] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:49.547792 20245 consensus_queue.cc:260] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.548645 20245 raft_consensus.cc:3060] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.550711 20171 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 5.
I20260709 13:05:49.551672 20283 leader_election.cc:304] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:49.552320 20369 raft_consensus.cc:2804] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:49.552735 20245 raft_consensus.cc:2468] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c118dde76a4be48a4f0cd86eac309a in term 5.
I20260709 13:05:49.552822 20369 raft_consensus.cc:697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 5 LEADER]: Becoming Leader. State: Replica: 97c118dde76a4be48a4f0cd86eac309a, State: Running, Role: LEADER
I20260709 13:05:49.553686 20369 consensus_queue.cc:237] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.560349 20066 catalog_manager.cc:5697] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a reported cstate change: term changed from 4 to 5, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3). New cstate: current_term: 5 leader_uuid: "97c118dde76a4be48a4f0cd86eac309a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.567647 20425 raft_consensus.cc:993] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.568089 20425 raft_consensus.cc:1081] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.569483 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50980
I20260709 13:05:49.569895 20171 raft_consensus.cc:493] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.570148 20171 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.573732 20171 raft_consensus.cc:515] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.575323 20171 leader_election.cc:290] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 3 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:49.576077 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:49.576409 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95b42d746047cf946b56721a9694ab" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:49.576547 20245 raft_consensus.cc:3055] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.576854 20245 raft_consensus.cc:740] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:49.576869 20318 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.577621 20245 consensus_queue.cc:260] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.578426 20245 raft_consensus.cc:3060] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.580974 20318 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 3.
I20260709 13:05:49.582072 20136 leader_election.cc:304] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:49.582412 20245 raft_consensus.cc:2468] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 3.
I20260709 13:05:49.583745 20516 raft_consensus.cc:2804] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.584764 20516 raft_consensus.cc:697] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 3 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:49.585641 20516 consensus_queue.cc:237] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.592021 20066 catalog_manager.cc:5697] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 2 to 3, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.667966 20482 raft_consensus.cc:993] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.668422 20425 raft_consensus.cc:1081] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.669611 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50980
I20260709 13:05:49.670025 20171 raft_consensus.cc:493] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.670288 20171 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.674000 20171 raft_consensus.cc:515] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.675503 20171 leader_election.cc:290] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 3 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:49.676177 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:49.676467 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cdf5819024a6bbd18925349f5d0df" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:49.676651 20245 raft_consensus.cc:3055] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.676947 20245 raft_consensus.cc:740] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:49.676972 20318 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.677659 20245 consensus_queue.cc:260] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.678432 20245 raft_consensus.cc:3060] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.680871 20318 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 3.
I20260709 13:05:49.681680 20136 leader_election.cc:304] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:49.682391 20516 raft_consensus.cc:2804] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.682904 20516 raft_consensus.cc:697] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 3 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:49.683115 20245 raft_consensus.cc:2468] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 3.
I20260709 13:05:49.683876 20516 consensus_queue.cc:237] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.690577 20066 catalog_manager.cc:5697] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 2 to 3, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.874943 20171 raft_consensus.cc:1275] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.876168 20369 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.878572 20482 raft_consensus.cc:993] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: : Instructing follower dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.879019 20425 raft_consensus.cc:1081] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Signalling peer dfe77076b7ae4c69b750fa2c548ac213 to start an election
I20260709 13:05:49.880733 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0"
dest_uuid: "dfe77076b7ae4c69b750fa2c548ac213"
 from {username='slave'} at 127.0.0.1:50980
I20260709 13:05:49.881362 20170 raft_consensus.cc:493] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.881776 20170 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.889406 20170 raft_consensus.cc:515] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.892011 20245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2"
I20260709 13:05:49.892320 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d5947a4bee49c4b53470d5d45791b0" candidate_uuid: "dfe77076b7ae4c69b750fa2c548ac213" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c118dde76a4be48a4f0cd86eac309a"
I20260709 13:05:49.892570 20245 raft_consensus.cc:3055] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.892823 20318 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.892899 20245 raft_consensus.cc:740] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6521fb3de1674f9fb0a3437d77fc2ea2, State: Running, Role: LEADER
I20260709 13:05:49.893692 20245 consensus_queue.cc:260] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.894626 20245 raft_consensus.cc:3060] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.897346 20318 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:49.898259 20136 leader_election.cc:304] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c118dde76a4be48a4f0cd86eac309a, dfe77076b7ae4c69b750fa2c548ac213; no voters: 
I20260709 13:05:49.899029 20245 raft_consensus.cc:2468] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfe77076b7ae4c69b750fa2c548ac213 in term 2.
I20260709 13:05:49.899086 20516 raft_consensus.cc:2804] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.899982 20516 raft_consensus.cc:697] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Becoming Leader. State: Replica: dfe77076b7ae4c69b750fa2c548ac213, State: Running, Role: LEADER
I20260709 13:05:49.901015 20516 consensus_queue.cc:237] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } }
I20260709 13:05:49.899374 20170 leader_election.cc:290] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [CANDIDATE]: Term 2 election: Requested vote from peers 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2:36905), 97c118dde76a4be48a4f0cd86eac309a (127.19.145.3:44209)
I20260709 13:05:49.903968 20245 raft_consensus.cc:1275] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.905329 20369 consensus_queue.cc:1048] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.909829 20067 catalog_manager.cc:5697] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 reported cstate change: term changed from 1 to 2, leader changed from 6521fb3de1674f9fb0a3437d77fc2ea2 (127.19.145.2) to dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "dfe77076b7ae4c69b750fa2c548ac213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.022171 20170 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 5 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:50.023576 20369 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfe77076b7ae4c69b750fa2c548ac213" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.033206 20245 raft_consensus.cc:1275] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 5 FOLLOWER]: Refusing update from remote peer 97c118dde76a4be48a4f0cd86eac309a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:50.034518 20523 consensus_queue.cc:1048] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.060456 20318 raft_consensus.cc:1275] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.061655 20516 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.070101 20245 raft_consensus.cc:1275] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.072235 20516 consensus_queue.cc:1048] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.195811 20245 raft_consensus.cc:1275] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.197139 20516 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6521fb3de1674f9fb0a3437d77fc2ea2" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 36905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.205763 20318 raft_consensus.cc:1275] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Refusing update from remote peer dfe77076b7ae4c69b750fa2c548ac213: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.207005 20533 consensus_queue.cc:1048] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c118dde76a4be48a4f0cd86eac309a" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.440958 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.446122 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
W20260709 13:05:50.469516 20283 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:50.472823 20283 consensus_peers.cc:597] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a -> Peer dfe77076b7ae4c69b750fa2c548ac213 (127.19.145.1:39585): Couldn't send request to peer dfe77076b7ae4c69b750fa2c548ac213. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.474583 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.475283 20036 tablet_replica.cc:333] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.475968 20036 raft_consensus.cc:2243] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.476437 20036 raft_consensus.cc:2272] T 1ac9d048a3e74bbe881e95b755d283b2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.478615 20036 tablet_replica.cc:333] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.479193 20036 raft_consensus.cc:2243] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.479772 20036 pending_rounds.cc:70] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Trying to abort 1 pending ops.
I20260709 13:05:50.479971 20036 pending_rounds.cc:77] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635225206398976 op_type: NO_OP noop_request { }
I20260709 13:05:50.480228 20036 raft_consensus.cc:2889] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:50.480445 20036 raft_consensus.cc:2272] T 67d5947a4bee49c4b53470d5d45791b0 P dfe77076b7ae4c69b750fa2c548ac213 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.482175 20036 tablet_replica.cc:333] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.482610 20036 raft_consensus.cc:2243] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.482968 20036 raft_consensus.cc:2272] T d996d83c87b9401980d7153490ae6553 P dfe77076b7ae4c69b750fa2c548ac213 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.484499 20036 tablet_replica.cc:333] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.484937 20036 raft_consensus.cc:2243] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.485276 20036 raft_consensus.cc:2272] T d65635bcd76f456a8718536b7af67b9c P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.486976 20036 tablet_replica.cc:333] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.487514 20036 raft_consensus.cc:2243] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.488149 20036 raft_consensus.cc:2272] T cc95b42d746047cf946b56721a9694ab P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.489784 20036 tablet_replica.cc:333] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.490216 20036 raft_consensus.cc:2243] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.490547 20036 raft_consensus.cc:2272] T 59335a678c874c1dbf65969b9a5b14c2 P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.491986 20036 tablet_replica.cc:333] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.492383 20036 raft_consensus.cc:2243] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.492992 20036 raft_consensus.cc:2272] T a13cdf5819024a6bbd18925349f5d0df P dfe77076b7ae4c69b750fa2c548ac213 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.494731 20036 tablet_replica.cc:333] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.495155 20036 raft_consensus.cc:2243] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.495625 20036 raft_consensus.cc:2272] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P dfe77076b7ae4c69b750fa2c548ac213 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.497576 20036 tablet_replica.cc:333] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213: stopping tablet replica
I20260709 13:05:50.497967 20036 raft_consensus.cc:2243] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.498332 20036 raft_consensus.cc:2272] T f7060d7a4d73419386b2a0a47c49c00d P dfe77076b7ae4c69b750fa2c548ac213 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.613196 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
I20260709 13:05:50.631114 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
I20260709 13:05:50.654458 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.655128 20036 tablet_replica.cc:333] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.655759 20036 raft_consensus.cc:2243] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.656556 20036 raft_consensus.cc:2272] T 1ac9d048a3e74bbe881e95b755d283b2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.658159 20036 tablet_replica.cc:333] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.658675 20036 raft_consensus.cc:2243] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.659433 20036 raft_consensus.cc:2272] T f7060d7a4d73419386b2a0a47c49c00d P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.661077 20036 tablet_replica.cc:333] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.661576 20036 raft_consensus.cc:2243] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.661947 20036 raft_consensus.cc:2272] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.663928 20036 tablet_replica.cc:333] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.664422 20036 raft_consensus.cc:2243] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.664793 20036 raft_consensus.cc:2272] T d65635bcd76f456a8718536b7af67b9c P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.666627 20036 tablet_replica.cc:333] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.667129 20036 raft_consensus.cc:2243] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.667562 20036 raft_consensus.cc:2272] T 67d5947a4bee49c4b53470d5d45791b0 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.669064 20036 tablet_replica.cc:333] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.669533 20036 raft_consensus.cc:2243] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.669893 20036 raft_consensus.cc:2272] T d996d83c87b9401980d7153490ae6553 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.671432 20036 tablet_replica.cc:333] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.671840 20036 raft_consensus.cc:2243] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.672190 20036 raft_consensus.cc:2272] T cc95b42d746047cf946b56721a9694ab P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.673985 20036 tablet_replica.cc:333] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.674430 20036 raft_consensus.cc:2243] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.674778 20036 raft_consensus.cc:2272] T a13cdf5819024a6bbd18925349f5d0df P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.676638 20036 tablet_replica.cc:333] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2: stopping tablet replica
I20260709 13:05:50.677058 20036 raft_consensus.cc:2243] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.677721 20036 raft_consensus.cc:2272] T 59335a678c874c1dbf65969b9a5b14c2 P 6521fb3de1674f9fb0a3437d77fc2ea2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.704026 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
I20260709 13:05:50.722551 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:05:50.748454 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.749171 20036 tablet_replica.cc:333] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.750087 20036 raft_consensus.cc:2243] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.750813 20036 raft_consensus.cc:2272] T 1ac9d048a3e74bbe881e95b755d283b2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.752562 20036 tablet_replica.cc:333] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.753103 20036 raft_consensus.cc:2243] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.753798 20036 raft_consensus.cc:2272] T d996d83c87b9401980d7153490ae6553 P 97c118dde76a4be48a4f0cd86eac309a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.755510 20036 tablet_replica.cc:333] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.755995 20036 raft_consensus.cc:2243] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.756614 20036 raft_consensus.cc:2272] T d65635bcd76f456a8718536b7af67b9c P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.758710 20036 tablet_replica.cc:333] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.759130 20036 raft_consensus.cc:2243] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.759562 20036 raft_consensus.cc:2272] T 67d5947a4bee49c4b53470d5d45791b0 P 97c118dde76a4be48a4f0cd86eac309a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.761041 20036 tablet_replica.cc:333] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.761442 20036 raft_consensus.cc:2243] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.761752 20036 raft_consensus.cc:2272] T f7060d7a4d73419386b2a0a47c49c00d P 97c118dde76a4be48a4f0cd86eac309a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.763168 20036 tablet_replica.cc:333] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.763723 20036 raft_consensus.cc:2243] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.764321 20036 raft_consensus.cc:2272] T 2508ea12c9cd4dcea7ea1ca9ab818d5b P 97c118dde76a4be48a4f0cd86eac309a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.766376 20036 tablet_replica.cc:333] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.766763 20036 raft_consensus.cc:2243] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.767086 20036 raft_consensus.cc:2272] T cc95b42d746047cf946b56721a9694ab P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.768899 20036 tablet_replica.cc:333] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.769344 20036 raft_consensus.cc:2243] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.769743 20036 raft_consensus.cc:2272] T 59335a678c874c1dbf65969b9a5b14c2 P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.771311 20036 tablet_replica.cc:333] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a: stopping tablet replica
I20260709 13:05:50.771739 20036 raft_consensus.cc:2243] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.772118 20036 raft_consensus.cc:2272] T a13cdf5819024a6bbd18925349f5d0df P 97c118dde76a4be48a4f0cd86eac309a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.799194 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:05:50.815167 20036 master.cc:562] Master@127.19.145.62:45205 shutting down...
I20260709 13:05:50.999192 20123 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:05:51.029691 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.030306 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.030659 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P d504daabe3e243e7a83291d9c803c3f8: stopping tablet replica
I20260709 13:05:51.050483 20036 master.cc:584] Master@127.19.145.62:45205 shutdown complete.
6521fb3de1674f9fb0a3437d77fc2ea2  4
97c118dde76a4be48a4f0cd86eac309a  1
dfe77076b7ae4c69b750fa2c548ac213  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12868 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:51.088883 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:40025
I20260709 13:05:51.090013 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.095049 20536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.096516 20537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.096778 20539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.097122 20036 server_base.cc:1061] running on GCE node
I20260709 13:05:51.098043 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.098214 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.098333 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602351098321 us; error 0 us; skew 500 ppm
I20260709 13:05:51.098758 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.101437 20036 webserver.cc:533] Webserver started at http://127.19.145.62:36397/ using document root <none> and password file <none>
I20260709 13:05:51.101888 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.102035 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.102245 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.103225 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "cc40ce6696874ea088ca956228c3b9c2"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.107472 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:05:51.110489 20544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.111215 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:51.111545 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "cc40ce6696874ea088ca956228c3b9c2"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.111832 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.136790 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.138036 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.178018 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:40025
I20260709 13:05:51.178133 20595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:40025 every 8 connection(s)
I20260709 13:05:51.182466 20596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.191573 20596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2: Bootstrap starting.
I20260709 13:05:51.196070 20596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.200245 20596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2: No bootstrap required, opened a new log
I20260709 13:05:51.202414 20596 raft_consensus.cc:359] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER }
I20260709 13:05:51.202778 20596 raft_consensus.cc:385] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.202960 20596 raft_consensus.cc:740] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40ce6696874ea088ca956228c3b9c2, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.203502 20596 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER }
I20260709 13:05:51.203897 20596 raft_consensus.cc:399] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:51.204077 20596 raft_consensus.cc:493] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:51.204275 20596 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.208164 20596 raft_consensus.cc:515] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER }
I20260709 13:05:51.208628 20596 leader_election.cc:304] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc40ce6696874ea088ca956228c3b9c2; no voters: 
I20260709 13:05:51.209748 20596 leader_election.cc:290] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:51.210108 20599 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.211512 20599 raft_consensus.cc:697] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 1 LEADER]: Becoming Leader. State: Replica: cc40ce6696874ea088ca956228c3b9c2, State: Running, Role: LEADER
I20260709 13:05:51.212172 20599 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER }
I20260709 13:05:51.212663 20596 sys_catalog.cc:565] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:51.216624 20600 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc40ce6696874ea088ca956228c3b9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER } }
I20260709 13:05:51.216756 20601 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc40ce6696874ea088ca956228c3b9c2. Latest consensus state: current_term: 1 leader_uuid: "cc40ce6696874ea088ca956228c3b9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc40ce6696874ea088ca956228c3b9c2" member_type: VOTER } }
I20260709 13:05:51.217394 20601 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:51.218875 20600 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:51.219415 20605 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:51.224339 20605 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:51.229017 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:51.233264 20605 catalog_manager.cc:1383] Generated new cluster ID: 0cc4f6f1adc547d88e1deb08a4ed2a0c
I20260709 13:05:51.233563 20605 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:51.251403 20605 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:51.252625 20605 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:51.272327 20605 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2: Generated new TSK 0
I20260709 13:05:51.272888 20605 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:51.295594 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.301306 20617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.302768 20618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.304143 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:51.304167 20620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.305173 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.305351 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.305480 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602351305468 us; error 0 us; skew 500 ppm
I20260709 13:05:51.305918 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.308071 20036 webserver.cc:533] Webserver started at http://127.19.145.1:44141/ using document root <none> and password file <none>
I20260709 13:05:51.308508 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.308660 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.308853 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.309808 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "611c5c47fca7440caad430a8872cbd01"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.314070 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:51.317253 20625 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.317945 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:51.318259 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "611c5c47fca7440caad430a8872cbd01"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.318570 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.331717 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.332893 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.334285 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.336550 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.336762 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.337001 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.337183 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.376219 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:35765
I20260709 13:05:51.376308 20687 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:35765 every 8 connection(s)
I20260709 13:05:51.380748 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.387992 20692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.392045 20695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.392176 20693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.393507 20036 server_base.cc:1061] running on GCE node
I20260709 13:05:51.394335 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.394542 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.394721 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602351394701 us; error 0 us; skew 500 ppm
I20260709 13:05:51.395347 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.397737 20036 webserver.cc:533] Webserver started at http://127.19.145.2:41889/ using document root <none> and password file <none>
I20260709 13:05:51.398346 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.398591 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.398885 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.399814 20688 heartbeater.cc:344] Connected to a master server at 127.19.145.62:40025
I20260709 13:05:51.400054 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.400158 20688 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:51.400936 20688 heartbeater.cc:507] Master 127.19.145.62:40025 requested a full tablet report, sending...
I20260709 13:05:51.402854 20561 ts_manager.cc:194] Registered new tserver with Master: 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765)
I20260709 13:05:51.404991 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:05:51.405009 20561 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59108
I20260709 13:05:51.408409 20700 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.409123 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:51.409442 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.409703 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.421439 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.422633 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.424134 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.426254 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.426445 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.426688 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.426846 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.464628 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:33377
I20260709 13:05:51.464736 20762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:33377 every 8 connection(s)
I20260709 13:05:51.469138 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.476111 20766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.476881 20767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.479182 20036 server_base.cc:1061] running on GCE node
W20260709 13:05:51.480187 20769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.480860 20763 heartbeater.cc:344] Connected to a master server at 127.19.145.62:40025
I20260709 13:05:51.481207 20763 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:51.481171 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.481573 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.481743 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602351481708 us; error 0 us; skew 500 ppm
I20260709 13:05:51.482112 20763 heartbeater.cc:507] Master 127.19.145.62:40025 requested a full tablet report, sending...
I20260709 13:05:51.482307 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.484074 20561 ts_manager.cc:194] Registered new tserver with Master: f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:51.485074 20036 webserver.cc:533] Webserver started at http://127.19.145.3:40559/ using document root <none> and password file <none>
I20260709 13:05:51.485353 20561 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59122
I20260709 13:05:51.485594 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.485841 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.486106 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.487430 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "4231759bef7e4465b010fb683f59a902"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.491495 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:05:51.494458 20774 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.495162 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:51.495512 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "4231759bef7e4465b010fb683f59a902"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-cd6k"
I20260709 13:05:51.495790 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.524580 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.525765 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.527159 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.529335 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.529562 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.529791 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.529968 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.568761 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:36721
I20260709 13:05:51.568866 20836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:36721 every 8 connection(s)
I20260709 13:05:51.581616 20837 heartbeater.cc:344] Connected to a master server at 127.19.145.62:40025
I20260709 13:05:51.581982 20837 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:51.582679 20837 heartbeater.cc:507] Master 127.19.145.62:40025 requested a full tablet report, sending...
I20260709 13:05:51.584501 20561 ts_manager.cc:194] Registered new tserver with Master: 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:51.585012 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013227029s
I20260709 13:05:51.586129 20561 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59134
I20260709 13:05:51.608331 20561 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59142:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:51.611416 20561 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:51.684460 20653 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa2ed03c7044275b768761ff7897c10 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.685993 20653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa2ed03c7044275b768761ff7897c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.694765 20652 tablet_service.cc:1511] Processing CreateTablet for tablet 422b62ed9c8f42d1865b81cf83f52ad8 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.696316 20652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422b62ed9c8f42d1865b81cf83f52ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.700958 20802 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa2ed03c7044275b768761ff7897c10 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.702263 20802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa2ed03c7044275b768761ff7897c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.706588 20651 tablet_service.cc:1511] Processing CreateTablet for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.707967 20651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.712190 20650 tablet_service.cc:1511] Processing CreateTablet for tablet 748279029d9f465d82fcbada2e88df16 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.713521 20650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748279029d9f465d82fcbada2e88df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.713368 20793 tablet_service.cc:1511] Processing CreateTablet for tablet d73574123f1847ad8bb941558d762fb5 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.714866 20793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73574123f1847ad8bb941558d762fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.716485 20649 tablet_service.cc:1511] Processing CreateTablet for tablet c8a05a8dfec24db284dc7945a9425eee (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.718182 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a05a8dfec24db284dc7945a9425eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.718523 20646 tablet_service.cc:1511] Processing CreateTablet for tablet 1e23b5c93209477a8a289ea1238faba2 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.718609 20795 tablet_service.cc:1511] Processing CreateTablet for tablet 1e23b5c93209477a8a289ea1238faba2 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.719916 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e23b5c93209477a8a289ea1238faba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.720329 20798 tablet_service.cc:1511] Processing CreateTablet for tablet c8a05a8dfec24db284dc7945a9425eee (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.719971 20795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e23b5c93209477a8a289ea1238faba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.723644 20647 tablet_service.cc:1511] Processing CreateTablet for tablet 512371cdef324a9b8272dff175e9825a (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:51.723778 20648 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba85ec8aa74a91886d1555c44f22b0 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:51.724982 20647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512371cdef324a9b8272dff175e9825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.724692 20800 tablet_service.cc:1511] Processing CreateTablet for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.721982 20794 tablet_service.cc:1511] Processing CreateTablet for tablet a22e1e6cc3094e368fff9b1172d4a176 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.726958 20648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba85ec8aa74a91886d1555c44f22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.726794 20799 tablet_service.cc:1511] Processing CreateTablet for tablet 748279029d9f465d82fcbada2e88df16 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.723644 20797 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba85ec8aa74a91886d1555c44f22b0 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:51.730516 20794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22e1e6cc3094e368fff9b1172d4a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.730371 20796 tablet_service.cc:1511] Processing CreateTablet for tablet 512371cdef324a9b8272dff175e9825a (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:51.736593 20728 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa2ed03c7044275b768761ff7897c10 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.737771 20728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa2ed03c7044275b768761ff7897c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.738643 20801 tablet_service.cc:1511] Processing CreateTablet for tablet 422b62ed9c8f42d1865b81cf83f52ad8 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.741417 20800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.742152 20798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a05a8dfec24db284dc7945a9425eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.743672 20799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748279029d9f465d82fcbada2e88df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.747857 20801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422b62ed9c8f42d1865b81cf83f52ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.751884 20797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba85ec8aa74a91886d1555c44f22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.753417 20727 tablet_service.cc:1511] Processing CreateTablet for tablet 422b62ed9c8f42d1865b81cf83f52ad8 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.753873 20796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512371cdef324a9b8272dff175e9825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.754736 20727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422b62ed9c8f42d1865b81cf83f52ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.756462 20645 tablet_service.cc:1511] Processing CreateTablet for tablet d73574123f1847ad8bb941558d762fb5 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.757658 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73574123f1847ad8bb941558d762fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.768524 20726 tablet_service.cc:1511] Processing CreateTablet for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.769896 20726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f02c5c1cd84330b1dc5e5a7b2e9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.778605 20725 tablet_service.cc:1511] Processing CreateTablet for tablet 748279029d9f465d82fcbada2e88df16 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.780364 20725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748279029d9f465d82fcbada2e88df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.797574 20724 tablet_service.cc:1511] Processing CreateTablet for tablet c8a05a8dfec24db284dc7945a9425eee (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.798946 20724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a05a8dfec24db284dc7945a9425eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.800494 20722 tablet_service.cc:1511] Processing CreateTablet for tablet 512371cdef324a9b8272dff175e9825a (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:51.802719 20721 tablet_service.cc:1511] Processing CreateTablet for tablet 1e23b5c93209477a8a289ea1238faba2 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.807590 20723 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba85ec8aa74a91886d1555c44f22b0 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:51.809109 20720 tablet_service.cc:1511] Processing CreateTablet for tablet a22e1e6cc3094e368fff9b1172d4a176 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.810590 20719 tablet_service.cc:1511] Processing CreateTablet for tablet d73574123f1847ad8bb941558d762fb5 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.811919 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e23b5c93209477a8a289ea1238faba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.812536 20723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba85ec8aa74a91886d1555c44f22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.814621 20652 tablet_service.cc:1511] Processing CreateTablet for tablet a22e1e6cc3094e368fff9b1172d4a176 (DEFAULT_TABLE table=test-workload [id=c504cf6b094e461e96e3d0a2eccd35ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.815958 20652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22e1e6cc3094e368fff9b1172d4a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.815970 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22e1e6cc3094e368fff9b1172d4a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.820678 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73574123f1847ad8bb941558d762fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.823611 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512371cdef324a9b8272dff175e9825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.867945 20852 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:51.889161 20852 tablet_bootstrap.cc:654] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.897078 20854 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:51.898666 20853 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:51.905998 20852 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:51.906476 20852 ts_tablet_manager.cc:1403] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 13:05:51.907096 20854 tablet_bootstrap.cc:654] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.908609 20853 tablet_bootstrap.cc:654] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.909425 20852 raft_consensus.cc:359] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:51.910247 20852 raft_consensus.cc:385] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.910488 20852 raft_consensus.cc:740] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.911293 20852 consensus_queue.cc:260] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:51.912606 20854 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:51.913354 20688 heartbeater.cc:499] Master 127.19.145.62:40025 was elected leader, sending a full tablet report...
I20260709 13:05:51.913663 20853 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:51.913841 20852 ts_tablet_manager.cc:1434] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:51.914140 20853 ts_tablet_manager.cc:1403] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:05:51.914718 20852 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:51.915365 20854 ts_tablet_manager.cc:1403] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:05:51.916788 20853 raft_consensus.cc:359] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.917963 20853 raft_consensus.cc:385] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.918262 20853 raft_consensus.cc:740] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.918201 20854 raft_consensus.cc:359] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:51.919158 20854 raft_consensus.cc:385] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.919729 20854 raft_consensus.cc:740] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.919207 20853 consensus_queue.cc:260] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.921095 20852 tablet_bootstrap.cc:654] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.920609 20854 consensus_queue.cc:260] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:51.932623 20852 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:51.932914 20853 ts_tablet_manager.cc:1434] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:05:51.933118 20852 ts_tablet_manager.cc:1403] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:05:51.933801 20763 heartbeater.cc:499] Master 127.19.145.62:40025 was elected leader, sending a full tablet report...
I20260709 13:05:51.936110 20852 raft_consensus.cc:359] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.936779 20852 raft_consensus.cc:385] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.937075 20852 raft_consensus.cc:740] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.938011 20852 consensus_queue.cc:260] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.940362 20852 ts_tablet_manager.cc:1434] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:05:51.941264 20852 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:51.947705 20852 tablet_bootstrap.cc:654] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.951951 20853 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:51.952528 20852 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:51.952978 20852 ts_tablet_manager.cc:1403] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:05:51.955662 20859 raft_consensus.cc:493] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.955731 20852 raft_consensus.cc:359] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.956488 20852 raft_consensus.cc:385] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.956216 20859 raft_consensus.cc:515] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.956779 20852 raft_consensus.cc:740] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.957612 20852 consensus_queue.cc:260] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:51.958884 20859 leader_election.cc:290] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:51.960143 20860 raft_consensus.cc:493] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.960239 20837 heartbeater.cc:499] Master 127.19.145.62:40025 was elected leader, sending a full tablet report...
I20260709 13:05:51.960645 20860 raft_consensus.cc:515] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:51.963570 20852 ts_tablet_manager.cc:1434] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:05:51.964582 20852 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:51.966683 20854 ts_tablet_manager.cc:1434] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.051s	user 0.012s	sys 0.030s
I20260709 13:05:51.967926 20854 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:51.969143 20860 leader_election.cc:290] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:51.969856 20853 tablet_bootstrap.cc:654] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.971184 20852 tablet_bootstrap.cc:654] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.987524 20854 tablet_bootstrap.cc:654] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.993646 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
W20260709 13:05:51.995899 20701 leader_election.cc:343] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.000155 20854 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.000774 20854 ts_tablet_manager.cc:1403] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.007s
I20260709 13:05:52.004230 20854 raft_consensus.cc:359] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.005396 20854 raft_consensus.cc:385] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.005846 20854 raft_consensus.cc:740] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.006808 20854 consensus_queue.cc:260] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.009613 20854 ts_tablet_manager.cc:1434] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:05:52.010653 20854 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.017881 20854 tablet_bootstrap.cc:654] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.029989 20854 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.030597 20854 ts_tablet_manager.cc:1403] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:05:52.033708 20854 raft_consensus.cc:359] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.034840 20854 raft_consensus.cc:385] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.035318 20854 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.036314 20854 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.038949 20854 ts_tablet_manager.cc:1434] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:52.040364 20860 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.040819 20860 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.042937 20860 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.039999 20854 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.051285 20854 tablet_bootstrap.cc:654] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.063501 20854 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.064101 20854 ts_tablet_manager.cc:1403] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:05:52.067415 20854 raft_consensus.cc:359] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.068377 20854 raft_consensus.cc:385] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.068776 20854 raft_consensus.cc:740] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.069784 20854 consensus_queue.cc:260] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.077433 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
W20260709 13:05:52.079062 20702 leader_election.cc:343] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.079594 20702 leader_election.cc:304] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.081418 20859 raft_consensus.cc:2749] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.084563 20854 ts_tablet_manager.cc:1434] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:05:52.085983 20854 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.086630 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.087237 20663 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.088989 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.089288 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
W20260709 13:05:52.090605 20775 leader_election.cc:343] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:52.091571 20775 leader_election.cc:343] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.092110 20854 tablet_bootstrap.cc:654] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.092267 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.093686 20775 leader_election.cc:304] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.094487 20860 raft_consensus.cc:2804] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.094818 20860 raft_consensus.cc:493] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.095180 20860 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.096905 20852 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.097373 20852 ts_tablet_manager.cc:1403] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.133s	user 0.051s	sys 0.067s
I20260709 13:05:52.099135 20854 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.099654 20854 ts_tablet_manager.cc:1403] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 13:05:52.100320 20852 raft_consensus.cc:359] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.101040 20852 raft_consensus.cc:385] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.101781 20852 raft_consensus.cc:740] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.102238 20854 raft_consensus.cc:359] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.102396 20860 raft_consensus.cc:515] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:52.102893 20854 raft_consensus.cc:385] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.102501 20852 consensus_queue.cc:260] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.103209 20854 raft_consensus.cc:740] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.103335 20858 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.103747 20858 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.103938 20854 consensus_queue.cc:260] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.106249 20858 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.106339 20854 ts_tablet_manager.cc:1434] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:52.107398 20854 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
W20260709 13:05:52.110631 20775 leader_election.cc:343] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.111322 20775 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4231759bef7e4465b010fb683f59a902; no voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.112629 20863 raft_consensus.cc:2749] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.114885 20854 tablet_bootstrap.cc:654] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.121933 20860 leader_election.cc:290] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.128347 20852 ts_tablet_manager.cc:1434] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:05:52.129383 20852 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.129616 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
W20260709 13:05:52.131876 20775 leader_election.cc:343] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.136585 20852 tablet_bootstrap.cc:654] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.140753 20853 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.141228 20853 ts_tablet_manager.cc:1403] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.189s	user 0.037s	sys 0.080s
I20260709 13:05:52.146570 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.146384 20853 raft_consensus.cc:359] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.146914 20854 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.147420 20853 raft_consensus.cc:385] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.147540 20854 ts_tablet_manager.cc:1403] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.027s
I20260709 13:05:52.147851 20853 raft_consensus.cc:740] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
W20260709 13:05:52.148285 20627 leader_election.cc:343] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.148813 20853 consensus_queue.cc:260] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.150954 20853 ts_tablet_manager.cc:1434] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:05:52.150607 20854 raft_consensus.cc:359] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.151666 20854 raft_consensus.cc:385] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.151976 20854 raft_consensus.cc:740] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.152289 20853 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.152699 20854 consensus_queue.cc:260] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.155197 20854 ts_tablet_manager.cc:1434] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:52.156534 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.156767 20854 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.157119 20663 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.138451 20860 raft_consensus.cc:493] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.161717 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.158152 20863 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.162984 20863 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.165128 20863 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.165863 20854 tablet_bootstrap.cc:654] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:52.166656 20626 leader_election.cc:343] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.167128 20626 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01; no voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.168083 20874 raft_consensus.cc:2749] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.169974 20859 raft_consensus.cc:493] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.170567 20859 raft_consensus.cc:515] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.158699 20860 raft_consensus.cc:515] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.173322 20859 leader_election.cc:290] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.174242 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
W20260709 13:05:52.176067 20701 leader_election.cc:343] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.181526 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.181526 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.182243 20663 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
W20260709 13:05:52.183053 20702 leader_election.cc:343] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.183568 20702 leader_election.cc:304] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.184612 20859 raft_consensus.cc:2749] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.184959 20860 leader_election.cc:290] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
W20260709 13:05:52.183126 20775 leader_election.cc:343] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.188844 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.189258 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.190817 20775 leader_election.cc:304] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.192605 20853 tablet_bootstrap.cc:654] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:52.192914 20775 leader_election.cc:343] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:52.193773 20775 leader_election.cc:343] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.194242 20775 leader_election.cc:304] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4231759bef7e4465b010fb683f59a902; no voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.195906 20863 raft_consensus.cc:2804] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.196421 20860 raft_consensus.cc:2749] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.196383 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.200420 20852 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.201004 20852 ts_tablet_manager.cc:1403] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.072s	user 0.033s	sys 0.011s
I20260709 13:05:52.202308 20854 tablet_bootstrap.cc:492] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.202895 20854 ts_tablet_manager.cc:1403] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.012s
W20260709 13:05:52.204073 20775 leader_election.cc:343] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.204493 20775 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4231759bef7e4465b010fb683f59a902; no voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.206199 20854 raft_consensus.cc:359] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.206480 20860 raft_consensus.cc:2749] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.206923 20854 raft_consensus.cc:385] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.207309 20854 raft_consensus.cc:740] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.206439 20852 raft_consensus.cc:359] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.207875 20852 raft_consensus.cc:385] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.208339 20852 raft_consensus.cc:740] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.208379 20854 consensus_queue.cc:260] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.209661 20852 consensus_queue.cc:260] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.210551 20863 raft_consensus.cc:697] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:52.211337 20854 ts_tablet_manager.cc:1434] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:05:52.212420 20854 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.213018 20874 raft_consensus.cc:493] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.213554 20874 raft_consensus.cc:515] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.213603 20863 consensus_queue.cc:237] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:52.215528 20858 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.215955 20858 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.217857 20858 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.218813 20874 leader_election.cc:290] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.219116 20854 tablet_bootstrap.cc:654] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.219637 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.220625 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.220764 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.221256 20811 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 0.
I20260709 13:05:52.221271 20812 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 0.
W20260709 13:05:52.222834 20626 leader_election.cc:343] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.222874 20627 leader_election.cc:304] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.223971 20627 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.224215 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
W20260709 13:05:52.224426 20609 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:52.224768 20737 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 0.
I20260709 13:05:52.225108 20858 raft_consensus.cc:2804] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.225455 20858 raft_consensus.cc:493] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.225773 20858 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.227483 20874 raft_consensus.cc:2804] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.227906 20874 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.229310 20874 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.229645 20854 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.229014 20560 catalog_manager.cc:5697] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.230037 20854 ts_tablet_manager.cc:1403] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:05:52.232275 20854 raft_consensus.cc:359] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.232880 20854 raft_consensus.cc:385] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.233168 20854 raft_consensus.cc:740] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.233894 20853 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.233819 20854 consensus_queue.cc:260] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.234373 20853 ts_tablet_manager.cc:1403] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.010s
I20260709 13:05:52.235986 20854 ts_tablet_manager.cc:1434] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:52.236301 20874 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.236840 20854 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.237221 20853 raft_consensus.cc:359] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.237905 20853 raft_consensus.cc:385] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.237977 20852 ts_tablet_manager.cc:1434] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:05:52.238255 20853 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.238675 20858 raft_consensus.cc:515] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.241457 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:52.242317 20812 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.242697 20854 tablet_bootstrap.cc:654] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.243466 20858 leader_election.cc:290] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.245002 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.245571 20738 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.247247 20854 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.247915 20854 ts_tablet_manager.cc:1403] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:05:52.250581 20738 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 1.
I20260709 13:05:52.239027 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.251523 20854 raft_consensus.cc:359] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.252434 20854 raft_consensus.cc:385] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.252825 20854 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.253151 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:52.253726 20811 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.238994 20853 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.241612 20852 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.253973 20854 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.255334 20626 leader_election.cc:304] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
W20260709 13:05:52.256220 20626 leader_election.cc:343] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.257112 20858 raft_consensus.cc:2804] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.257424 20854 ts_tablet_manager.cc:1434] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:52.258690 20854 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: Bootstrap starting.
I20260709 13:05:52.260810 20852 tablet_bootstrap.cc:654] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.265985 20854 tablet_bootstrap.cc:654] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.270655 20811 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 1.
I20260709 13:05:52.271771 20853 ts_tablet_manager.cc:1434] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:05:52.274413 20812 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 1.
I20260709 13:05:52.275552 20627 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.280062 20853 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.283294 20863 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.285574 20863 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.289614 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.290257 20663 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.288090 20863 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.291466 20775 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.292428 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.292676 20863 raft_consensus.cc:2804] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.293030 20863 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.293781 20863 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:52.299641 20775 leader_election.cc:343] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.300900 20874 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.304301 20890 raft_consensus.cc:2804] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.304819 20890 raft_consensus.cc:697] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:52.304925 20874 raft_consensus.cc:493] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.305349 20874 raft_consensus.cc:515] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.305678 20890 consensus_queue.cc:237] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.308383 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.308736 20858 raft_consensus.cc:697] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:52.311710 20858 consensus_queue.cc:237] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
W20260709 13:05:52.314416 20626 leader_election.cc:343] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.315388 20863 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.321285 20874 leader_election.cc:290] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.327911 20853 tablet_bootstrap.cc:654] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.328122 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.328701 20663 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.333035 20854 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: No bootstrap required, opened a new log
I20260709 13:05:52.334527 20854 ts_tablet_manager.cc:1403] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: Time spent bootstrapping tablet: real 0.076s	user 0.030s	sys 0.033s
I20260709 13:05:52.337508 20854 raft_consensus.cc:359] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.339692 20854 raft_consensus.cc:385] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.340582 20852 tablet_bootstrap.cc:492] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.337809 20663 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.341058 20852 ts_tablet_manager.cc:1403] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.004s
I20260709 13:05:52.340705 20854 raft_consensus.cc:740] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.341781 20775 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.342804 20880 raft_consensus.cc:2804] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.343340 20880 raft_consensus.cc:697] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:52.343863 20854 consensus_queue.cc:260] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.344000 20852 raft_consensus.cc:359] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.346450 20852 raft_consensus.cc:385] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.346763 20852 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.347553 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.348140 20854 ts_tablet_manager.cc:1434] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:05:52.348717 20863 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
W20260709 13:05:52.349252 20775 leader_election.cc:343] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.344147 20880 consensus_queue.cc:237] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.343194 20559 catalog_manager.cc:5697] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.340427 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.351583 20812 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 0.
I20260709 13:05:52.352843 20627 leader_election.cc:304] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.353699 20890 raft_consensus.cc:2804] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.354135 20890 raft_consensus.cc:493] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.353462 20852 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.354504 20890 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.356330 20852 ts_tablet_manager.cc:1434] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:05:52.357299 20852 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.361656 20890 raft_consensus.cc:515] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.362592 20853 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.364051 20559 catalog_manager.cc:5697] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.364890 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.365260 20853 ts_tablet_manager.cc:1403] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.014s
W20260709 13:05:52.366356 20626 leader_election.cc:343] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.367206 20852 tablet_bootstrap.cc:654] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.368397 20890 leader_election.cc:290] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.368574 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:52.369148 20812 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.373068 20852 tablet_bootstrap.cc:492] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.373472 20852 ts_tablet_manager.cc:1403] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:05:52.373342 20853 raft_consensus.cc:359] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.374078 20853 raft_consensus.cc:385] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.374384 20853 raft_consensus.cc:740] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.375100 20853 consensus_queue.cc:260] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.375922 20812 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 1.
I20260709 13:05:52.377105 20853 ts_tablet_manager.cc:1434] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:52.377131 20627 leader_election.cc:304] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.378036 20853 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.378285 20890 raft_consensus.cc:2804] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.378201 20852 raft_consensus.cc:359] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.378801 20890 raft_consensus.cc:697] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:52.378986 20852 raft_consensus.cc:385] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.379317 20852 raft_consensus.cc:740] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.379652 20890 consensus_queue.cc:237] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.380069 20852 consensus_queue.cc:260] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.385054 20852 ts_tablet_manager.cc:1434] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:52.386305 20852 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.386081 20560 catalog_manager.cc:5697] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.392244 20853 tablet_bootstrap.cc:654] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.393828 20880 raft_consensus.cc:493] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.395203 20880 raft_consensus.cc:515] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.398835 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.398540 20559 catalog_manager.cc:5697] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.399660 20663 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.401371 20775 leader_election.cc:304] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.402441 20863 raft_consensus.cc:2804] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.402892 20863 raft_consensus.cc:493] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.403306 20863 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.405499 20852 tablet_bootstrap.cc:654] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.417634 20852 tablet_bootstrap.cc:492] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.418072 20852 ts_tablet_manager.cc:1403] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.032s	user 0.002s	sys 0.013s
I20260709 13:05:52.420440 20852 raft_consensus.cc:359] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.421072 20852 raft_consensus.cc:385] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.420979 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.421406 20852 raft_consensus.cc:740] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.421646 20738 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.422150 20852 consensus_queue.cc:260] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.423135 20880 leader_election.cc:290] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.424063 20863 raft_consensus.cc:515] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.424088 20852 ts_tablet_manager.cc:1434] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:52.425828 20852 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.426369 20853 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.426847 20853 ts_tablet_manager.cc:1403] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.023s
I20260709 13:05:52.426760 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.427393 20663 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.428207 20863 leader_election.cc:290] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.429750 20853 raft_consensus.cc:359] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.431602 20853 raft_consensus.cc:385] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.431564 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.432070 20853 raft_consensus.cc:740] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.432286 20738 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.432962 20852 tablet_bootstrap.cc:654] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.432842 20853 consensus_queue.cc:260] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.435031 20853 ts_tablet_manager.cc:1434] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:52.436139 20853 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.439756 20738 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.440899 20775 leader_election.cc:304] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.441740 20863 raft_consensus.cc:2804] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.442193 20863 raft_consensus.cc:697] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:52.443001 20863 consensus_queue.cc:237] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.445008 20853 tablet_bootstrap.cc:654] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.453485 20663 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.457593 20852 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.458045 20852 ts_tablet_manager.cc:1403] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.032s	user 0.025s	sys 0.003s
I20260709 13:05:52.459954 20852 raft_consensus.cc:359] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.460474 20852 raft_consensus.cc:385] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.460690 20852 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.461316 20852 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.462359 20853 tablet_bootstrap.cc:492] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.462848 20853 ts_tablet_manager.cc:1403] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 13:05:52.463033 20852 ts_tablet_manager.cc:1434] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:52.463928 20852 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: Bootstrap starting.
I20260709 13:05:52.465822 20853 raft_consensus.cc:359] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.466511 20853 raft_consensus.cc:385] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.466813 20853 raft_consensus.cc:740] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.467525 20853 consensus_queue.cc:260] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.468263 20559 catalog_manager.cc:5697] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.469568 20852 tablet_bootstrap.cc:654] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.476331 20853 ts_tablet_manager.cc:1434] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:05:52.477291 20853 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.483641 20853 tablet_bootstrap.cc:654] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.488344 20852 tablet_bootstrap.cc:492] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: No bootstrap required, opened a new log
I20260709 13:05:52.488593 20853 tablet_bootstrap.cc:492] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.488756 20852 ts_tablet_manager.cc:1403] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.009s
I20260709 13:05:52.488996 20853 ts_tablet_manager.cc:1403] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:05:52.491561 20852 raft_consensus.cc:359] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.491741 20853 raft_consensus.cc:359] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:52.492054 20852 raft_consensus.cc:385] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.492214 20853 raft_consensus.cc:385] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.492380 20852 raft_consensus.cc:740] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.492445 20853 raft_consensus.cc:740] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.493112 20852 consensus_queue.cc:260] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.493160 20853 consensus_queue.cc:260] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:52.494679 20852 ts_tablet_manager.cc:1434] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:05:52.495195 20853 ts_tablet_manager.cc:1434] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:52.496124 20853 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.502342 20853 tablet_bootstrap.cc:654] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.507558 20853 tablet_bootstrap.cc:492] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.507849 20853 ts_tablet_manager.cc:1403] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.009s
I20260709 13:05:52.509485 20853 raft_consensus.cc:359] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.509958 20853 raft_consensus.cc:385] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.510133 20853 raft_consensus.cc:740] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.510633 20853 consensus_queue.cc:260] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.512084 20853 ts_tablet_manager.cc:1434] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:52.512750 20853 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.517838 20853 tablet_bootstrap.cc:654] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.522173 20853 tablet_bootstrap.cc:492] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.522606 20853 ts_tablet_manager.cc:1403] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:52.524353 20853 raft_consensus.cc:359] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.524799 20853 raft_consensus.cc:385] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.524969 20853 raft_consensus.cc:740] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.525463 20853 consensus_queue.cc:260] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.526681 20853 ts_tablet_manager.cc:1434] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:05:52.527637 20853 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: Bootstrap starting.
I20260709 13:05:52.532824 20853 tablet_bootstrap.cc:654] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.537353 20853 tablet_bootstrap.cc:492] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: No bootstrap required, opened a new log
I20260709 13:05:52.537791 20853 ts_tablet_manager.cc:1403] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:05:52.539577 20853 raft_consensus.cc:359] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.540041 20853 raft_consensus.cc:385] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.540259 20853 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.540942 20859 raft_consensus.cc:493] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.540889 20853 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.541373 20859 raft_consensus.cc:515] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.543111 20853 ts_tablet_manager.cc:1434] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:05:52.543241 20909 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.543366 20859 leader_election.cc:290] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.543952 20909 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.545131 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.545226 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.545616 20812 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 0.
I20260709 13:05:52.545841 20663 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 0.
I20260709 13:05:52.546849 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.547055 20701 leader_election.cc:304] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.547158 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.547463 20662 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 0.
I20260709 13:05:52.547852 20812 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 0.
I20260709 13:05:52.547931 20859 raft_consensus.cc:2804] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.547248 20909 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.548427 20859 raft_consensus.cc:493] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.548609 20701 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.548817 20859 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.551679 20909 raft_consensus.cc:2804] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.552030 20909 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.552367 20909 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.556123 20859 raft_consensus.cc:515] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.558524 20859 leader_election.cc:290] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.558745 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.559376 20662 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.559350 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:52.559345 20909 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.560138 20812 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.561551 20909 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.563019 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:52.563611 20811 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.564204 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.564734 20663 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.566320 20662 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 1.
I20260709 13:05:52.569293 20701 leader_election.cc:304] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.570166 20909 raft_consensus.cc:2804] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.570250 20811 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 1.
I20260709 13:05:52.570788 20909 raft_consensus.cc:697] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:52.571053 20812 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 1.
I20260709 13:05:52.571106 20663 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 1.
I20260709 13:05:52.571445 20702 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.571960 20909 consensus_queue.cc:237] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.573446 20859 raft_consensus.cc:2804] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.574016 20859 raft_consensus.cc:697] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:52.574779 20859 consensus_queue.cc:237] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.580226 20558 catalog_manager.cc:5697] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.592312 20558 catalog_manager.cc:5697] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.600697 20863 raft_consensus.cc:493] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.601078 20863 raft_consensus.cc:515] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.602460 20863 leader_election.cc:290] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.603359 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.603570 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.603902 20663 raft_consensus.cc:2468] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.604323 20738 raft_consensus.cc:2468] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.604873 20775 leader_election.cc:304] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.605655 20863 raft_consensus.cc:2804] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.605996 20863 raft_consensus.cc:493] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.606292 20863 raft_consensus.cc:3060] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.610415 20863 raft_consensus.cc:515] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.612068 20863 leader_election.cc:290] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.612735 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.613098 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73574123f1847ad8bb941558d762fb5" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.613195 20663 raft_consensus.cc:3060] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.613638 20738 raft_consensus.cc:3060] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.617854 20738 raft_consensus.cc:2468] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.617882 20663 raft_consensus.cc:2468] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.618860 20775 leader_election.cc:304] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:52.619562 20863 raft_consensus.cc:2804] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.620026 20863 raft_consensus.cc:697] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:52.620783 20863 consensus_queue.cc:237] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.627115 20558 catalog_manager.cc:5697] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.632720 20859 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.633200 20859 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.634299 20863 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.635783 20859 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.636152 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.635736 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.636461 20859 raft_consensus.cc:493] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.637019 20812 raft_consensus.cc:2393] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5ac0f3e332b4c6ba001f55a06a9218c in current term 1: Already voted for candidate 611c5c47fca7440caad430a8872cbd01 in this term.
I20260709 13:05:52.637261 20859 raft_consensus.cc:515] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:52.638911 20702 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.639461 20859 leader_election.cc:290] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.639977 20859 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.640060 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.641871 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.641855 20863 raft_consensus.cc:493] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.642791 20863 raft_consensus.cc:515] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.643370 20702 leader_election.cc:304] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.644140 20909 raft_consensus.cc:2749] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.646445 20863 leader_election.cc:290] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.646991 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.648154 20738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" is_pre_election: true
I20260709 13:05:52.648438 20662 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.648823 20738 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 0.
I20260709 13:05:52.649715 20775 leader_election.cc:304] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.651352 20863 raft_consensus.cc:2804] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.651702 20863 raft_consensus.cc:493] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.652070 20863 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.652037 20859 raft_consensus.cc:2749] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.660835 20863 raft_consensus.cc:515] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.662643 20738 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.664738 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:52.665397 20663 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.666358 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:52.667129 20737 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.671126 20663 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.672200 20775 leader_election.cc:304] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:52.673005 20917 raft_consensus.cc:2804] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.673513 20917 raft_consensus.cc:697] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:52.673719 20737 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 1.
I20260709 13:05:52.674274 20917 consensus_queue.cc:237] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.674896 20863 leader_election.cc:290] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 1 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:52.675487 20863 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.685549 20558 catalog_manager.cc:5697] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.695757 20859 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.696255 20859 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.697633 20890 consensus_queue.cc:1048] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.698204 20859 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.698982 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.699761 20663 raft_consensus.cc:2393] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5ac0f3e332b4c6ba001f55a06a9218c in current term 1: Already voted for candidate 4231759bef7e4465b010fb683f59a902 in this term.
I20260709 13:05:52.699788 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.701346 20702 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.702015 20909 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.706926 20909 raft_consensus.cc:2749] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.714407 20874 consensus_queue.cc:1048] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.730780 20874 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.743866 20890 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.746990 20909 raft_consensus.cc:493] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.747539 20909 raft_consensus.cc:515] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:52.749186 20909 leader_election.cc:290] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:52.749820 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "611c5c47fca7440caad430a8872cbd01" is_pre_election: true
I20260709 13:05:52.750844 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4231759bef7e4465b010fb683f59a902" is_pre_election: true
I20260709 13:05:52.751531 20811 raft_consensus.cc:2393] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5ac0f3e332b4c6ba001f55a06a9218c in current term 1: Already voted for candidate 611c5c47fca7440caad430a8872cbd01 in this term.
I20260709 13:05:52.752504 20702 leader_election.cc:304] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.753103 20909 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.756671 20917 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.758559 20909 raft_consensus.cc:2749] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.767437 20863 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.849072 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:52.849618 20812 raft_consensus.cc:606] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.854336 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:52.854846 20812 raft_consensus.cc:606] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.869210 20737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:48494
I20260709 13:05:52.869721 20737 raft_consensus.cc:606] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:52.885128 20663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:34888
I20260709 13:05:52.885788 20663 raft_consensus.cc:606] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Received request to transfer leadership to TS f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.886934 20890 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.894376 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:52.894861 20812 raft_consensus.cc:606] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Received request to transfer leadership to TS f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.904448 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:52.904953 20812 raft_consensus.cc:606] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Received request to transfer leadership to TS f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:05:52.906461 20890 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.012682 20863 consensus_queue.cc:1048] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.022807 20863 consensus_queue.cc:1048] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.037719 20863 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.043398 20860 raft_consensus.cc:993] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: : Instructing follower f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.043819 20880 raft_consensus.cc:1081] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Signalling peer f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.046314 20738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:56866
I20260709 13:05:53.047282 20738 raft_consensus.cc:493] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.047690 20738 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.047977 20880 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.054224 20738 raft_consensus.cc:515] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.056888 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:53.057458 20663 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.058038 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.058597 20812 raft_consensus.cc:3055] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.058463 20909 consensus_queue.cc:1048] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.058943 20812 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:53.059820 20812 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.060899 20812 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.057003 20738 leader_election.cc:290] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:53.066175 20663 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:05:53.067494 20701 leader_election.cc:304] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:53.068325 20909 raft_consensus.cc:2804] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.068828 20909 raft_consensus.cc:697] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:53.069636 20909 consensus_queue.cc:237] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.070397 20812 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:05:53.077229 20909 consensus_queue.cc:1048] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.079064 20559 catalog_manager.cc:5697] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 1 to 2, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.155959 20909 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.156273 20880 consensus_queue.cc:1048] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.163923 20860 raft_consensus.cc:993] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: : Instructing follower f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.164274 20909 raft_consensus.cc:993] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.164333 20860 raft_consensus.cc:1081] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Signalling peer f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.164810 20909 raft_consensus.cc:1081] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.166682 20662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:05:53.167218 20662 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.167606 20662 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.175632 20662 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.175946 20738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:56866
I20260709 13:05:53.177378 20738 raft_consensus.cc:493] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.178313 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:53.178668 20662 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:53.178857 20737 raft_consensus.cc:3055] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.179251 20737 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:53.179854 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.180377 20812 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.180022 20737 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.177835 20738 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.181164 20860 consensus_queue.cc:1048] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.180981 20737 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.186736 20663 raft_consensus.cc:1240] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Rejecting Update request from peer f5ac0f3e332b4c6ba001f55a06a9218c for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.190503 20812 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.190763 20738 raft_consensus.cc:515] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.191583 20627 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:53.192397 20858 raft_consensus.cc:2804] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.192847 20858 raft_consensus.cc:697] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:53.192943 20738 leader_election.cc:290] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:53.193882 20737 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.193666 20858 consensus_queue.cc:237] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.194432 20736 raft_consensus.cc:1240] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Rejecting Update request from peer 4231759bef7e4465b010fb683f59a902 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.196486 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.197055 20812 raft_consensus.cc:3055] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.200891 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22e1e6cc3094e368fff9b1172d4a176" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:53.201553 20880 consensus_queue.cc:1059] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.202251 20812 raft_consensus.cc:740] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:53.202771 20663 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.203230 20812 consensus_queue.cc:260] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.204098 20812 raft_consensus.cc:3060] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:53.180975 20909 consensus_queue.cc:1175] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4231759bef7e4465b010fb683f59a902" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:53.208109 20558 catalog_manager.cc:5697] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 1 to 2, leader changed from f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.209014 20812 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
W20260709 13:05:53.209540 20863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:05:53.209625 20663 raft_consensus.cc:2468] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:05:53.210423 20702 leader_election.cc:304] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:53.210987 20662 raft_consensus.cc:1240] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Rejecting Update request from peer 4231759bef7e4465b010fb683f59a902 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:53.211895 20909 raft_consensus.cc:2804] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.212404 20909 raft_consensus.cc:697] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:53.213771 20909 consensus_queue.cc:237] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.220804 20558 catalog_manager.cc:5697] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 1 to 2, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.258780 20890 raft_consensus.cc:993] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: : Instructing follower f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.259286 20858 raft_consensus.cc:1081] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Signalling peer f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:05:53.259372 20880 raft_consensus.cc:993] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.259855 20863 raft_consensus.cc:1081] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.260865 20737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:56880
I20260709 13:05:53.261350 20662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:05:53.261428 20737 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.261934 20737 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.261945 20662 raft_consensus.cc:493] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.262447 20662 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.268795 20662 raft_consensus.cc:515] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:53.268791 20737 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.271001 20662 leader_election.cc:290] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Requested vote from peers 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:53.271001 20737 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:53.272440 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.272872 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.272974 20811 raft_consensus.cc:3055] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.272994 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:53.273118 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:53.273458 20812 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.273509 20811 raft_consensus.cc:740] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:53.273705 20737 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.273846 20663 raft_consensus.cc:3055] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.274215 20663 raft_consensus.cc:740] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:53.274457 20811 consensus_queue.cc:260] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:53.275251 20663 consensus_queue.cc:260] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.275755 20811 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.276651 20663 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.280258 20737 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.280301 20812 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:05:53.281589 20626 leader_election.cc:304] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:53.281828 20702 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:53.282455 20858 raft_consensus.cc:2804] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.282639 20909 raft_consensus.cc:2804] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.282994 20858 raft_consensus.cc:697] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:53.283704 20663 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:05:53.283803 20909 raft_consensus.cc:697] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:53.283879 20858 consensus_queue.cc:237] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:05:53.284478 20811 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.284680 20909 consensus_queue.cc:237] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.291467 20560 catalog_manager.cc:5697] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 1 to 2, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.291617 20558 catalog_manager.cc:5697] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 1 to 2, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.378748 20880 raft_consensus.cc:993] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.379165 20863 raft_consensus.cc:1081] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:53.380505 20663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:05:53.380911 20663 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.381143 20663 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.385654 20663 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.387506 20663 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:53.388368 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:53.388633 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:53.388870 20737 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.389173 20811 raft_consensus.cc:3055] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.389569 20811 raft_consensus.cc:740] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:53.390272 20811 consensus_queue.cc:260] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.391227 20811 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.393600 20737 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.394588 20626 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:53.395408 20858 raft_consensus.cc:2804] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.395889 20858 raft_consensus.cc:697] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:53.396171 20811 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:53.396961 20858 consensus_queue.cc:237] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:53.404531 20558 catalog_manager.cc:5697] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 1 to 2, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.486447 20811 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.487579 20909 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.494948 20663 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.496551 20909 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.672055 20737 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.673475 20890 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.680821 20812 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.682888 20874 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.765897 20812 raft_consensus.cc:1275] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.767236 20942 consensus_queue.cc:1048] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.771929 20811 raft_consensus.cc:1275] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.774044 20942 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.776517 20737 raft_consensus.cc:1275] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.776836 20663 raft_consensus.cc:1275] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.778311 20874 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.780140 20909 consensus_queue.cc:1048] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.789206 20662 raft_consensus.cc:1275] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.797629 20942 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.798497 20737 raft_consensus.cc:1275] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.800745 20858 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.801817 20811 raft_consensus.cc:1275] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.803900 20874 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.822831 20811 raft_consensus.cc:1275] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.824313 20874 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:55.935560 20036 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:55.936326 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.950578 20663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:05:55.950989 20663 raft_consensus.cc:606] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Received request to transfer leadership to TS 4231759bef7e4465b010fb683f59a902
I20260709 13:05:55.953217 20663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:05:55.953573 20663 raft_consensus.cc:606] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Received request to transfer leadership to TS 4231759bef7e4465b010fb683f59a902
I20260709 13:05:55.954427 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:55.954834 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:56.230221 20874 raft_consensus.cc:993] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: : Instructing follower 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:05:56.230762 20956 raft_consensus.cc:1081] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Signalling peer 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:05:56.232206 20812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:49314
I20260709 13:05:56.232656 20812 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.232954 20812 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.237234 20812 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.238708 20812 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 3 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:56.239449 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:56.239720 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:56.239979 20663 raft_consensus.cc:3055] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.240253 20737 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.240298 20663 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:56.241051 20663 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.241842 20663 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.244906 20737 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 3.
I20260709 13:05:56.245888 20663 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 3.
I20260709 13:05:56.245921 20775 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:56.246781 20953 raft_consensus.cc:2804] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.247706 20953 raft_consensus.cc:697] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:56.248522 20953 consensus_queue.cc:237] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.254626 20558 catalog_manager.cc:5697] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 2 to 3, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.457806 20874 raft_consensus.cc:993] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: : Instructing follower 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:05:56.458205 20956 raft_consensus.cc:1081] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Signalling peer 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:05:56.459451 20812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:49314
I20260709 13:05:56.459903 20812 raft_consensus.cc:493] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.460196 20812 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.464315 20812 raft_consensus.cc:515] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.465603 20812 leader_election.cc:290] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 2 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:05:56.466364 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:05:56.466655 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:56.466917 20663 raft_consensus.cc:3055] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.467180 20737 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.467211 20663 raft_consensus.cc:740] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:56.468094 20663 consensus_queue.cc:260] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.469148 20663 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.473568 20737 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 2.
I20260709 13:05:56.474609 20775 leader_election.cc:304] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:56.474871 20663 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 2.
I20260709 13:05:56.475287 20953 raft_consensus.cc:2804] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.475785 20953 raft_consensus.cc:697] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:56.476514 20953 consensus_queue.cc:237] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:56.482632 20558 catalog_manager.cc:5697] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 1 to 2, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.695820 20663 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.696970 20953 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.707065 20737 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.709339 20957 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.918417 20737 raft_consensus.cc:1275] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.919574 20957 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.928699 20663 raft_consensus.cc:1275] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.930361 20957 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.955576 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:56.971961 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:56.972419 20812 raft_consensus.cc:606] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:56.976418 20812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:58672
I20260709 13:05:56.976837 20812 raft_consensus.cc:606] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:56.980703 20737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:48494
I20260709 13:05:56.981135 20737 raft_consensus.cc:606] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:56.985033 20737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512371cdef324a9b8272dff175e9825a"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:48494
I20260709 13:05:56.985448 20737 raft_consensus.cc:606] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:56.989611 20737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
mode: GRACEFUL
new_leader_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:48494
I20260709 13:05:56.990028 20737 raft_consensus.cc:606] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Received request to transfer leadership to TS 611c5c47fca7440caad430a8872cbd01
I20260709 13:05:57.115149 20952 raft_consensus.cc:993] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.115583 20952 raft_consensus.cc:1081] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.116981 20663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:05:57.117470 20663 raft_consensus.cc:493] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.117772 20663 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.123112 20663 raft_consensus.cc:515] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.124544 20663 leader_election.cc:290] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:57.125290 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:57.125531 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:57.125811 20737 raft_consensus.cc:3055] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:57.125977 20812 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.126123 20737 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:57.126842 20737 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.127880 20737 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.131680 20812 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.132758 20627 leader_election.cc:304] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:57.133405 20956 raft_consensus.cc:2804] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:57.133356 20737 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.134557 20956 raft_consensus.cc:697] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:57.135381 20956 consensus_queue.cc:237] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.141311 20558 catalog_manager.cc:5697] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 2 to 3, leader changed from f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.240188 20972 raft_consensus.cc:993] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.240607 20952 raft_consensus.cc:1081] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.242007 20663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512371cdef324a9b8272dff175e9825a"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:05:57.242549 20663 raft_consensus.cc:493] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.242901 20663 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.247309 20663 raft_consensus.cc:515] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.248772 20663 leader_election.cc:290] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:57.249651 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:57.249755 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512371cdef324a9b8272dff175e9825a" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:57.250128 20737 raft_consensus.cc:3055] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:57.250226 20812 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.250447 20737 raft_consensus.cc:740] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:57.251160 20737 consensus_queue.cc:260] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.251999 20737 raft_consensus.cc:3060] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.254482 20812 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:57.255422 20627 leader_election.cc:304] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:57.256084 20956 raft_consensus.cc:2804] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:57.256084 20737 raft_consensus.cc:2468] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 2.
I20260709 13:05:57.256685 20956 raft_consensus.cc:697] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:57.257417 20956 consensus_queue.cc:237] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.263417 20558 catalog_manager.cc:5697] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 1 to 2, leader changed from f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.282809 20953 raft_consensus.cc:993] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.283233 20970 raft_consensus.cc:1081] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.284838 20663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "748279029d9f465d82fcbada2e88df16"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:05:57.285360 20663 raft_consensus.cc:493] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.285704 20663 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.291891 20663 raft_consensus.cc:515] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.293680 20663 leader_election.cc:290] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 4 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:57.294552 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:57.294806 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748279029d9f465d82fcbada2e88df16" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:57.295091 20737 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.295429 20812 raft_consensus.cc:3055] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:57.295758 20812 raft_consensus.cc:740] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:57.296476 20812 consensus_queue.cc:260] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.297461 20812 raft_consensus.cc:3060] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.300035 20737 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 4.
I20260709 13:05:57.301261 20626 leader_election.cc:304] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:57.302434 20956 raft_consensus.cc:2804] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:57.303006 20956 raft_consensus.cc:697] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 4 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:57.303301 20972 raft_consensus.cc:993] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.304242 20952 raft_consensus.cc:1081] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.303958 20956 consensus_queue.cc:237] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.304584 20812 raft_consensus.cc:2468] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 4.
I20260709 13:05:57.306593 20662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:05:57.307063 20662 raft_consensus.cc:493] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.307464 20662 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.311503 20558 catalog_manager.cc:5697] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 3 to 4, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 4 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.313612 20662 raft_consensus.cc:515] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.315308 20662 leader_election.cc:290] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:57.316064 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:57.316589 20737 raft_consensus.cc:3055] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:57.316653 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba85ec8aa74a91886d1555c44f22b0" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:57.316920 20737 raft_consensus.cc:740] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:05:57.317154 20812 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.317770 20737 consensus_queue.cc:260] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.318846 20737 raft_consensus.cc:3060] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.322521 20812 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.323447 20627 leader_election.cc:304] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, 611c5c47fca7440caad430a8872cbd01; no voters: 
I20260709 13:05:57.324147 20737 raft_consensus.cc:2468] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.324204 20956 raft_consensus.cc:2804] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:57.324738 20956 raft_consensus.cc:697] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:57.325433 20956 consensus_queue.cc:237] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.331247 20558 catalog_manager.cc:5697] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 2 to 3, leader changed from f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.519280 20957 raft_consensus.cc:993] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: : Instructing follower 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.519780 20970 raft_consensus.cc:1081] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 LEADER]: Signalling peer 611c5c47fca7440caad430a8872cbd01 to start an election
I20260709 13:05:57.521324 20662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:05:57.521842 20662 raft_consensus.cc:493] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.522169 20662 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.526968 20662 raft_consensus.cc:515] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.528532 20662 leader_election.cc:290] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Requested vote from peers f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:05:57.529366 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:05:57.529526 20812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a05a8dfec24db284dc7945a9425eee" candidate_uuid: "611c5c47fca7440caad430a8872cbd01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:05:57.529897 20737 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.530020 20812 raft_consensus.cc:3055] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:57.530361 20812 raft_consensus.cc:740] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:05:57.530966 20812 consensus_queue.cc:260] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.531957 20812 raft_consensus.cc:3060] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.534220 20737 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.535108 20626 leader_election.cc:304] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 611c5c47fca7440caad430a8872cbd01, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:05:57.535840 20973 raft_consensus.cc:2804] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:57.536295 20973 raft_consensus.cc:697] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Becoming Leader. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:05:57.537032 20973 consensus_queue.cc:237] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:05:57.537729 20812 raft_consensus.cc:2468] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 611c5c47fca7440caad430a8872cbd01 in term 3.
I20260709 13:05:57.542979 20558 catalog_manager.cc:5697] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 reported cstate change: term changed from 2 to 3, leader changed from 4231759bef7e4465b010fb683f59a902 (127.19.145.3) to 611c5c47fca7440caad430a8872cbd01 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "611c5c47fca7440caad430a8872cbd01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.575124 20812 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.576298 20973 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.586879 20737 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.588347 20973 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.662117 20737 raft_consensus.cc:1275] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:57.663200 20973 consensus_queue.cc:1048] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:57.671708 20812 raft_consensus.cc:1275] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:57.673135 20984 consensus_queue.cc:1048] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:57.876869 20737 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.877969 20956 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.886950 20812 raft_consensus.cc:1275] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.888458 20984 consensus_queue.cc:1048] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.936942 20737 raft_consensus.cc:1275] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.938001 20984 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.941499 20812 raft_consensus.cc:1275] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.942859 20984 consensus_queue.cc:1048] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.997134 20812 raft_consensus.cc:1275] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.998456 20984 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:58.006184 20737 raft_consensus.cc:1275] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Refusing update from remote peer 611c5c47fca7440caad430a8872cbd01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:58.007830 20984 consensus_queue.cc:1048] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.996268 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.003755 20662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:06:00.004428 20662 raft_consensus.cc:606] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Received request to transfer leadership to TS 4231759bef7e4465b010fb683f59a902
I20260709 13:06:00.006726 20662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:06:00.007157 20662 raft_consensus.cc:606] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Received request to transfer leadership to TS 4231759bef7e4465b010fb683f59a902
I20260709 13:06:00.009155 20662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:06:00.009577 20662 raft_consensus.cc:606] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Received request to transfer leadership to TS f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:06:00.011631 20662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e"
dest_uuid: "611c5c47fca7440caad430a8872cbd01"
mode: GRACEFUL
new_leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:34896
I20260709 13:06:00.012074 20662 raft_consensus.cc:606] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Received request to transfer leadership to TS f5ac0f3e332b4c6ba001f55a06a9218c
I20260709 13:06:00.013041 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:00.013540 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:00.049852 20973 raft_consensus.cc:993] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: : Instructing follower 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:06:00.050387 20998 raft_consensus.cc:1081] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Signalling peer 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:06:00.051818 20811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:49314
I20260709 13:06:00.052289 20811 raft_consensus.cc:493] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.052611 20811 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.058450 20811 raft_consensus.cc:515] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:06:00.060439 20811 leader_election.cc:290] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 3 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:06:00.061154 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:06:00.061488 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa2ed03c7044275b768761ff7897c10" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:06:00.061926 20662 raft_consensus.cc:3055] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.062027 20737 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.062239 20662 raft_consensus.cc:740] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:06:00.063092 20662 consensus_queue.cc:260] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:06:00.064241 20662 raft_consensus.cc:3060] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.067498 20737 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 3.
I20260709 13:06:00.067745 20973 raft_consensus.cc:993] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: : Instructing follower f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:06:00.068267 20998 raft_consensus.cc:1081] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Signalling peer f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:06:00.068950 20775 leader_election.cc:304] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:06:00.069808 20997 raft_consensus.cc:2804] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.069897 20737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:56880
I20260709 13:06:00.070389 20737 raft_consensus.cc:493] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.070740 20737 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.070899 20997 raft_consensus.cc:697] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:06:00.071741 20662 raft_consensus.cc:2468] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 3.
I20260709 13:06:00.071946 20997 consensus_queue.cc:237] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } }
I20260709 13:06:00.075950 20737 raft_consensus.cc:515] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.078389 20737 leader_election.cc:290] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 3 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:06:00.078944 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:06:00.078948 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422b62ed9c8f42d1865b81cf83f52ad8" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:06:00.079716 20811 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.079977 20662 raft_consensus.cc:3055] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.080364 20662 raft_consensus.cc:740] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:06:00.080344 20558 catalog_manager.cc:5697] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 2 to 3, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.081364 20662 consensus_queue.cc:260] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.082562 20662 raft_consensus.cc:3060] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.086596 20811 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 3.
I20260709 13:06:00.087842 20702 leader_election.cc:304] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:06:00.088649 20989 raft_consensus.cc:2804] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.089897 20989 raft_consensus.cc:697] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:06:00.090716 20989 consensus_queue.cc:237] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.091600 20662 raft_consensus.cc:2468] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 3.
I20260709 13:06:00.099854 20559 catalog_manager.cc:5697] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 2 to 3, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.240594 20973 raft_consensus.cc:993] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: : Instructing follower 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:06:00.241031 20998 raft_consensus.cc:1081] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Signalling peer 4231759bef7e4465b010fb683f59a902 to start an election
I20260709 13:06:00.242327 20811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2"
dest_uuid: "4231759bef7e4465b010fb683f59a902"
 from {username='slave'} at 127.0.0.1:49314
I20260709 13:06:00.242807 20811 raft_consensus.cc:493] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.243112 20811 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.247784 20811 raft_consensus.cc:515] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.249449 20811 leader_election.cc:290] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 4 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377)
I20260709 13:06:00.250110 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:06:00.250437 20737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e23b5c93209477a8a289ea1238faba2" candidate_uuid: "4231759bef7e4465b010fb683f59a902" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
I20260709 13:06:00.250684 20662 raft_consensus.cc:3055] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.250928 20737 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.251025 20662 raft_consensus.cc:740] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:06:00.251904 20662 consensus_queue.cc:260] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.253126 20662 raft_consensus.cc:3060] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.257109 20737 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 4.
I20260709 13:06:00.258108 20775 leader_election.cc:304] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:06:00.258751 20997 raft_consensus.cc:2804] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:00.259138 20997 raft_consensus.cc:697] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 4 LEADER]: Becoming Leader. State: Replica: 4231759bef7e4465b010fb683f59a902, State: Running, Role: LEADER
I20260709 13:06:00.259308 20662 raft_consensus.cc:2468] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4231759bef7e4465b010fb683f59a902 in term 4.
I20260709 13:06:00.260079 20997 consensus_queue.cc:237] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.267175 20559 catalog_manager.cc:5697] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 reported cstate change: term changed from 3 to 4, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to 4231759bef7e4465b010fb683f59a902 (127.19.145.3). New cstate: current_term: 4 leader_uuid: "4231759bef7e4465b010fb683f59a902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.408504 20973 raft_consensus.cc:993] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: : Instructing follower f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:06:00.408918 20998 raft_consensus.cc:1081] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Signalling peer f5ac0f3e332b4c6ba001f55a06a9218c to start an election
I20260709 13:06:00.410279 20737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e"
dest_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c"
 from {username='slave'} at 127.0.0.1:56880
I20260709 13:06:00.410703 20737 raft_consensus.cc:493] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.410983 20737 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.416496 20737 raft_consensus.cc:515] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.418031 20737 leader_election.cc:290] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Requested vote from peers 611c5c47fca7440caad430a8872cbd01 (127.19.145.1:35765), 4231759bef7e4465b010fb683f59a902 (127.19.145.3:36721)
I20260709 13:06:00.419010 20811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4231759bef7e4465b010fb683f59a902"
I20260709 13:06:00.419064 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f02c5c1cd84330b1dc5e5a7b2e9d4e" candidate_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "611c5c47fca7440caad430a8872cbd01"
I20260709 13:06:00.419636 20811 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.419703 20662 raft_consensus.cc:3055] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.420187 20662 raft_consensus.cc:740] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 611c5c47fca7440caad430a8872cbd01, State: Running, Role: LEADER
I20260709 13:06:00.421005 20662 consensus_queue.cc:260] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.422211 20662 raft_consensus.cc:3060] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.426429 20811 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:06:00.427567 20702 leader_election.cc:304] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4231759bef7e4465b010fb683f59a902, f5ac0f3e332b4c6ba001f55a06a9218c; no voters: 
I20260709 13:06:00.428241 20989 raft_consensus.cc:2804] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.428377 20662 raft_consensus.cc:2468] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac0f3e332b4c6ba001f55a06a9218c in term 2.
I20260709 13:06:00.428674 20989 raft_consensus.cc:697] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Becoming Leader. State: Replica: f5ac0f3e332b4c6ba001f55a06a9218c, State: Running, Role: LEADER
I20260709 13:06:00.429590 20989 consensus_queue.cc:237] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } }
I20260709 13:06:00.436542 20559 catalog_manager.cc:5697] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c reported cstate change: term changed from 1 to 2, leader changed from 611c5c47fca7440caad430a8872cbd01 (127.19.145.1) to f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.459206 20737 raft_consensus.cc:1275] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.460276 20997 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.470142 20662 raft_consensus.cc:1275] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.471760 20999 consensus_queue.cc:1048] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.585517 20662 raft_consensus.cc:1275] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.586728 20989 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.595736 20811 raft_consensus.cc:1275] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.598137 21015 consensus_queue.cc:1048] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.759326 20737 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.760339 20997 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac0f3e332b4c6ba001f55a06a9218c" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.768803 20662 raft_consensus.cc:1275] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Refusing update from remote peer 4231759bef7e4465b010fb683f59a902: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.770944 21018 consensus_queue.cc:1048] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:00.856138 20811 raft_consensus.cc:1275] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.857388 21015 consensus_queue.cc:1048] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4231759bef7e4465b010fb683f59a902" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.866604 20662 raft_consensus.cc:1275] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Refusing update from remote peer f5ac0f3e332b4c6ba001f55a06a9218c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.868933 21002 consensus_queue.cc:1048] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [LEADER]: Connected to new peer: Peer: permanent_uuid: "611c5c47fca7440caad430a8872cbd01" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.014310 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:01.020037 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:06:01.040511 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:01.041174 20036 tablet_replica.cc:333] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.041725 20036 raft_consensus.cc:2243] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.042423 20036 raft_consensus.cc:2272] T 748279029d9f465d82fcbada2e88df16 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.044257 20036 tablet_replica.cc:333] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.044746 20036 raft_consensus.cc:2243] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.045446 20036 raft_consensus.cc:2272] T 512371cdef324a9b8272dff175e9825a P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.047405 20036 tablet_replica.cc:333] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.047950 20036 raft_consensus.cc:2243] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.048331 20036 raft_consensus.cc:2272] T d73574123f1847ad8bb941558d762fb5 P 611c5c47fca7440caad430a8872cbd01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.050036 20036 tablet_replica.cc:333] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.050501 20036 raft_consensus.cc:2243] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.050915 20036 raft_consensus.cc:2272] T a22e1e6cc3094e368fff9b1172d4a176 P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.052574 20036 tablet_replica.cc:333] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.053049 20036 raft_consensus.cc:2243] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.053421 20036 raft_consensus.cc:2272] T 1e23b5c93209477a8a289ea1238faba2 P 611c5c47fca7440caad430a8872cbd01 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.056161 20036 tablet_replica.cc:333] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.056634 20036 raft_consensus.cc:2243] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.057024 20036 raft_consensus.cc:2272] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 611c5c47fca7440caad430a8872cbd01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.059583 20036 tablet_replica.cc:333] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.060209 20036 raft_consensus.cc:2243] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.060951 20036 raft_consensus.cc:2272] T c8a05a8dfec24db284dc7945a9425eee P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.062825 20036 tablet_replica.cc:333] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.063320 20036 raft_consensus.cc:2243] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.063681 20036 raft_consensus.cc:2272] T 422b62ed9c8f42d1865b81cf83f52ad8 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.065483 20036 tablet_replica.cc:333] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.065940 20036 raft_consensus.cc:2243] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.066612 20036 raft_consensus.cc:2272] T 4dba85ec8aa74a91886d1555c44f22b0 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.068176 20036 tablet_replica.cc:333] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01: stopping tablet replica
I20260709 13:06:01.068580 20036 raft_consensus.cc:2243] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.068945 20036 raft_consensus.cc:2272] T 2fa2ed03c7044275b768761ff7897c10 P 611c5c47fca7440caad430a8872cbd01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.087167 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
I20260709 13:06:01.110288 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
I20260709 13:06:01.135002 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:01.135762 20036 tablet_replica.cc:333] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.136404 20036 raft_consensus.cc:2243] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.136910 20036 raft_consensus.cc:2272] T 748279029d9f465d82fcbada2e88df16 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.138672 20036 tablet_replica.cc:333] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.139174 20036 raft_consensus.cc:2243] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.139683 20036 raft_consensus.cc:2272] T c8a05a8dfec24db284dc7945a9425eee P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.141224 20036 tablet_replica.cc:333] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.141717 20036 raft_consensus.cc:2243] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.142117 20036 raft_consensus.cc:2272] T 2fa2ed03c7044275b768761ff7897c10 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.144708 20036 tablet_replica.cc:333] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.145231 20036 raft_consensus.cc:2243] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.145676 20036 raft_consensus.cc:2272] T 4dba85ec8aa74a91886d1555c44f22b0 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.147167 20036 tablet_replica.cc:333] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.147706 20036 raft_consensus.cc:2243] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.148396 20036 raft_consensus.cc:2272] T 422b62ed9c8f42d1865b81cf83f52ad8 P f5ac0f3e332b4c6ba001f55a06a9218c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.150182 20036 tablet_replica.cc:333] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.150674 20036 raft_consensus.cc:2243] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.151081 20036 raft_consensus.cc:2272] T 1e23b5c93209477a8a289ea1238faba2 P f5ac0f3e332b4c6ba001f55a06a9218c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.153023 20036 tablet_replica.cc:333] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.153504 20036 raft_consensus.cc:2243] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.154208 20036 raft_consensus.cc:2272] T a22e1e6cc3094e368fff9b1172d4a176 P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.155987 20036 tablet_replica.cc:333] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.156502 20036 raft_consensus.cc:2243] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.156926 20036 raft_consensus.cc:2272] T 512371cdef324a9b8272dff175e9825a P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.158428 20036 tablet_replica.cc:333] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.158936 20036 raft_consensus.cc:2243] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.159359 20036 raft_consensus.cc:2272] T d73574123f1847ad8bb941558d762fb5 P f5ac0f3e332b4c6ba001f55a06a9218c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.160815 20036 tablet_replica.cc:333] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c: stopping tablet replica
I20260709 13:06:01.161250 20036 raft_consensus.cc:2243] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.161940 20036 raft_consensus.cc:2272] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P f5ac0f3e332b4c6ba001f55a06a9218c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.194376 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
W20260709 13:06:01.210850 20775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.2:33377: connect: Connection refused (error 111)
W20260709 13:06:01.214359 20775 consensus_peers.cc:597] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 -> Peer f5ac0f3e332b4c6ba001f55a06a9218c (127.19.145.2:33377): Couldn't send request to peer f5ac0f3e332b4c6ba001f55a06a9218c. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:33377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.215432 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:06:01.236440 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:01.237167 20036 tablet_replica.cc:333] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.237751 20036 raft_consensus.cc:2243] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.238256 20036 raft_consensus.cc:2272] T a22e1e6cc3094e368fff9b1172d4a176 P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.240082 20036 tablet_replica.cc:333] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.240609 20036 raft_consensus.cc:2243] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.241322 20036 raft_consensus.cc:2272] T 1e23b5c93209477a8a289ea1238faba2 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.243814 20036 tablet_replica.cc:333] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.244324 20036 raft_consensus.cc:2243] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.245054 20036 raft_consensus.cc:2272] T d73574123f1847ad8bb941558d762fb5 P 4231759bef7e4465b010fb683f59a902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.246598 20036 tablet_replica.cc:333] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.247059 20036 raft_consensus.cc:2243] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.247515 20036 raft_consensus.cc:2272] T 82f02c5c1cd84330b1dc5e5a7b2e9d4e P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.249410 20036 tablet_replica.cc:333] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.249928 20036 raft_consensus.cc:2243] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.250356 20036 raft_consensus.cc:2272] T 512371cdef324a9b8272dff175e9825a P 4231759bef7e4465b010fb683f59a902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.251991 20036 tablet_replica.cc:333] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.252462 20036 raft_consensus.cc:2243] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.252856 20036 raft_consensus.cc:2272] T c8a05a8dfec24db284dc7945a9425eee P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.254304 20036 tablet_replica.cc:333] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.254765 20036 raft_consensus.cc:2243] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.255160 20036 raft_consensus.cc:2272] T 748279029d9f465d82fcbada2e88df16 P 4231759bef7e4465b010fb683f59a902 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.256708 20036 tablet_replica.cc:333] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.257160 20036 raft_consensus.cc:2243] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.257552 20036 raft_consensus.cc:2272] T 422b62ed9c8f42d1865b81cf83f52ad8 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.259613 20036 tablet_replica.cc:333] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.260062 20036 raft_consensus.cc:2243] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.260461 20036 raft_consensus.cc:2272] T 4dba85ec8aa74a91886d1555c44f22b0 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.261929 20036 tablet_replica.cc:333] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902: stopping tablet replica
I20260709 13:06:01.262343 20036 raft_consensus.cc:2243] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.262985 20036 raft_consensus.cc:2272] T 2fa2ed03c7044275b768761ff7897c10 P 4231759bef7e4465b010fb683f59a902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.289672 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:06:01.307796 20036 master.cc:562] Master@127.19.145.62:40025 shutting down...
I20260709 13:06:01.326970 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:01.327520 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.327857 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P cc40ce6696874ea088ca956228c3b9c2: stopping tablet replica
I20260709 13:06:01.347747 20036 master.cc:584] Master@127.19.145.62:40025 shutdown complete.
4231759bef7e4465b010fb683f59a902  1
611c5c47fca7440caad430a8872cbd01  5
f5ac0f3e332b4c6ba001f55a06a9218c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10297 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:01.386504 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:44287
I20260709 13:06:01.387688 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.393311 21024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.393864 21027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.394477 21025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.394635 20036 server_base.cc:1061] running on GCE node
I20260709 13:06:01.395728 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.395931 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.396107 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602361396075 us; error 0 us; skew 500 ppm
I20260709 13:06:01.396644 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.398861 20036 webserver.cc:533] Webserver started at http://127.19.145.62:32905/ using document root <none> and password file <none>
I20260709 13:06:01.399410 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.399603 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.399901 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.400960 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.405424 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:01.408535 21032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.409389 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:01.409618 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.409868 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.423233 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.424433 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.461740 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:44287
I20260709 13:06:01.461850 21083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:44287 every 8 connection(s)
I20260709 13:06:01.465637 21084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.474743 21084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Bootstrap starting.
I20260709 13:06:01.479406 21084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.483330 21084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: No bootstrap required, opened a new log
I20260709 13:06:01.485356 21084 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER }
I20260709 13:06:01.485743 21084 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.485972 21084 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f9ac50e9a3445ba29d33dbe0f8af0f, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.486531 21084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER }
I20260709 13:06:01.486989 21084 raft_consensus.cc:399] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:01.487208 21084 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:01.487514 21084 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.491477 21084 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER }
I20260709 13:06:01.491989 21084 leader_election.cc:304] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17f9ac50e9a3445ba29d33dbe0f8af0f; no voters: 
I20260709 13:06:01.493053 21084 leader_election.cc:290] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:01.493445 21087 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.494638 21087 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 1 LEADER]: Becoming Leader. State: Replica: 17f9ac50e9a3445ba29d33dbe0f8af0f, State: Running, Role: LEADER
I20260709 13:06:01.495378 21087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER }
I20260709 13:06:01.496017 21084 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:01.499600 21088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER } }
I20260709 13:06:01.500268 21088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:01.500102 21089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17f9ac50e9a3445ba29d33dbe0f8af0f. Latest consensus state: current_term: 1 leader_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f9ac50e9a3445ba29d33dbe0f8af0f" member_type: VOTER } }
I20260709 13:06:01.500676 21089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:01.503086 21094 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:01.510860 21094 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:01.511899 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:01.519619 21094 catalog_manager.cc:1383] Generated new cluster ID: c9d25d7a5e9f4ab48cd4dad8d978e7f6
I20260709 13:06:01.519928 21094 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:01.553980 21094 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:01.555341 21094 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:01.568910 21094 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Generated new TSK 0
I20260709 13:06:01.569522 21094 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:01.577943 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.583544 21105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.584646 21106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.586243 20036 server_base.cc:1061] running on GCE node
W20260709 13:06:01.586215 21108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.587361 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.587535 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.587649 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602361587638 us; error 0 us; skew 500 ppm
I20260709 13:06:01.588099 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.590160 20036 webserver.cc:533] Webserver started at http://127.19.145.1:36063/ using document root <none> and password file <none>
I20260709 13:06:01.590592 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.590744 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.590948 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.592039 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "3585d99c303e453c8c3762b294caba4e"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.596282 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:06:01.599395 21113 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.600102 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 13:06:01.600492 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "3585d99c303e453c8c3762b294caba4e"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.600764 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.613426 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.614616 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.616048 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.618201 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.618394 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.618659 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.618836 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.657274 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:46145
I20260709 13:06:01.657344 21175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:46145 every 8 connection(s)
I20260709 13:06:01.662066 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.669883 21180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.670658 21181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.674574 21183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.674741 20036 server_base.cc:1061] running on GCE node
I20260709 13:06:01.675519 21176 heartbeater.cc:344] Connected to a master server at 127.19.145.62:44287
I20260709 13:06:01.675700 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:01.675872 21176 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:01.676017 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.676294 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602361676275 us; error 0 us; skew 500 ppm
I20260709 13:06:01.676748 21176 heartbeater.cc:507] Master 127.19.145.62:44287 requested a full tablet report, sending...
I20260709 13:06:01.676872 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.679214 21049 ts_manager.cc:194] Registered new tserver with Master: 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:01.679693 20036 webserver.cc:533] Webserver started at http://127.19.145.2:40421/ using document root <none> and password file <none>
I20260709 13:06:01.680181 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.680389 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.680644 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.681135 21049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46294
I20260709 13:06:01.681785 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.686056 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:01.689039 21188 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.689738 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:01.690025 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.690304 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.708262 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.709422 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.710783 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.713076 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.713291 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.713529 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.713693 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.753109 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:43757
I20260709 13:06:01.753198 21250 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:43757 every 8 connection(s)
I20260709 13:06:01.757659 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.764369 21254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.765133 21255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.767722 21257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.768040 20036 server_base.cc:1061] running on GCE node
I20260709 13:06:01.769243 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.769503 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.769703 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602361769683 us; error 0 us; skew 500 ppm
I20260709 13:06:01.769774 21251 heartbeater.cc:344] Connected to a master server at 127.19.145.62:44287
I20260709 13:06:01.770131 21251 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.770442 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.770987 21251 heartbeater.cc:507] Master 127.19.145.62:44287 requested a full tablet report, sending...
I20260709 13:06:01.773001 20036 webserver.cc:533] Webserver started at http://127.19.145.3:33363/ using document root <none> and password file <none>
I20260709 13:06:01.773669 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.773605 21049 ts_manager.cc:194] Registered new tserver with Master: f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:01.773986 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.774317 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.775430 21049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46310
I20260709 13:06:01.775774 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "7c5246dc52bb49f38aef22aba1467452"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.780445 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:01.783424 21262 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.784118 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:06:01.784379 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "7c5246dc52bb49f38aef22aba1467452"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-cd6k"
I20260709 13:06:01.784605 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.796423 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.797632 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.798964 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.801067 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.801270 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.801522 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.801692 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.842077 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:44115
I20260709 13:06:01.842168 21324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:44115 every 8 connection(s)
I20260709 13:06:01.855399 21325 heartbeater.cc:344] Connected to a master server at 127.19.145.62:44287
I20260709 13:06:01.855708 21325 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.856350 21325 heartbeater.cc:507] Master 127.19.145.62:44287 requested a full tablet report, sending...
I20260709 13:06:01.858062 21049 ts_manager.cc:194] Registered new tserver with Master: 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:01.858572 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013304411s
I20260709 13:06:01.859756 21049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46318
I20260709 13:06:01.884995 21049 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46322:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:01.892869 21049 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:02.090943 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc62cd1660e437688d81540b9af858b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:02.092406 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc62cd1660e437688d81540b9af858b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.095443 21289 tablet_service.cc:1511] Processing CreateTablet for tablet ba1398186a7e4fe393aecbc014b953c9 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:02.095600 21140 tablet_service.cc:1511] Processing CreateTablet for tablet ba1398186a7e4fe393aecbc014b953c9 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:02.096866 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1398186a7e4fe393aecbc014b953c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.096962 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1398186a7e4fe393aecbc014b953c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.097725 21286 tablet_service.cc:1511] Processing CreateTablet for tablet 68ebd645703043ddb9e32ba2d84bbc1e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:02.098593 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 67929a23f7cc4a9a8f64f854df93b149 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:02.099134 21286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ebd645703043ddb9e32ba2d84bbc1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.099325 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 68ebd645703043ddb9e32ba2d84bbc1e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:02.099936 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67929a23f7cc4a9a8f64f854df93b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.100607 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ebd645703043ddb9e32ba2d84bbc1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.096606 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 17378a57c1c3434a8411ab6894114acb (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:02.101553 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17378a57c1c3434a8411ab6894114acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.104354 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 67929a23f7cc4a9a8f64f854df93b149 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:02.096606 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 17378a57c1c3434a8411ab6894114acb (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:02.105640 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67929a23f7cc4a9a8f64f854df93b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.106194 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17378a57c1c3434a8411ab6894114acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.104300 21290 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc62cd1660e437688d81540b9af858b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:02.108266 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc62cd1660e437688d81540b9af858b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.127928 21216 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc62cd1660e437688d81540b9af858b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:02.129293 21216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc62cd1660e437688d81540b9af858b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.132592 21215 tablet_service.cc:1511] Processing CreateTablet for tablet ba1398186a7e4fe393aecbc014b953c9 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:02.134428 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1398186a7e4fe393aecbc014b953c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.136940 21213 tablet_service.cc:1511] Processing CreateTablet for tablet 17378a57c1c3434a8411ab6894114acb (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:02.138787 21213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17378a57c1c3434a8411ab6894114acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.140961 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 68ebd645703043ddb9e32ba2d84bbc1e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:02.142908 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ebd645703043ddb9e32ba2d84bbc1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.144861 21214 tablet_service.cc:1511] Processing CreateTablet for tablet 67929a23f7cc4a9a8f64f854df93b149 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:02.147739 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67929a23f7cc4a9a8f64f854df93b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.178369 21341 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:02.181617 21340 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.190970 21211 tablet_service.cc:1511] Processing CreateTablet for tablet 425aa4009f134d7c94f0050facfd0811 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:02.191530 21289 tablet_service.cc:1511] Processing CreateTablet for tablet 425aa4009f134d7c94f0050facfd0811 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:02.192427 21211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425aa4009f134d7c94f0050facfd0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.192778 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425aa4009f134d7c94f0050facfd0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.200043 21340 tablet_bootstrap.cc:654] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.208444 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 425aa4009f134d7c94f0050facfd0811 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:02.210888 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425aa4009f134d7c94f0050facfd0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.224561 21341 tablet_bootstrap.cc:654] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.225404 21340 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:02.225252 21138 tablet_service.cc:1511] Processing CreateTablet for tablet a4a7d35cd96a44f7ab838841678c5b17 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:02.225862 21340 ts_tablet_manager.cc:1403] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:06:02.226660 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a7d35cd96a44f7ab838841678c5b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.226718 21343 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:02.228843 21340 raft_consensus.cc:359] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.229542 21340 raft_consensus.cc:385] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.229830 21340 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.230569 21340 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.234905 21343 tablet_bootstrap.cc:654] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.241480 21341 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:02.241834 21343 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:02.241974 21341 ts_tablet_manager.cc:1403] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.009s
I20260709 13:06:02.242393 21343 ts_tablet_manager.cc:1403] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 13:06:02.243366 21211 tablet_service.cc:1511] Processing CreateTablet for tablet a4a7d35cd96a44f7ab838841678c5b17 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:02.245122 21211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a7d35cd96a44f7ab838841678c5b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.244961 21341 raft_consensus.cc:359] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.245756 21341 raft_consensus.cc:385] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.246088 21341 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.245127 21343 raft_consensus.cc:359] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.251401 21343 raft_consensus.cc:385] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.249485 21288 tablet_service.cc:1511] Processing CreateTablet for tablet a4a7d35cd96a44f7ab838841678c5b17 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:02.251292 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 881a7cf58d404812aa274b116b666741 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:02.256107 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a7d35cd96a44f7ab838841678c5b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.256417 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881a7cf58d404812aa274b116b666741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.257889 21343 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.252568 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 881a7cf58d404812aa274b116b666741 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:02.258924 21343 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.259797 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881a7cf58d404812aa274b116b666741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.265870 21214 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbfab1f26fc47bab947744fba7cf062 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:02.246915 21341 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.254112 21213 tablet_service.cc:1511] Processing CreateTablet for tablet 881a7cf58d404812aa274b116b666741 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:02.268613 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbfab1f26fc47bab947744fba7cf062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.270138 21176 heartbeater.cc:499] Master 127.19.145.62:44287 was elected leader, sending a full tablet report...
I20260709 13:06:02.270673 21340 ts_tablet_manager.cc:1434] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.044s	user 0.015s	sys 0.022s
I20260709 13:06:02.272578 21286 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbfab1f26fc47bab947744fba7cf062 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:02.278168 21286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbfab1f26fc47bab947744fba7cf062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.278262 21340 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.280543 21213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881a7cf58d404812aa274b116b666741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.272584 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbfab1f26fc47bab947744fba7cf062 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:02.287314 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbfab1f26fc47bab947744fba7cf062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.290787 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 116d5e82da354208af66a0e6f7a51dcf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:02.292140 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116d5e82da354208af66a0e6f7a51dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.297331 21341 ts_tablet_manager.cc:1434] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:06:02.297765 21251 heartbeater.cc:499] Master 127.19.145.62:44287 was elected leader, sending a full tablet report...
I20260709 13:06:02.307421 21139 tablet_service.cc:1511] Processing CreateTablet for tablet e36ad000b4a9410f80c7796396b878f5 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:02.307994 21325 heartbeater.cc:499] Master 127.19.145.62:44287 was elected leader, sending a full tablet report...
I20260709 13:06:02.308715 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ad000b4a9410f80c7796396b878f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.308393 21215 tablet_service.cc:1511] Processing CreateTablet for tablet e36ad000b4a9410f80c7796396b878f5 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:02.298084 21216 tablet_service.cc:1511] Processing CreateTablet for tablet 116d5e82da354208af66a0e6f7a51dcf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:02.312862 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:02.314160 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.315709 21346 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.316174 21346 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.317857 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:02.318395 21210 tablet_service.cc:1511] Processing CreateTablet for tablet 54d06546a96347e488abe4e862d0425b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:02.318773 21346 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.320009 21340 tablet_bootstrap.cc:654] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.320354 21136 tablet_service.cc:1511] Processing CreateTablet for tablet 54d06546a96347e488abe4e862d0425b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:02.325663 21136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d06546a96347e488abe4e862d0425b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.326930 21348 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.327591 21348 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.331079 21348 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:02.318854 21341 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:02.345434 21288 tablet_service.cc:1511] Processing CreateTablet for tablet e36ad000b4a9410f80c7796396b878f5 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:02.346752 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ad000b4a9410f80c7796396b878f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.347316 21211 tablet_service.cc:1511] Processing CreateTablet for tablet aa95e198a0404e91adecdec5338443a0 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.346761 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ad000b4a9410f80c7796396b878f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.350375 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.350991 21210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d06546a96347e488abe4e862d0425b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.351557 21211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa95e198a0404e91adecdec5338443a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.359745 21216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116d5e82da354208af66a0e6f7a51dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.364451 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 116d5e82da354208af66a0e6f7a51dcf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:02.364698 21209 tablet_service.cc:1511] Processing CreateTablet for tablet 98b79eeda2784ff4ac1d2f6696c48563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.365813 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116d5e82da354208af66a0e6f7a51dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.366031 21209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b79eeda2784ff4ac1d2f6696c48563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.382208 21290 tablet_service.cc:1511] Processing CreateTablet for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:02.382535 21285 tablet_service.cc:1511] Processing CreateTablet for tablet aa95e198a0404e91adecdec5338443a0 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.383580 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.384281 21208 tablet_service.cc:1511] Processing CreateTablet for tablet c22f29b50b474596adeb0f179b9eb385 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.384778 21284 tablet_service.cc:1511] Processing CreateTablet for tablet 98b79eeda2784ff4ac1d2f6696c48563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.385594 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22f29b50b474596adeb0f179b9eb385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.386096 21284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b79eeda2784ff4ac1d2f6696c48563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.382472 21289 tablet_service.cc:1511] Processing CreateTablet for tablet 54d06546a96347e488abe4e862d0425b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:02.387645 21343 ts_tablet_manager.cc:1434] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.003s
I20260709 13:06:02.388013 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d06546a96347e488abe4e862d0425b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.388634 21343 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:02.391606 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa95e198a0404e91adecdec5338443a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.410192 21283 tablet_service.cc:1511] Processing CreateTablet for tablet c22f29b50b474596adeb0f179b9eb385 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.411674 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22f29b50b474596adeb0f179b9eb385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.413110 21341 tablet_bootstrap.cc:654] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.428985 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 98b79eeda2784ff4ac1d2f6696c48563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.430279 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b79eeda2784ff4ac1d2f6696c48563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.406248 21343 tablet_bootstrap.cc:654] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.440210 21134 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0599d67fb34b91a3afc1c32163efa4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.442665 21134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0599d67fb34b91a3afc1c32163efa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.443341 21135 tablet_service.cc:1511] Processing CreateTablet for tablet c22f29b50b474596adeb0f179b9eb385 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.444675 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22f29b50b474596adeb0f179b9eb385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.444576 21139 tablet_service.cc:1511] Processing CreateTablet for tablet aa95e198a0404e91adecdec5338443a0 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.445915 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa95e198a0404e91adecdec5338443a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.465090 21340 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:02.465591 21340 ts_tablet_manager.cc:1403] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.002s
I20260709 13:06:02.470407 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:02.472090 21263 leader_election.cc:343] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.472582 21340 raft_consensus.cc:359] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.473302 21340 raft_consensus.cc:385] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.473596 21340 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.474429 21340 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.497987 21208 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0599d67fb34b91a3afc1c32163efa4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.499393 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0599d67fb34b91a3afc1c32163efa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.505618 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:02.506104 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:02.507033 21114 leader_election.cc:343] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.507153 21340 ts_tablet_manager.cc:1434] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:06:02.508244 21340 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.514310 21290 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0599d67fb34b91a3afc1c32163efa4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.519449 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0599d67fb34b91a3afc1c32163efa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.519992 21341 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:02.520540 21341 ts_tablet_manager.cc:1403] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.205s	user 0.004s	sys 0.013s
I20260709 13:06:02.522336 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 217f5315ea524ce28a596c2aa95cb43f (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.523613 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217f5315ea524ce28a596c2aa95cb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.526867 21209 tablet_service.cc:1511] Processing CreateTablet for tablet 217f5315ea524ce28a596c2aa95cb43f (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.528410 21209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217f5315ea524ce28a596c2aa95cb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.538040 21285 tablet_service.cc:1511] Processing CreateTablet for tablet 217f5315ea524ce28a596c2aa95cb43f (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.539319 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217f5315ea524ce28a596c2aa95cb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.542225 21288 tablet_service.cc:1511] Processing CreateTablet for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.543558 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.549540 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:02.551900 21116 leader_election.cc:343] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.552354 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:02.553416 21346 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.555539 21138 tablet_service.cc:1511] Processing CreateTablet for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.556766 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.562439 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:02.564841 21212 tablet_service.cc:1511] Processing CreateTablet for tablet b58884ca99bd494292202a75faf1833c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.566501 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58884ca99bd494292202a75faf1833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.566792 21214 tablet_service.cc:1511] Processing CreateTablet for tablet fccd55284a3547968acf752c8d6f9f4d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.568038 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccd55284a3547968acf752c8d6f9f4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.568938 21263 leader_election.cc:343] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.569535 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:02.571081 21349 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.580169 21140 tablet_service.cc:1511] Processing CreateTablet for tablet fccd55284a3547968acf752c8d6f9f4d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.580080 21290 tablet_service.cc:1511] Processing CreateTablet for tablet b58884ca99bd494292202a75faf1833c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.583899 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58884ca99bd494292202a75faf1833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.583657 21341 raft_consensus.cc:359] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.584400 21341 raft_consensus.cc:385] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.584702 21341 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.588143 21340 tablet_bootstrap.cc:654] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.593485 21215 tablet_service.cc:1511] Processing CreateTablet for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.594715 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.594393 21288 tablet_service.cc:1511] Processing CreateTablet for tablet fccd55284a3547968acf752c8d6f9f4d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.598417 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccd55284a3547968acf752c8d6f9f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.585444 21341 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.603021 21137 tablet_service.cc:1511] Processing CreateTablet for tablet ef66c45b466e4acb83723f82bb2be36e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.603842 21343 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:02.604310 21343 ts_tablet_manager.cc:1403] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.037s
I20260709 13:06:02.605576 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccd55284a3547968acf752c8d6f9f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.607275 21343 raft_consensus.cc:359] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.607975 21343 raft_consensus.cc:385] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.608273 21343 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.609088 21343 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.611168 21343 ts_tablet_manager.cc:1434] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:02.612244 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66c45b466e4acb83723f82bb2be36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.613977 21214 tablet_service.cc:1511] Processing CreateTablet for tablet ef66c45b466e4acb83723f82bb2be36e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.615306 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66c45b466e4acb83723f82bb2be36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.620808 21343 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:02.621893 21340 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:02.622351 21340 ts_tablet_manager.cc:1403] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.003s
I20260709 13:06:02.623553 21135 tablet_service.cc:1511] Processing CreateTablet for tablet b58884ca99bd494292202a75faf1833c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.624650 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58884ca99bd494292202a75faf1833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.625244 21340 raft_consensus.cc:359] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.625958 21340 raft_consensus.cc:385] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.626253 21340 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.626875 21343 tablet_bootstrap.cc:654] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.628567 21341 ts_tablet_manager.cc:1434] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.108s	user 0.000s	sys 0.006s
I20260709 13:06:02.629478 21341 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:02.627003 21340 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.637322 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 7a837dff96224f8b8795bace63448d84 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.643101 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a837dff96224f8b8795bace63448d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.643911 21340 ts_tablet_manager.cc:1434] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:06:02.633764 21288 tablet_service.cc:1511] Processing CreateTablet for tablet ef66c45b466e4acb83723f82bb2be36e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.648000 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66c45b466e4acb83723f82bb2be36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.650067 21340 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.655306 21285 tablet_service.cc:1511] Processing CreateTablet for tablet 7a837dff96224f8b8795bace63448d84 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.656213 21340 tablet_bootstrap.cc:654] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.655325 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 7a837dff96224f8b8795bace63448d84 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.656562 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a837dff96224f8b8795bace63448d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.657343 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a837dff96224f8b8795bace63448d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.660362 21341 tablet_bootstrap.cc:654] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.669396 21340 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:02.669952 21340 ts_tablet_manager.cc:1403] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:06:02.672272 21341 tablet_bootstrap.cc:492] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:02.672740 21341 ts_tablet_manager.cc:1403] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.007s
I20260709 13:06:02.672931 21340 raft_consensus.cc:359] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.673661 21340 raft_consensus.cc:385] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.673945 21340 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.674778 21340 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.675630 21341 raft_consensus.cc:359] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.676338 21341 raft_consensus.cc:385] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.676618 21341 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.678583 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 28d3af139eae4d85981a3afde9289604 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.679877 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d3af139eae4d85981a3afde9289604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.682314 21290 tablet_service.cc:1511] Processing CreateTablet for tablet 28d3af139eae4d85981a3afde9289604 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.682691 21343 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:02.683215 21343 ts_tablet_manager.cc:1403] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:06:02.684854 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 28d3af139eae4d85981a3afde9289604 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.686058 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d3af139eae4d85981a3afde9289604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.686621 21341 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.688683 21138 tablet_service.cc:1511] Processing CreateTablet for tablet aff8a809ecee49028cc5d6587518d7c8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.689931 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8a809ecee49028cc5d6587518d7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.693465 21340 ts_tablet_manager.cc:1434] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:06:02.695477 21341 ts_tablet_manager.cc:1434] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:06:02.696619 21340 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.698470 21347 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.698958 21347 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.704767 21347 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.708259 21340 tablet_bootstrap.cc:654] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.708624 21341 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:02.715704 21341 tablet_bootstrap.cc:654] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.717142 21215 tablet_service.cc:1511] Processing CreateTablet for tablet aff8a809ecee49028cc5d6587518d7c8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.718410 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8a809ecee49028cc5d6587518d7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.727905 21341 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:02.728386 21341 ts_tablet_manager.cc:1403] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:06:02.729878 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:02.730527 21300 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:02.731238 21341 raft_consensus.cc:359] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.712944 21343 raft_consensus.cc:359] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.732043 21341 raft_consensus.cc:385] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.732494 21341 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.732259 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:02.733404 21347 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.733728 21347 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.734053 21347 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.733551 21341 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.735854 21341 ts_tablet_manager.cc:1434] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:02.736815 21341 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:02.734100 21340 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:02.732401 21343 raft_consensus.cc:385] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.737913 21340 ts_tablet_manager.cc:1403] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.002s
I20260709 13:06:02.737983 21343 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.740024 21343 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.746871 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d3af139eae4d85981a3afde9289604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.746938 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 5918dc9de89b4d149ecb2548872e4642 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.747473 21347 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.748273 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5918dc9de89b4d149ecb2548872e4642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.750372 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:02.750522 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:02.750993 21300 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.750993 21150 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.755457 21285 tablet_service.cc:1511] Processing CreateTablet for tablet 5918dc9de89b4d149ecb2548872e4642 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.756740 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5918dc9de89b4d149ecb2548872e4642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.740820 21340 raft_consensus.cc:359] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.742568 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:02.761430 21340 raft_consensus.cc:385] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.761788 21340 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.762609 21340 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.762879 21283 tablet_service.cc:1511] Processing CreateTablet for tablet 605603ac2631443292cd7278cf055b51 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.764149 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605603ac2631443292cd7278cf055b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.764987 21340 ts_tablet_manager.cc:1434] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:06:02.765960 21340 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:02.766381 21300 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:02.767673 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:02.768826 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 605603ac2631443292cd7278cf055b51 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.772250 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 605603ac2631443292cd7278cf055b51 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.773005 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605603ac2631443292cd7278cf055b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.773566 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605603ac2631443292cd7278cf055b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.776276 21150 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:02.778523 21288 tablet_service.cc:1511] Processing CreateTablet for tablet aff8a809ecee49028cc5d6587518d7c8 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.779765 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8a809ecee49028cc5d6587518d7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.770663 21347 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.786355 21347 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.788421 21341 tablet_bootstrap.cc:654] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.787942 21347 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.801751 21347 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.802444 21347 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.802407 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:02.803094 21347 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:02.803305 21135 tablet_service.cc:1511] Processing CreateTablet for tablet a40ec5c131174be78b99773258d3da3b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.802287 21215 tablet_service.cc:1511] Processing CreateTablet for tablet 5918dc9de89b4d149ecb2548872e4642 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.803982 21347 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.804519 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ec5c131174be78b99773258d3da3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.804713 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5918dc9de89b4d149ecb2548872e4642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.811403 21150 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:02.812958 21189 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:02.814388 21285 tablet_service.cc:1511] Processing CreateTablet for tablet a40ec5c131174be78b99773258d3da3b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.816251 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ec5c131174be78b99773258d3da3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.816323 21367 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.816797 21367 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.820505 21139 tablet_service.cc:1511] Processing CreateTablet for tablet f13baf7007c44fb5a2efa7e30933caf3 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.821827 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13baf7007c44fb5a2efa7e30933caf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.822289 21283 tablet_service.cc:1511] Processing CreateTablet for tablet f13baf7007c44fb5a2efa7e30933caf3 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.823555 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13baf7007c44fb5a2efa7e30933caf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.817214 21367 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.837970 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:02.838629 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:02.839090 21214 tablet_service.cc:1511] Processing CreateTablet for tablet f13baf7007c44fb5a2efa7e30933caf3 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.840361 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13baf7007c44fb5a2efa7e30933caf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.844554 21289 tablet_service.cc:1511] Processing CreateTablet for tablet 3dee37f119694b8cbc658fd3b84b0563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.845830 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dee37f119694b8cbc658fd3b84b0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.851781 21340 tablet_bootstrap.cc:654] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.853456 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 3dee37f119694b8cbc658fd3b84b0563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.854156 21134 tablet_service.cc:1511] Processing CreateTablet for tablet 5cca46a22ac5436d9438fe96be0e2fbe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.854707 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dee37f119694b8cbc658fd3b84b0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.855382 21134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cca46a22ac5436d9438fe96be0e2fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.863516 21366 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.864239 21343 ts_tablet_manager.cc:1434] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.181s	user 0.018s	sys 0.018s
I20260709 13:06:02.864018 21366 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.865206 21343 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:02.865679 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 5cca46a22ac5436d9438fe96be0e2fbe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.866151 21366 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.866950 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cca46a22ac5436d9438fe96be0e2fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.867760 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:02.868429 21150 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:02.869741 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:02.870556 21366 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.870905 21366 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.871214 21366 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.873190 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:02.875918 21208 tablet_service.cc:1511] Processing CreateTablet for tablet 5cca46a22ac5436d9438fe96be0e2fbe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.877161 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cca46a22ac5436d9438fe96be0e2fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.878961 21366 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.881840 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:02.882366 21150 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:02.883594 21191 leader_election.cc:343] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.886194 21343 tablet_bootstrap.cc:654] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.888820 21150 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:02.889943 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:02.889974 21211 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b6c321dab4a71866dd41996aca451 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.890971 21365 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.891357 21211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b6c321dab4a71866dd41996aca451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.851945 21215 tablet_service.cc:1511] Processing CreateTablet for tablet a40ec5c131174be78b99773258d3da3b (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.891144 21284 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b6c321dab4a71866dd41996aca451 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.911340 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ec5c131174be78b99773258d3da3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.910811 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 34b1f4f16adf4e74a88911d4906d95bf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:02.912536 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b1f4f16adf4e74a88911d4906d95bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.914510 21209 tablet_service.cc:1511] Processing CreateTablet for tablet 34b1f4f16adf4e74a88911d4906d95bf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:02.915782 21209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b1f4f16adf4e74a88911d4906d95bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.915791 21341 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:02.916395 21341 ts_tablet_manager.cc:1403] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.008s
I20260709 13:06:02.917908 21346 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.918342 21346 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.917404 21049 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.919799 21284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b6c321dab4a71866dd41996aca451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.920368 21346 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.925545 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:02.927564 21216 tablet_service.cc:1511] Processing CreateTablet for tablet df140636c4344f32a0253fef2a907c50 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.927564 21141 tablet_service.cc:1511] Processing CreateTablet for tablet df140636c4344f32a0253fef2a907c50 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.929086 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140636c4344f32a0253fef2a907c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.925566 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:02.929086 21216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140636c4344f32a0253fef2a907c50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.930534 21114 leader_election.cc:343] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.935401 21116 leader_election.cc:343] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.936607 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:02.937901 21116 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:02.939123 21346 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.922251 21341 raft_consensus.cc:359] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.940011 21341 raft_consensus.cc:385] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.940338 21341 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.941069 21341 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.941982 21300 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.947839 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 3dee37f119694b8cbc658fd3b84b0563 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.948524 21366 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.949206 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dee37f119694b8cbc658fd3b84b0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.949978 21300 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:02.964414 21136 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb461d83104dcc8a40aac647f74899 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:02.965688 21136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb461d83104dcc8a40aac647f74899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.965969 21215 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb461d83104dcc8a40aac647f74899 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:02.967242 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb461d83104dcc8a40aac647f74899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.960734 21341 ts_tablet_manager.cc:1434] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:06:02.961472 21365 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:02.981472 21290 tablet_service.cc:1511] Processing CreateTablet for tablet df140636c4344f32a0253fef2a907c50 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.982556 21135 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b6c321dab4a71866dd41996aca451 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.983174 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140636c4344f32a0253fef2a907c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.983952 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b6c321dab4a71866dd41996aca451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.984338 21214 tablet_service.cc:1511] Processing CreateTablet for tablet ddef3aae03e94e30acb5d8592f3f75b2 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:02.985523 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef3aae03e94e30acb5d8592f3f75b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.988018 21289 tablet_service.cc:1511] Processing CreateTablet for tablet 34b1f4f16adf4e74a88911d4906d95bf (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:02.989207 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b1f4f16adf4e74a88911d4906d95bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.990651 21138 tablet_service.cc:1511] Processing CreateTablet for tablet ddef3aae03e94e30acb5d8592f3f75b2 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:02.992079 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef3aae03e94e30acb5d8592f3f75b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.960482 21367 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:02.997136 21367 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:02.997864 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:02.998245 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:02.998409 21150 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.998807 21300 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.001093 21341 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:03.005650 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:03.006949 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:03.008011 21367 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.008708 21367 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:03.009578 21150 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:03.009542 21367 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.022495 21346 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.023033 21346 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.025048 21346 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.027804 21283 tablet_service.cc:1511] Processing CreateTablet for tablet ddef3aae03e94e30acb5d8592f3f75b2 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:03.029089 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef3aae03e94e30acb5d8592f3f75b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.032107 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb461d83104dcc8a40aac647f74899 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:03.032850 21340 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:03.033306 21340 ts_tablet_manager.cc:1403] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.268s	user 0.013s	sys 0.011s
I20260709 13:06:03.036240 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 688a48cc2bc64a7a9e78bf41a84d44ca (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:03.037452 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688a48cc2bc64a7a9e78bf41a84d44ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.038796 21212 tablet_service.cc:1511] Processing CreateTablet for tablet 688a48cc2bc64a7a9e78bf41a84d44ca (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:03.040011 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688a48cc2bc64a7a9e78bf41a84d44ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.039945 21365 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.043049 21349 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.043588 21349 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.033354 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb461d83104dcc8a40aac647f74899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.043974 21286 tablet_service.cc:1511] Processing CreateTablet for tablet 688a48cc2bc64a7a9e78bf41a84d44ca (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:03.045212 21286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688a48cc2bc64a7a9e78bf41a84d44ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.045459 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:03.045608 21349 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:03.046038 21300 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:03.047231 21116 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:03.047605 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:03.047648 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:03.050586 21114 leader_election.cc:343] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.051465 21346 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.051831 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:03.052220 21263 leader_election.cc:343] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.052809 21346 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.053643 21346 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.053717 21263 leader_election.cc:343] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.054436 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:03.055490 21349 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.069550 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 09568f2c2c854929b369d24083d81717 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:03.070865 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09568f2c2c854929b369d24083d81717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.065227 21341 tablet_bootstrap.cc:654] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.083312 21215 tablet_service.cc:1511] Processing CreateTablet for tablet 09568f2c2c854929b369d24083d81717 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:03.084698 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09568f2c2c854929b369d24083d81717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.093422 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 398cfd943855433fb7159548a64fbe6e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:03.094717 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398cfd943855433fb7159548a64fbe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.097107 21343 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:03.097610 21343 ts_tablet_manager.cc:1403] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.233s	user 0.021s	sys 0.006s
I20260709 13:06:03.100150 21135 tablet_service.cc:1511] Processing CreateTablet for tablet 09568f2c2c854929b369d24083d81717 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:03.094316 21346 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.111481 21208 tablet_service.cc:1511] Processing CreateTablet for tablet 398cfd943855433fb7159548a64fbe6e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:03.112746 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398cfd943855433fb7159548a64fbe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.113121 21134 tablet_service.cc:1511] Processing CreateTablet for tablet e2494cfa0b6749f6b7ba55475fc2cf68 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:03.114748 21134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2494cfa0b6749f6b7ba55475fc2cf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.118815 21343 raft_consensus.cc:359] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.119517 21343 raft_consensus.cc:385] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.119793 21343 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.119088 21285 tablet_service.cc:1511] Processing CreateTablet for tablet 398cfd943855433fb7159548a64fbe6e (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:03.120520 21343 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.121537 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398cfd943855433fb7159548a64fbe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.122531 21343 ts_tablet_manager.cc:1434] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 13:06:03.124688 21343 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:03.136672 21343 tablet_bootstrap.cc:654] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.137851 21340 raft_consensus.cc:359] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.138581 21340 raft_consensus.cc:385] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.138895 21340 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.139690 21340 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.156186 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09568f2c2c854929b369d24083d81717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.159778 21367 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.160526 21346 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.160265 21367 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.161530 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:03.162097 21225 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.163125 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:03.163825 21300 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.165175 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:03.167695 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:03.168649 21150 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:03.163126 21367 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.174953 21189 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:03.183646 21212 tablet_service.cc:1511] Processing CreateTablet for tablet e2494cfa0b6749f6b7ba55475fc2cf68 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:03.185122 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2494cfa0b6749f6b7ba55475fc2cf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.190529 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 198128dc1acc4c9bbe56ff48a07e23a4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.212957 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:03.203754 21284 tablet_service.cc:1511] Processing CreateTablet for tablet e2494cfa0b6749f6b7ba55475fc2cf68 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:03.217427 21284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2494cfa0b6749f6b7ba55475fc2cf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.217702 21209 tablet_service.cc:1511] Processing CreateTablet for tablet 08a13eedafd74dabb8f0219f4c7e9288 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.218907 21209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a13eedafd74dabb8f0219f4c7e9288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.219702 21365 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.220309 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 9f88661ef8d64aa7893277b13b46ff04 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.225649 21300 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:03.226022 21341 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:03.226506 21341 ts_tablet_manager.cc:1403] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.000s
I20260709 13:06:03.228911 21215 tablet_service.cc:1511] Processing CreateTablet for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:03.229775 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ede0f4ec7554d9597f6e9c64ce23e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.190838 21214 tablet_service.cc:1511] Processing CreateTablet for tablet 198128dc1acc4c9bbe56ff48a07e23a4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.226724 21116 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:03.232124 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198128dc1acc4c9bbe56ff48a07e23a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.234867 21346 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.248319 21346 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:03.249413 21346 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.260674 21377 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.261269 21343 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:03.261170 21377 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.261407 21225 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:03.261791 21343 ts_tablet_manager.cc:1403] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.006s
I20260709 13:06:03.262087 21367 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.264081 21132 tablet_service.cc:1511] Processing CreateTablet for tablet c2308648f35c4faf94816331179c44aa (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.265295 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f88661ef8d64aa7893277b13b46ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.265975 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:03.266587 21299 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:03.267766 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:03.271574 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ede0f4ec7554d9597f6e9c64ce23e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.236755 21133 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0495c200ee4175916ed50c64ff61a7 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.274134 21377 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.274904 21133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0495c200ee4175916ed50c64ff61a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.276021 21132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2308648f35c4faf94816331179c44aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.274796 21377 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.276402 21377 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.276854 21377 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.279923 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:03.281210 21114 leader_election.cc:343] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.282720 21343 raft_consensus.cc:359] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.283473 21343 raft_consensus.cc:385] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.283761 21343 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.284482 21343 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.286516 21340 ts_tablet_manager.cc:1434] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.253s	user 0.012s	sys 0.000s
I20260709 13:06:03.287736 21340 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:03.289865 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 33f9268b51e14a8d82c0377b1596e9ce (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.293766 21341 raft_consensus.cc:359] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.294463 21341 raft_consensus.cc:385] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.294752 21341 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.234743 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 08a13eedafd74dabb8f0219f4c7e9288 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.259505 21214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198128dc1acc4c9bbe56ff48a07e23a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.298942 21212 tablet_service.cc:1511] Processing CreateTablet for tablet c2308648f35c4faf94816331179c44aa (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.300206 21215 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0495c200ee4175916ed50c64ff61a7 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.310563 21211 tablet_service.cc:1511] Processing CreateTablet for tablet 33f9268b51e14a8d82c0377b1596e9ce (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.316524 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 574f49e93265460891ff981be2cee774 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:03.291136 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f9268b51e14a8d82c0377b1596e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.319310 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0495c200ee4175916ed50c64ff61a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.310563 21208 tablet_service.cc:1511] Processing CreateTablet for tablet 9f88661ef8d64aa7893277b13b46ff04 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.331490 21367 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.332144 21211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f9268b51e14a8d82c0377b1596e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.331936 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 28a3e5fa488f4d4f813752adf6415abe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.333035 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a3e5fa488f4d4f813752adf6415abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.339651 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 198128dc1acc4c9bbe56ff48a07e23a4 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.340792 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198128dc1acc4c9bbe56ff48a07e23a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.342803 21377 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.345531 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:03.346066 21225 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.348829 21216 tablet_service.cc:1511] Processing CreateTablet for tablet 574f49e93265460891ff981be2cee774 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:03.349152 21213 tablet_service.cc:1511] Processing CreateTablet for tablet 28a3e5fa488f4d4f813752adf6415abe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.351109 21210 tablet_service.cc:1511] Processing CreateTablet for tablet 02e32a83beeb475fa3edaac416334c5d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.351687 21216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574f49e93265460891ff981be2cee774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.352560 21210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e32a83beeb475fa3edaac416334c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.353852 21225 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:03.354583 21377 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.356119 21286 tablet_service.cc:1511] Processing CreateTablet for tablet 08a13eedafd74dabb8f0219f4c7e9288 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.357317 21286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a13eedafd74dabb8f0219f4c7e9288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.355943 21283 tablet_service.cc:1511] Processing CreateTablet for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:03.360224 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ede0f4ec7554d9597f6e9c64ce23e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.362119 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2308648f35c4faf94816331179c44aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.364130 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a13eedafd74dabb8f0219f4c7e9288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.363986 21287 tablet_service.cc:1511] Processing CreateTablet for tablet c2308648f35c4faf94816331179c44aa (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.365176 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2308648f35c4faf94816331179c44aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.366250 21289 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0495c200ee4175916ed50c64ff61a7 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.367821 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0495c200ee4175916ed50c64ff61a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.370568 21290 tablet_service.cc:1511] Processing CreateTablet for tablet 9f88661ef8d64aa7893277b13b46ff04 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.372051 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574f49e93265460891ff981be2cee774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.372212 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f88661ef8d64aa7893277b13b46ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.375837 21114 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:03.384749 21377 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.387904 21377 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:03.388753 21377 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.388947 21134 tablet_service.cc:1511] Processing CreateTablet for tablet 02e32a83beeb475fa3edaac416334c5d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.390213 21134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e32a83beeb475fa3edaac416334c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.390617 21213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a3e5fa488f4d4f813752adf6415abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.392298 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f88661ef8d64aa7893277b13b46ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.319005 21341 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.400053 21343 ts_tablet_manager.cc:1434] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 13:06:03.401096 21343 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:03.407437 21049 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.412168 21049 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:03.387616 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 119899us
I20260709 13:06:03.443805 21133 tablet_service.cc:1511] Processing CreateTablet for tablet 19d2a839d8cf43eea500e735e58a9e28 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.445081 21133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d2a839d8cf43eea500e735e58a9e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.452685 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:03.453331 21299 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.457636 21349 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.458117 21349 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.460139 21349 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:03.461181 21209 tablet_service.cc:1511] Processing CreateTablet for tablet 19d2a839d8cf43eea500e735e58a9e28 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.462462 21209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d2a839d8cf43eea500e735e58a9e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.464061 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:03.465327 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:03.465904 21151 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:03.467500 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 574f49e93265460891ff981be2cee774 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:06:03.467854 21263 leader_election.cc:343] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.469307 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574f49e93265460891ff981be2cee774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.466271 21341 ts_tablet_manager.cc:1434] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.238s	user 0.003s	sys 0.005s
I20260709 13:06:03.471719 21340 tablet_bootstrap.cc:654] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.500226 21281 tablet_service.cc:1511] Processing CreateTablet for tablet 02e32a83beeb475fa3edaac416334c5d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.501622 21282 tablet_service.cc:1511] Processing CreateTablet for tablet 33f9268b51e14a8d82c0377b1596e9ce (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.503119 21207 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7b1fec990b4785a3b45b520909244c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.508080 21207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7b1fec990b4785a3b45b520909244c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:03.520402 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:03.531437 21285 tablet_service.cc:1511] Processing CreateTablet for tablet 28a3e5fa488f4d4f813752adf6415abe (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.533367 21367 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.524353 21341 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:03.544685 21283 tablet_service.cc:1511] Processing CreateTablet for tablet 19d2a839d8cf43eea500e735e58a9e28 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.547202 21048 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.517364 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:03.552003 21349 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.552380 21349 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.552708 21349 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.569623 21281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e32a83beeb475fa3edaac416334c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.570327 21299 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:03.553578 21284 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7b1fec990b4785a3b45b520909244c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.572139 21284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7b1fec990b4785a3b45b520909244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.575845 21282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f9268b51e14a8d82c0377b1596e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.577142 21343 tablet_bootstrap.cc:654] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.555866 21135 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7b1fec990b4785a3b45b520909244c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.579164 21365 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.581950 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a3e5fa488f4d4f813752adf6415abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.596704 21283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d2a839d8cf43eea500e735e58a9e28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:03.591650 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 77021.6us
I20260709 13:06:03.595111 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7b1fec990b4785a3b45b520909244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.604065 21137 tablet_service.cc:1511] Processing CreateTablet for tablet d142716765ff4750912c13d99d61a1df (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.603202 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc65b57b7ce480581c0933f52538838 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.605119 21210 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc65b57b7ce480581c0933f52538838 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.608204 21210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc65b57b7ce480581c0933f52538838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.608137 21287 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc65b57b7ce480581c0933f52538838 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.609404 21287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc65b57b7ce480581c0933f52538838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.605192 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d142716765ff4750912c13d99d61a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.611410 21212 tablet_service.cc:1511] Processing CreateTablet for tablet d142716765ff4750912c13d99d61a1df (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.606024 21208 tablet_service.cc:1511] Processing CreateTablet for tablet 99d11247a80d4fb5b4034e0a238c9388 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:03.606024 21213 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb23cad4ade4afea24324bfae738314 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.606813 21136 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb23cad4ade4afea24324bfae738314 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.606817 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 99d11247a80d4fb5b4034e0a238c9388 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:03.612800 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d142716765ff4750912c13d99d61a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.613622 21213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb23cad4ade4afea24324bfae738314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.614500 21208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d11247a80d4fb5b4034e0a238c9388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.616694 21215 tablet_service.cc:1511] Processing CreateTablet for tablet e8a59065e5d64bc09a27e51c9955775d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.617769 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a59065e5d64bc09a27e51c9955775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.611413 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc65b57b7ce480581c0933f52538838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.618633 21132 tablet_service.cc:1511] Processing CreateTablet for tablet e8a59065e5d64bc09a27e51c9955775d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.619549 21136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb23cad4ade4afea24324bfae738314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.623522 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d11247a80d4fb5b4034e0a238c9388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.630959 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 99d11247a80d4fb5b4034e0a238c9388 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:03.634202 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d11247a80d4fb5b4034e0a238c9388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.622946 21349 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.630070 21286 tablet_service.cc:1511] Processing CreateTablet for tablet d142716765ff4750912c13d99d61a1df (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.642035 21377 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.646214 21132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a59065e5d64bc09a27e51c9955775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.653982 21139 tablet_service.cc:1511] Processing CreateTablet for tablet fe2e5a8d491c4a22ac81fce79a27a7ea (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:03.660463 21210 tablet_service.cc:1511] Processing CreateTablet for tablet fe2e5a8d491c4a22ac81fce79a27a7ea (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:03.663869 21138 tablet_service.cc:1511] Processing CreateTablet for tablet ac63da274d954b86ab071da6f6b5148c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.692821 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac63da274d954b86ab071da6f6b5148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.670295 21215 tablet_service.cc:1511] Processing CreateTablet for tablet ac63da274d954b86ab071da6f6b5148c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.635674 21371 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:06:03.684479 21286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d142716765ff4750912c13d99d61a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.724417 21340 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:03.725080 21340 ts_tablet_manager.cc:1403] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.438s	user 0.011s	sys 0.011s
I20260709 13:06:03.728590 21340 raft_consensus.cc:359] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.729410 21340 raft_consensus.cc:385] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.729775 21340 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.720641 21365 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:06:03.731724 21381 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.730497 21340 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.746861 21288 tablet_service.cc:1511] Processing CreateTablet for tablet e8a59065e5d64bc09a27e51c9955775d (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.751358 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2e5a8d491c4a22ac81fce79a27a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.756223 21048 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.750321 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a59065e5d64bc09a27e51c9955775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.767618 21341 tablet_bootstrap.cc:654] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.790093 21349 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:03.790654 21288 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb23cad4ade4afea24324bfae738314 (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.790668 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:03.791682 21150 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.792047 21288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb23cad4ade4afea24324bfae738314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.795303 21290 tablet_service.cc:1511] Processing CreateTablet for tablet fe2e5a8d491c4a22ac81fce79a27a7ea (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:03.796535 21290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2e5a8d491c4a22ac81fce79a27a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.798130 21289 tablet_service.cc:1511] Processing CreateTablet for tablet ac63da274d954b86ab071da6f6b5148c (DEFAULT_TABLE table=test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.798537 21150 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:03.779188 21210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2e5a8d491c4a22ac81fce79a27a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:03.774091 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 75591.5us
I20260709 13:06:03.800621 21289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac63da274d954b86ab071da6f6b5148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.811049 21343 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:03.811563 21343 ts_tablet_manager.cc:1403] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.411s	user 0.015s	sys 0.017s
I20260709 13:06:03.808238 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:03.816392 21215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac63da274d954b86ab071da6f6b5148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.817925 21349 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.819334 21381 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.819761 21381 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.821933 21381 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:03.823827 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:03.826416 21114 leader_election.cc:343] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.827347 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:03.829046 21116 leader_election.cc:343] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.829499 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:03.830632 21381 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.818598 21349 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:03.832088 21349 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.817163 21343 raft_consensus.cc:359] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.834069 21343 raft_consensus.cc:385] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.834436 21343 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.854053 21381 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.867341 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:03.845177 21343 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.869695 21224 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.875948 21340 ts_tablet_manager.cc:1434] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.150s	user 0.003s	sys 0.005s
I20260709 13:06:03.876953 21340 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:03.882582 21224 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:03.913513 21340 tablet_bootstrap.cc:654] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.920306 21343 ts_tablet_manager.cc:1434] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.003s
I20260709 13:06:03.921365 21343 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:03.923651 21341 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:03.932284 21341 ts_tablet_manager.cc:1403] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.428s	user 0.008s	sys 0.007s
I20260709 13:06:03.927495 21048 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.927604 21343 tablet_bootstrap.cc:654] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.950489 21341 raft_consensus.cc:359] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.951211 21341 raft_consensus.cc:385] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.951515 21341 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.952889 21341 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.955371 21341 ts_tablet_manager.cc:1434] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:03.955279 21377 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.956492 21341 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:03.963394 21343 tablet_bootstrap.cc:492] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:03.963927 21343 ts_tablet_manager.cc:1403] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.007s
I20260709 13:06:03.966658 21343 raft_consensus.cc:359] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.967365 21343 raft_consensus.cc:385] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.967658 21343 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.972458 21343 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.974758 21343 ts_tablet_manager.cc:1434] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 13:06:03.977072 21341 tablet_bootstrap.cc:654] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.977629 21340 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:03.978075 21340 ts_tablet_manager.cc:1403] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.043s
I20260709 13:06:03.980415 21343 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:03.982882 21341 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:03.980629 21340 raft_consensus.cc:359] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.983335 21341 ts_tablet_manager.cc:1403] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:06:03.983369 21340 raft_consensus.cc:385] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.983774 21340 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.984398 21340 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.985842 21340 ts_tablet_manager.cc:1434] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:03.986101 21341 raft_consensus.cc:359] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.986774 21340 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:03.986753 21341 raft_consensus.cc:385] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.987329 21341 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.987990 21341 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:03.988889 21343 tablet_bootstrap.cc:654] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.990424 21341 ts_tablet_manager.cc:1434] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:03.991451 21341 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:03.993768 21340 tablet_bootstrap.cc:654] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.997007 21341 tablet_bootstrap.cc:654] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.008339 21341 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.008790 21341 ts_tablet_manager.cc:1403] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:06:04.011415 21341 raft_consensus.cc:359] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.012053 21341 raft_consensus.cc:385] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.012400 21341 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.013540 21341 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.019703 21341 ts_tablet_manager.cc:1434] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:06:04.021703 21394 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.026885 21394 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.029726 21394 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.031344 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.031737 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.032234 21298 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.032605 21151 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.020593 21341 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.034068 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.038158 21394 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.038653 21394 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.039031 21394 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.042398 21341 tablet_bootstrap.cc:654] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.048657 21343 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:04.049269 21343 ts_tablet_manager.cc:1403] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.028s
I20260709 13:06:04.054567 21343 raft_consensus.cc:359] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.055045 21394 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.055562 21343 raft_consensus.cc:385] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.055871 21340 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.055945 21343 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.056423 21340 ts_tablet_manager.cc:1403] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.070s	user 0.043s	sys 0.019s
I20260709 13:06:04.057883 21394 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.058794 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.058826 21340 raft_consensus.cc:359] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.059492 21151 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.059823 21340 raft_consensus.cc:385] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.059773 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.060362 21340 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.060489 21298 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.060915 21341 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.061334 21341 ts_tablet_manager.cc:1403] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.007s
I20260709 13:06:04.061172 21340 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.063349 21340 ts_tablet_manager.cc:1434] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:04.064040 21341 raft_consensus.cc:359] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.064486 21340 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:04.064670 21341 raft_consensus.cc:385] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.064958 21341 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.065690 21341 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.067615 21341 ts_tablet_manager.cc:1434] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:04.068679 21341 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.070447 21340 tablet_bootstrap.cc:654] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.074548 21341 tablet_bootstrap.cc:654] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.076172 21298 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:04.057075 21343 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.077292 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.081085 21394 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.081562 21394 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:04.082326 21394 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.088258 21343 ts_tablet_manager.cc:1434] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:06:04.089211 21343 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:04.091485 21151 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:04.100837 21341 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.101464 21341 ts_tablet_manager.cc:1403] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.013s
I20260709 13:06:04.101649 21343 tablet_bootstrap.cc:654] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.105101 21341 raft_consensus.cc:359] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.106137 21341 raft_consensus.cc:385] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.106485 21341 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.107554 21341 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.111796 21048 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.114311 21349 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.114604 21341 ts_tablet_manager.cc:1434] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:06:04.114802 21349 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.115540 21341 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.116739 21349 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.118582 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.119207 21151 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:04.119580 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.120177 21226 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:04.120537 21263 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.122021 21349 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.122381 21349 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.122694 21349 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.123368 21341 tablet_bootstrap.cc:654] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.129558 21349 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.132272 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.132815 21151 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.136041 21349 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.137135 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.137732 21226 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.141259 21341 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.141701 21341 ts_tablet_manager.cc:1403] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:06:04.142244 21340 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.142537 21151 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:04.142724 21340 ts_tablet_manager.cc:1403] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.035s
I20260709 13:06:04.137367 21343 tablet_bootstrap.cc:492] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:04.143600 21343 ts_tablet_manager.cc:1403] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.006s
I20260709 13:06:04.143839 21263 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.144393 21341 raft_consensus.cc:359] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.145044 21341 raft_consensus.cc:385] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.145316 21341 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.145731 21340 raft_consensus.cc:359] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.146225 21349 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.146404 21340 raft_consensus.cc:385] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.146059 21341 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.146121 21343 raft_consensus.cc:359] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.146974 21340 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.147249 21349 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:04.148332 21340 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.148300 21349 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.147396 21343 raft_consensus.cc:385] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.149480 21343 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.146071 21226 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:04.150198 21340 ts_tablet_manager.cc:1434] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:04.150102 21343 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.148903 21341 ts_tablet_manager.cc:1434] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:04.151222 21340 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:04.151549 21341 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.157275 21340 tablet_bootstrap.cc:654] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.157794 21341 tablet_bootstrap.cc:654] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.158375 21343 ts_tablet_manager.cc:1434] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:06:04.159379 21343 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:04.170244 21343 tablet_bootstrap.cc:654] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.190979 21048 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.218925 21377 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.219647 21377 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.224634 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.226488 21377 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.226743 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:04.227731 21114 leader_election.cc:343] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.230212 21116 leader_election.cc:343] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.230886 21116 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.233011 21340 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.232829 21377 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.233482 21340 ts_tablet_manager.cc:1403] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.059s
I20260709 13:06:04.235600 21343 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:04.236011 21343 ts_tablet_manager.cc:1403] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.077s	user 0.031s	sys 0.026s
I20260709 13:06:04.236125 21341 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.236660 21341 ts_tablet_manager.cc:1403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.053s
I20260709 13:06:04.238579 21343 raft_consensus.cc:359] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.239338 21343 raft_consensus.cc:385] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.239087 21341 raft_consensus.cc:359] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.236086 21340 raft_consensus.cc:359] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.239688 21343 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.239805 21341 raft_consensus.cc:385] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.240064 21340 raft_consensus.cc:385] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.240161 21341 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.240442 21340 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.240450 21343 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.240898 21341 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.242614 21343 ts_tablet_manager.cc:1434] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:04.243003 21341 ts_tablet_manager.cc:1434] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:04.241307 21340 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.244143 21341 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.248009 21340 ts_tablet_manager.cc:1434] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:06:04.248992 21340 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:04.250185 21341 tablet_bootstrap.cc:654] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.255095 21340 tablet_bootstrap.cc:654] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.259049 21343 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:04.267055 21343 tablet_bootstrap.cc:654] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.268918 21349 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.269459 21349 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.271795 21349 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.273984 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.274884 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.275452 21341 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.275889 21341 ts_tablet_manager.cc:1403] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.017s
W20260709 13:06:04.276435 21263 leader_election.cc:343] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.277323 21263 leader_election.cc:343] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.277825 21263 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.278554 21340 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.279080 21340 ts_tablet_manager.cc:1403] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.001s
I20260709 13:06:04.278636 21341 raft_consensus.cc:359] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.279222 21349 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.279443 21341 raft_consensus.cc:385] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.280172 21341 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.280747 21341 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.282519 21341 ts_tablet_manager.cc:1434] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:04.282255 21340 raft_consensus.cc:359] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.282996 21343 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:04.283015 21340 raft_consensus.cc:385] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.283495 21343 ts_tablet_manager.cc:1403] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:06:04.283495 21340 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.283787 21341 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.284480 21340 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.286420 21343 raft_consensus.cc:359] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.287225 21343 raft_consensus.cc:385] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.287546 21343 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.288331 21343 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.290186 21341 tablet_bootstrap.cc:654] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.290530 21343 ts_tablet_manager.cc:1434] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:06:04.290530 21340 ts_tablet_manager.cc:1434] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:04.291651 21343 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:04.291651 21340 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:04.305258 21343 tablet_bootstrap.cc:654] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.306067 21340 tablet_bootstrap.cc:654] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.309866 21377 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.310400 21377 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.312721 21377 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.314330 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.315006 21226 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:04.316375 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.316859 21114 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.317018 21298 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:04.317759 21377 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.318147 21377 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.318508 21377 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.320667 21341 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.321147 21341 ts_tablet_manager.cc:1403] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.008s
I20260709 13:06:04.324455 21341 raft_consensus.cc:359] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.325126 21341 raft_consensus.cc:385] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.325420 21341 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.326267 21341 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.328370 21341 ts_tablet_manager.cc:1434] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:04.329713 21341 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.329998 21377 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.335889 21341 tablet_bootstrap.cc:654] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.348026 21341 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.348497 21341 ts_tablet_manager.cc:1403] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:06:04.350000 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.350598 21226 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.351145 21341 raft_consensus.cc:359] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.351624 21349 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.351891 21341 raft_consensus.cc:385] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.352269 21349 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.354434 21349 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.352253 21341 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.355978 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.356389 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.356738 21151 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:04.356976 21341 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:04.358014 21263 leader_election.cc:343] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.358712 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.359390 21341 ts_tablet_manager.cc:1434] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:04.359835 21349 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.360219 21349 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.360416 21341 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.360594 21349 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.366991 21341 tablet_bootstrap.cc:654] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.369408 21349 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.372064 21226 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:04.372526 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.373129 21151 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.375602 21114 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.376534 21341 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.376475 21346 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.377079 21341 ts_tablet_manager.cc:1403] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:06:04.377077 21346 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:04.378247 21346 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.380806 21341 raft_consensus.cc:359] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.381506 21341 raft_consensus.cc:385] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.381793 21341 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.382390 21389 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.382457 21341 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.382956 21389 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.385804 21389 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.388459 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.389915 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:04.391762 21263 leader_election.cc:343] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.393911 21341 ts_tablet_manager.cc:1434] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:06:04.394960 21341 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
W20260709 13:06:04.392516 21263 leader_election.cc:343] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.396386 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.397315 21431 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.402096 21341 tablet_bootstrap.cc:654] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.405710 21389 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.415815 21341 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.416450 21341 ts_tablet_manager.cc:1403] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 13:06:04.419335 21151 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:04.419471 21341 raft_consensus.cc:359] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.420186 21341 raft_consensus.cc:385] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.420493 21341 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.420692 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.421595 21389 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.421427 21341 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.422741 21389 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:04.424108 21389 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.428088 21394 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.428718 21394 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.429457 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.430294 21298 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.433847 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.434655 21300 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.435403 21377 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.436050 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:04.437878 21189 leader_election.cc:343] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.439239 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:04.440383 21367 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.440837 21367 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.441264 21367 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.442024 21298 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:04.447381 21394 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.450728 21340 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.451484 21340 ts_tablet_manager.cc:1403] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.160s	user 0.059s	sys 0.074s
I20260709 13:06:04.452282 21349 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.452903 21377 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.450726 21367 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.453390 21377 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.453866 21341 ts_tablet_manager.cc:1434] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.024s
I20260709 13:06:04.453977 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.454908 21341 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
W20260709 13:06:04.455823 21263 leader_election.cc:343] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.456370 21367 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.457767 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.458302 21300 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.462632 21341 tablet_bootstrap.cc:654] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.456298 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.463784 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:04.463901 21189 leader_election.cc:343] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.457257 21340 raft_consensus.cc:359] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.467392 21340 raft_consensus.cc:385] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.467679 21340 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.468295 21340 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.468568 21394 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:04.470973 21114 leader_election.cc:343] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.473516 21300 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:04.470466 21340 ts_tablet_manager.cc:1434] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 13:06:04.483471 21340 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:04.487397 21389 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.488616 21343 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:04.488087 21389 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.488727 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:04.489090 21343 ts_tablet_manager.cc:1403] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.198s	user 0.039s	sys 0.082s
I20260709 13:06:04.472247 21047 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.493209 21377 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.493726 21394 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.494711 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.495154 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.501515 21436 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:04.502750 21340 tablet_bootstrap.cc:654] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.506037 21394 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:04.506934 21394 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.508807 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:04.510205 21263 leader_election.cc:343] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.510924 21263 leader_election.cc:343] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.511325 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.512284 21436 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.499361 21389 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.520560 21343 raft_consensus.cc:359] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.522522 21343 raft_consensus.cc:385] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.522961 21343 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.524003 21343 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.528853 21346 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.529539 21346 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.513996 21298 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:04.543555 21343 ts_tablet_manager.cc:1434] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:06:04.545387 21439 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.546095 21439 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.566231 21343 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:04.553578 21389 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.559629 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.571120 21377 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.571497 21377 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.571856 21377 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.575742 21341 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:04.576246 21341 ts_tablet_manager.cc:1403] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.122s	user 0.042s	sys 0.043s
I20260709 13:06:04.578727 21346 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.590585 21432 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.592437 21377 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.590893 21341 raft_consensus.cc:359] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.596490 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.596793 21377 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.596992 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.597155 21298 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:04.597561 21300 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.597361 21432 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.598623 21116 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.602406 21439 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.603109 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.582769 21389 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.603569 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.603727 21151 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.604243 21298 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:04.605041 21389 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.605052 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.605590 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.606523 21346 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.606626 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.606966 21346 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.607285 21225 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:04.607430 21346 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.608278 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.608868 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.610208 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:04.610562 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:04.611155 21432 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.611557 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:04.612098 21389 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.612478 21436 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.612576 21389 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.612887 21436 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.613392 21436 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.612846 21047 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.595587 21341 raft_consensus.cc:385] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.614706 21341 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.615471 21341 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.618068 21343 tablet_bootstrap.cc:654] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.620405 21341 ts_tablet_manager.cc:1434] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:06:04.621731 21341 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:04.623342 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:04.624768 21263 leader_election.cc:343] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.626188 21394 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.626739 21394 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.627246 21394 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.627635 21439 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.628245 21439 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.637995 21394 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.656500 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.669651 21439 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.673956 21394 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:04.690359 21441 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:04.612761 21377 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.705861 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.695560 21300 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:04.713498 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:04.714397 21432 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.714880 21432 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:04.715688 21432 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.702301 21377 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.719405 21377 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.710709 21346 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:04.730355 21151 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:04.731411 21346 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.759229 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.760332 21226 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:04.763226 21049 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.766341 21377 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:04.792078 21114 leader_election.cc:343] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.820269 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.828785 21436 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:04.838358 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46339.3us
W20260709 13:06:04.831995 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 187691us
I20260709 13:06:04.842199 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.849586 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:04.844763 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:04.843595 21377 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:04.895890 21300 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:04.928287 21377 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.901353 21389 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:04.931208 21389 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.932642 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.932721 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:04.933507 21298 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:04.936563 21151 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:04.926956 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.956996 21341 tablet_bootstrap.cc:654] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.931887 21389 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:04.945950 21189 leader_election.cc:343] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.947166 21436 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:04.957918 21114 leader_election.cc:343] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.957759 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:04.973028 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:04.973093 21340 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:04.974056 21340 ts_tablet_manager.cc:1403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.491s	user 0.036s	sys 0.023s
I20260709 13:06:04.971081 21224 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:04.976485 21299 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.980487 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:04.982720 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:04.982857 21263 leader_election.cc:343] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.983506 21223 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:04.983388 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:04.990381 21436 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:04.990893 21114 leader_election.cc:343] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.989871 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:05.006729 21442 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.005985 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.021673 21453 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.015441 21432 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:05.023208 21389 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.031677 21349 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.031737 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.026299 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:05.034308 21367 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.034687 21367 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.035033 21367 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.035197 21343 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.035653 21343 ts_tablet_manager.cc:1403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.470s	user 0.027s	sys 0.029s
I20260709 13:06:05.037284 21442 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:05.039018 21263 consensus_peers.cc:597] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:05.039670 21263 leader_election.cc:343] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.042454 21299 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.043735 21116 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.037977 21340 raft_consensus.cc:359] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.044672 21340 raft_consensus.cc:385] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.044914 21340 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.043893 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.046017 21377 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.046283 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.046491 21377 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:05.047549 21349 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:05.052402 21389 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:05.052587 21263 leader_election.cc:343] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.042527 21048 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.053040 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.057643 21349 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.048046 21432 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.060330 21341 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.060813 21341 ts_tablet_manager.cc:1403] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.439s	user 0.018s	sys 0.016s
I20260709 13:06:05.061929 21367 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.051723 21340 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.047358 21377 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.066573 21343 raft_consensus.cc:359] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.067212 21343 raft_consensus.cc:385] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.067478 21343 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.068104 21343 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.070781 21343 ts_tablet_manager.cc:1434] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:05.071674 21343 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.072481 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:06:05.073971 21189 leader_election.cc:343] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.077335 21340 ts_tablet_manager.cc:1434] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.001s
I20260709 13:06:05.078507 21340 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.090622 21367 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.093850 21394 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:05.095923 21189 consensus_peers.cc:597] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.107095 21341 raft_consensus.cc:359] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.108008 21341 raft_consensus.cc:385] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.108296 21341 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.106681 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.110855 21341 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.112906 21296 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.114225 21341 ts_tablet_manager.cc:1434] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:06:05.115139 21341 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.119549 21346 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.121454 21346 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.126111 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.126700 21225 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.128134 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.128733 21298 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.128782 21114 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.126856 21346 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.132238 21343 tablet_bootstrap.cc:654] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.132848 21377 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.134579 21377 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.134941 21377 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.133368 21296 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:05.141566 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:05.143358 21367 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.143811 21367 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:05.146884 21367 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.148545 21049 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.156934 21340 tablet_bootstrap.cc:654] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:05.157711 21114 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.174420 21341 tablet_bootstrap.cc:654] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.186666 21377 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.189911 21049 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.191794 21343 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.192212 21343 ts_tablet_manager.cc:1403] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.001s
I20260709 13:06:05.194169 21377 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.195844 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.215034 21226 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.218583 21340 tablet_bootstrap.cc:492] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.219044 21340 ts_tablet_manager.cc:1403] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.027s
I20260709 13:06:05.196842 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.219892 21300 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.221544 21340 raft_consensus.cc:359] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.221920 21226 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.222234 21340 raft_consensus.cc:385] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.222524 21340 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.223042 21114 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.223136 21340 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.223910 21377 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.224345 21377 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:05.225129 21340 ts_tablet_manager.cc:1434] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.225137 21377 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.226681 21340 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.229388 21300 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.234246 21341 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.234886 21341 ts_tablet_manager.cc:1403] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.120s	user 0.009s	sys 0.009s
I20260709 13:06:05.201910 21343 raft_consensus.cc:359] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.235452 21343 raft_consensus.cc:385] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.235800 21343 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.236585 21343 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.237916 21341 raft_consensus.cc:359] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.238617 21341 raft_consensus.cc:385] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.238968 21341 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.239814 21341 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.241528 21343 ts_tablet_manager.cc:1434] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:06:05.241816 21341 ts_tablet_manager.cc:1434] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:05.242383 21343 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.243616 21340 tablet_bootstrap.cc:654] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.245322 21341 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.248588 21343 tablet_bootstrap.cc:654] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.253672 21341 tablet_bootstrap.cc:654] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.259873 21340 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.260349 21340 ts_tablet_manager.cc:1403] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 13:06:05.262130 21343 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.263016 21340 raft_consensus.cc:359] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.262778 21048 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.263756 21341 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.264132 21340 raft_consensus.cc:385] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.264232 21343 ts_tablet_manager.cc:1403] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:06:05.264530 21341 ts_tablet_manager.cc:1403] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:06:05.264441 21340 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.268142 21343 raft_consensus.cc:359] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.268729 21343 raft_consensus.cc:385] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.268982 21343 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.269261 21341 raft_consensus.cc:359] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.269843 21341 raft_consensus.cc:385] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.269660 21343 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.270139 21341 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.270804 21341 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.272382 21343 ts_tablet_manager.cc:1434] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:06:05.272739 21341 ts_tablet_manager.cc:1434] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:05.273597 21341 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.273908 21343 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.275718 21377 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.279611 21343 tablet_bootstrap.cc:654] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.279349 21340 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.281248 21340 ts_tablet_manager.cc:1434] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:06:05.282037 21340 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.287572 21340 tablet_bootstrap.cc:654] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.290126 21341 tablet_bootstrap.cc:654] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.291385 21349 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.291872 21349 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.299535 21349 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.301941 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.303107 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:05.305312 21263 leader_election.cc:343] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.306032 21263 leader_election.cc:343] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.306531 21263 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.308928 21349 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.316046 21341 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.316514 21341 ts_tablet_manager.cc:1403] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 13:06:05.317564 21343 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.317976 21343 ts_tablet_manager.cc:1403] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.016s
I20260709 13:06:05.318944 21340 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.319392 21340 ts_tablet_manager.cc:1403] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:06:05.319100 21341 raft_consensus.cc:359] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.319821 21341 raft_consensus.cc:385] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.320088 21341 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.320397 21343 raft_consensus.cc:359] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.320693 21341 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.321008 21343 raft_consensus.cc:385] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.321617 21343 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.322052 21340 raft_consensus.cc:359] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.322249 21343 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.322738 21340 raft_consensus.cc:385] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.323114 21340 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.323362 21341 ts_tablet_manager.cc:1434] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:05.324162 21343 ts_tablet_manager.cc:1434] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:06:05.324352 21341 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.325004 21343 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.323819 21340 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.329495 21340 ts_tablet_manager.cc:1434] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:05.330091 21341 tablet_bootstrap.cc:654] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.330482 21340 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.331091 21343 tablet_bootstrap.cc:654] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.336730 21340 tablet_bootstrap.cc:654] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.349785 21343 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.349785 21341 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.350294 21343 ts_tablet_manager.cc:1403] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 13:06:05.350358 21341 ts_tablet_manager.cc:1403] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:06:05.352931 21340 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.352710 21343 raft_consensus.cc:359] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.352977 21341 raft_consensus.cc:359] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.353354 21343 raft_consensus.cc:385] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.353427 21340 ts_tablet_manager.cc:1403] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:06:05.353726 21341 raft_consensus.cc:385] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.353763 21343 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.354218 21341 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.354663 21343 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.354877 21341 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.356218 21340 raft_consensus.cc:359] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.356634 21343 ts_tablet_manager.cc:1434] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:05.356838 21340 raft_consensus.cc:385] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.357124 21340 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.357761 21343 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.360165 21340 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.362375 21341 ts_tablet_manager.cc:1434] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:05.363298 21343 tablet_bootstrap.cc:654] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.363336 21341 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.365159 21340 ts_tablet_manager.cc:1434] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:06:05.366024 21340 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.371117 21341 tablet_bootstrap.cc:654] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.371377 21340 tablet_bootstrap.cc:654] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.391549 21343 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.392087 21341 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.392166 21343 ts_tablet_manager.cc:1403] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.013s
I20260709 13:06:05.392589 21341 ts_tablet_manager.cc:1403] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.007s
I20260709 13:06:05.395004 21343 raft_consensus.cc:359] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.395684 21343 raft_consensus.cc:385] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.395304 21341 raft_consensus.cc:359] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.395931 21343 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.396018 21340 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.396036 21341 raft_consensus.cc:385] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.396452 21341 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.396575 21340 ts_tablet_manager.cc:1403] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 13:06:05.396613 21343 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.397104 21341 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.398617 21343 ts_tablet_manager.cc:1434] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.399161 21340 raft_consensus.cc:359] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.399716 21343 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.399780 21340 raft_consensus.cc:385] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.400170 21340 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.400738 21340 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.402078 21341 ts_tablet_manager.cc:1434] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:05.402871 21341 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.406131 21343 tablet_bootstrap.cc:654] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.406725 21367 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.407217 21367 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.410306 21340 ts_tablet_manager.cc:1434] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:06:05.414896 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.415606 21300 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:05.415781 21340 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.416877 21191 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.417977 21442 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.418440 21442 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.418850 21442 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.421223 21340 tablet_bootstrap.cc:654] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.412416 21341 tablet_bootstrap.cc:654] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.410858 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:05.428740 21189 leader_election.cc:343] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.429795 21367 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.440701 21442 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.455297 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:05.456504 21349 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.456984 21349 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.456984 21189 leader_election.cc:343] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.459187 21349 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.461380 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.461472 21340 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.461390 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.462029 21340 ts_tablet_manager.cc:1403] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.036s
W20260709 13:06:05.462647 21263 leader_election.cc:343] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.463688 21263 leader_election.cc:343] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.464061 21263 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.464637 21340 raft_consensus.cc:359] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.465003 21349 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.465291 21340 raft_consensus.cc:385] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.465281 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.465745 21340 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.465976 21300 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.466276 21340 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.466723 21442 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.468442 21340 ts_tablet_manager.cc:1434] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:05.469610 21340 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.483525 21340 tablet_bootstrap.cc:654] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.484428 21341 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.484594 21343 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.484992 21341 ts_tablet_manager.cc:1403] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.025s
I20260709 13:06:05.485327 21343 ts_tablet_manager.cc:1403] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.086s	user 0.038s	sys 0.019s
I20260709 13:06:05.487723 21341 raft_consensus.cc:359] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.488420 21341 raft_consensus.cc:385] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.488739 21341 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.488782 21343 raft_consensus.cc:359] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.489728 21343 raft_consensus.cc:385] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.489497 21341 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.490090 21343 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.491089 21343 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.491945 21341 ts_tablet_manager.cc:1434] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:05.493481 21343 ts_tablet_manager.cc:1434] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:05.493522 21341 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.494377 21343 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.494663 21340 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.495590 21340 ts_tablet_manager.cc:1403] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:06:05.498078 21340 raft_consensus.cc:359] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.498971 21340 raft_consensus.cc:385] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.499249 21340 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.499845 21343 tablet_bootstrap.cc:654] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.500000 21340 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.501719 21300 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:05.502218 21340 ts_tablet_manager.cc:1434] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:05.506544 21340 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.508587 21341 tablet_bootstrap.cc:654] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.508774 21191 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:05.512017 21340 tablet_bootstrap.cc:654] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.516270 21394 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.516924 21394 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:05.517710 21394 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.522581 21452 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.523070 21452 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.526974 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:05.528373 21263 leader_election.cc:343] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.533106 21381 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.533704 21381 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.537587 21432 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.538189 21432 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.540571 21432 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.551035 21452 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.551944 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.552974 21295 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:05.553004 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.554193 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.555301 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:05.555439 21263 leader_election.cc:343] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.555958 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.556985 21452 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.558175 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.559275 21432 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.562798 21394 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.563345 21341 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.563804 21341 ts_tablet_manager.cc:1403] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260709 13:06:05.563891 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.566318 21341 raft_consensus.cc:359] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.566954 21341 raft_consensus.cc:385] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.567032 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.567797 21295 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:05.568936 21116 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.569679 21346 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.569984 21341 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.570780 21341 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.575438 21381 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.576246 21340 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.576676 21340 ts_tablet_manager.cc:1403] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.014s
I20260709 13:06:05.579643 21341 ts_tablet_manager.cc:1434] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:05.580535 21341 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.581929 21346 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.586409 21341 tablet_bootstrap.cc:654] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.586539 21340 raft_consensus.cc:359] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.587437 21340 raft_consensus.cc:385] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.587764 21340 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.588580 21340 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.594244 21340 ts_tablet_manager.cc:1434] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:06:05.599429 21442 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.599892 21442 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.601857 21442 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.603287 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.603804 21226 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.603904 21149 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:05.605664 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.606283 21296 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:05.607481 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.608273 21367 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.608609 21367 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.608928 21367 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.614260 21151 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.620230 21394 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.620702 21394 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.622615 21394 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.623730 21346 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.624361 21346 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.627671 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.628656 21442 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.629174 21442 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.629921 21114 leader_election.cc:343] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.631599 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.635108 21225 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.635376 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.636427 21295 raft_consensus.cc:2393] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:05.637655 21442 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.636533 21367 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.639035 21340 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.643083 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.643776 21295 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.644464 21377 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.647353 21367 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.655014 21295 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:05.656869 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.657918 21394 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.658448 21394 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:05.659657 21394 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.660415 21341 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.660843 21341 ts_tablet_manager.cc:1403] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.080s	user 0.042s	sys 0.035s
I20260709 13:06:05.663504 21341 raft_consensus.cc:359] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.664150 21341 raft_consensus.cc:385] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.664397 21341 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.665011 21341 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.668417 21341 ts_tablet_manager.cc:1434] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:05.668648 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.669261 21341 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.669217 21295 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.670434 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.671520 21381 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.671852 21381 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.597100 21432 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.675010 21377 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.675477 21377 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.676296 21343 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.677444 21377 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.662884 21340 tablet_bootstrap.cc:654] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.676905 21343 ts_tablet_manager.cc:1403] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.010s
I20260709 13:06:05.673110 21381 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.674252 21346 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.680564 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.681254 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.682581 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:05.683246 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.684214 21226 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.691731 21381 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.690306 21341 tablet_bootstrap.cc:654] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:05.694326 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:05.686177 21346 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.699767 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.700341 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.701411 21343 raft_consensus.cc:359] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.704581 21343 raft_consensus.cc:385] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.704883 21343 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.705601 21343 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.709895 21343 ts_tablet_manager.cc:1434] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:06:05.710836 21343 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.704375 21346 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.709718 21452 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.712024 21381 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.713092 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:05.713755 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.714999 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.716064 21377 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.721853 21341 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.722488 21341 ts_tablet_manager.cc:1403] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.053s	user 0.002s	sys 0.013s
I20260709 13:06:05.723217 21295 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.721509 21452 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.723507 21149 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.728902 21452 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.729597 21341 raft_consensus.cc:359] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.718874 21346 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.730957 21341 raft_consensus.cc:385] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.751857 21341 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.752693 21341 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.754263 21341 ts_tablet_manager.cc:1434] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.013s
I20260709 13:06:05.735231 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.755333 21341 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.743942 21049 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.740353 21452 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.731606 21225 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.761111 21452 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.735111 21114 leader_election.cc:343] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.772070 21263 leader_election.cc:343] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.726806 21492 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:06:05.774267 21432 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.780922 21432 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.782781 21432 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.783893 21349 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.784539 21149 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:05.746193 21189 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:05.785053 21349 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.787468 21394 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:05.792119 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 65342us
I20260709 13:06:05.794952 21189 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:05.795197 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.793771 21295 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.796316 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.797003 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.797287 21343 tablet_bootstrap.cc:654] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.803808 21346 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.787206 21349 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.798800 21452 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.798578 21296 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.801879 21149 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:05.802021 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.802543 21453 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.806835 21340 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.807585 21340 ts_tablet_manager.cc:1403] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.213s	user 0.046s	sys 0.022s
I20260709 13:06:05.808341 21432 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.811816 21432 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:05.808197 21453 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.813692 21453 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.813505 21340 raft_consensus.cc:359] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.814545 21340 raft_consensus.cc:385] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.814890 21340 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.812660 21432 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.817130 21346 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.819805 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:05.821041 21394 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.823630 21340 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.827150 21377 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.827665 21377 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.821696 21394 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.829867 21377 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.830013 21394 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.835840 21340 ts_tablet_manager.cc:1434] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:06:05.822885 21346 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.836916 21340 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:05.838721 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.839299 21296 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.839157 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.840183 21295 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:05.841655 21191 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.842665 21394 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.842854 21341 tablet_bootstrap.cc:654] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.845464 21453 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.846287 21453 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.826509 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.836910 21346 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.843271 21394 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.851202 21346 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.854691 21343 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:05.855270 21343 ts_tablet_manager.cc:1403] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.145s	user 0.020s	sys 0.005s
W20260709 13:06:05.852648 21263 leader_election.cc:343] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.858223 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:05.858887 21452 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.859185 21452 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.858991 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:05.859579 21452 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.859779 21295 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:05.859946 21453 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:05.853493 21394 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.865029 21377 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:05.869747 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.870374 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.871017 21343 raft_consensus.cc:359] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.871685 21343 raft_consensus.cc:385] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.871944 21343 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.872624 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.873503 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.874086 21151 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:05.874284 21343 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.875617 21340 tablet_bootstrap.cc:654] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.862353 21492 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.874735 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.880092 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.882287 21343 ts_tablet_manager.cc:1434] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:06:05.882858 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.883471 21296 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.885931 21224 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:05.877094 21116 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:05.888195 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:05.889294 21114 leader_election.cc:343] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.884580 21226 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.895784 21343 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:05.892863 21432 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.906579 21432 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.907006 21432 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.908479 21394 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.897396 21263 leader_election.cc:343] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.911630 21263 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.912453 21453 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:05.913004 21263 leader_election.cc:343] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.915623 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:05.916832 21346 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.918740 21346 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:05.920186 21114 leader_election.cc:343] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.919364 21432 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.921571 21452 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.922583 21263 leader_election.cc:343] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.923271 21432 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:05.923157 21263 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.924170 21453 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.924248 21452 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:05.925805 21263 leader_election.cc:343] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.927937 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.928437 21222 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.931037 21432 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.933753 21341 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:05.934198 21341 ts_tablet_manager.cc:1403] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.032s
I20260709 13:06:05.934360 21226 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:05.936743 21341 raft_consensus.cc:359] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.935093 21047 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.937439 21343 tablet_bootstrap.cc:654] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.937429 21341 raft_consensus.cc:385] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.937855 21341 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.938556 21341 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.939026 21114 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:05.939947 21432 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.940388 21432 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:05.940755 21341 ts_tablet_manager.cc:1434] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:05.941632 21341 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:05.941155 21432 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:05.947431 21263 leader_election.cc:343] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.947468 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:05.948115 21341 tablet_bootstrap.cc:654] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.948417 21151 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:05.948132 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:05.947464 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.952214 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:05.953332 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.954315 21295 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:05.949240 21452 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.957999 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:05.958992 21149 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.960731 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:05.961475 21295 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.964135 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:05.958076 21340 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:05.968189 21340 ts_tablet_manager.cc:1403] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.131s	user 0.006s	sys 0.014s
I20260709 13:06:05.969982 21492 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.987763 21442 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.988445 21340 raft_consensus.cc:359] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.989272 21340 raft_consensus.cc:385] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.989567 21340 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.012665 21340 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:05.986866 21222 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:06.024490 21340 ts_tablet_manager.cc:1434] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.004s
I20260709 13:06:06.025796 21340 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.034674 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.036099 21394 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:06.036849 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 57151.5us
I20260709 13:06:06.038151 21349 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.038081 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.038743 21299 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.038682 21349 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:06.043924 21349 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.023186 21149 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:06.061203 21189 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.062044 21514 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.062513 21514 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:06.062942 21340 tablet_bootstrap.cc:654] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:06.048825 21263 leader_election.cc:343] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.053349 21299 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
W20260709 13:06:06.057915 21114 leader_election.cc:343] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.058844 21295 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:06.069433 21114 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.070246 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.063400 21514 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.078194 21432 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.078567 21453 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.081238 21047 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.085897 21116 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.103070 21381 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.103564 21453 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.103593 21381 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:06.109983 21381 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.110509 21049 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.111642 21343 tablet_bootstrap.cc:492] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.112041 21343 ts_tablet_manager.cc:1403] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.217s	user 0.031s	sys 0.045s
I20260709 13:06:06.115571 21343 raft_consensus.cc:359] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.116192 21343 raft_consensus.cc:385] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.116457 21343 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.117198 21343 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.109493 21453 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.120568 21453 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.123570 21343 ts_tablet_manager.cc:1434] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:06.124742 21343 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.127794 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.152604 21341 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.153218 21341 ts_tablet_manager.cc:1403] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.055s
W20260709 13:06:06.157943 21263 leader_election.cc:343] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.170562 21341 raft_consensus.cc:359] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.172124 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.174881 21341 raft_consensus.cc:385] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.175604 21340 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.175982 21341 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.176395 21340 ts_tablet_manager.cc:1403] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.151s	user 0.025s	sys 0.003s
I20260709 13:06:06.176718 21341 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.180352 21341 ts_tablet_manager.cc:1434] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:06:06.181190 21341 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.181474 21340 raft_consensus.cc:359] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.182053 21340 raft_consensus.cc:385] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.182292 21340 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.182865 21340 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:06.187387 21263 leader_election.cc:343] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.188021 21047 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.187847 21263 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.191802 21340 ts_tablet_manager.cc:1434] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:06.192078 21349 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.192658 21340 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.194453 21394 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.207672 21341 tablet_bootstrap.cc:654] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.210026 21343 tablet_bootstrap.cc:654] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.203572 21046 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.218607 21381 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.219364 21381 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.222925 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:06.233017 21114 leader_election.cc:343] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.233850 21394 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.244207 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:06.245018 21299 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:06.246671 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.248179 21346 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.248659 21346 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.249111 21346 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.250608 21341 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.251012 21341 ts_tablet_manager.cc:1403] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.002s
I20260709 13:06:06.252171 21381 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.254069 21341 raft_consensus.cc:359] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.254695 21341 raft_consensus.cc:385] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.254904 21340 tablet_bootstrap.cc:654] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.254998 21341 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.255774 21341 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.258193 21341 ts_tablet_manager.cc:1434] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:06.258096 21346 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.259642 21341 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.260850 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:06.262099 21114 leader_election.cc:343] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.263990 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.264495 21296 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.267691 21343 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.268275 21343 ts_tablet_manager.cc:1403] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.144s	user 0.035s	sys 0.021s
I20260709 13:06:06.270810 21343 raft_consensus.cc:359] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.271499 21343 raft_consensus.cc:385] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.271764 21343 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.274919 21343 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.276999 21343 ts_tablet_manager.cc:1434] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:06.271183 21296 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:06.279899 21341 tablet_bootstrap.cc:654] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.280032 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.280992 21381 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.281347 21343 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.281414 21381 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:06.282256 21381 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.287288 21343 tablet_bootstrap.cc:654] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.291335 21349 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.291828 21349 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.293824 21349 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.295909 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.298828 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:06.300454 21263 leader_election.cc:343] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:06.301764 21263 leader_election.cc:343] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.302273 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.303591 21349 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.305006 21343 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.305454 21343 ts_tablet_manager.cc:1403] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:06:06.305774 21502 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.309017 21343 raft_consensus.cc:359] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.309691 21343 raft_consensus.cc:385] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.309963 21343 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.310701 21343 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.312448 21341 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.313093 21341 ts_tablet_manager.cc:1403] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.011s
I20260709 13:06:06.318040 21349 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.321148 21343 ts_tablet_manager.cc:1434] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:06.321314 21349 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.316314 21341 raft_consensus.cc:359] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.322153 21341 raft_consensus.cc:385] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.322630 21341 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.323997 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.323764 21341 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:06.325300 21263 leader_election.cc:343] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.327081 21341 ts_tablet_manager.cc:1434] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:06.328354 21341 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.330066 21343 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.330403 21349 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.331914 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:06.333262 21263 leader_election.cc:343] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.333714 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.336282 21343 tablet_bootstrap.cc:654] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.336414 21349 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.336550 21341 tablet_bootstrap.cc:654] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.339731 21346 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.348887 21341 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.349390 21341 ts_tablet_manager.cc:1403] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:06:06.352819 21341 raft_consensus.cc:359] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.354566 21341 raft_consensus.cc:385] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.355063 21341 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.356011 21341 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.353909 21349 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.357434 21349 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.359999 21515 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.360483 21515 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.360862 21349 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.362574 21049 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.364243 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.362437 21515 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.365808 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.366227 21341 ts_tablet_manager.cc:1434] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:06.367467 21341 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.369652 21343 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.370069 21343 ts_tablet_manager.cc:1403] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:06:06.372539 21515 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.372961 21515 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.374910 21515 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.375227 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:06.375861 21341 tablet_bootstrap.cc:654] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:06.376503 21263 leader_election.cc:343] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.377352 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:06.377550 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.378602 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:06.378691 21263 leader_election.cc:343] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.380425 21263 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.381162 21349 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.381393 21515 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.382249 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:06.382937 21299 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:06.383850 21343 raft_consensus.cc:359] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.384495 21343 raft_consensus.cc:385] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.384262 21191 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:06.384783 21343 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.385655 21343 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.386039 21515 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.390631 21343 ts_tablet_manager.cc:1434] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:06:06.391554 21343 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.397908 21343 tablet_bootstrap.cc:654] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.399315 21349 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.399834 21349 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.399499 21515 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.402173 21349 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.403218 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:06.404452 21263 leader_election.cc:343] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.406679 21341 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.407356 21341 ts_tablet_manager.cc:1403] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.001s
I20260709 13:06:06.406716 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:06.411520 21263 leader_election.cc:343] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.411892 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.412591 21349 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.405818 21222 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.420169 21343 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.420639 21343 ts_tablet_manager.cc:1403] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:06:06.423571 21343 raft_consensus.cc:359] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.424180 21343 raft_consensus.cc:385] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.424466 21343 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.425099 21343 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.425616 21341 raft_consensus.cc:359] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.426229 21341 raft_consensus.cc:385] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.426278 21381 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.426509 21341 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.427074 21343 ts_tablet_manager.cc:1434] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:06.427464 21341 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.427963 21343 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.429450 21341 ts_tablet_manager.cc:1434] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.003s
I20260709 13:06:06.430296 21341 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.434239 21453 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.434751 21340 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.435185 21340 ts_tablet_manager.cc:1403] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.243s	user 0.060s	sys 0.088s
I20260709 13:06:06.435882 21341 tablet_bootstrap.cc:654] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.437800 21340 raft_consensus.cc:359] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.438514 21340 raft_consensus.cc:385] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.438783 21340 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.439586 21340 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.443979 21340 ts_tablet_manager.cc:1434] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:06.444902 21340 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.446750 21381 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.452241 21346 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.452719 21346 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.456022 21346 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.455935 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:06.456997 21296 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:06.458254 21116 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:06.459043 21346 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.459412 21346 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.459754 21346 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.459983 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.460624 21226 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:06.467149 21346 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.470453 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:06.471160 21226 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.477669 21226 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:06.475057 21515 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:06.478773 21114 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.479558 21453 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.481746 21381 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.482458 21381 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:06.482685 21340 tablet_bootstrap.cc:654] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.485611 21381 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.486838 21432 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.497829 21492 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.502429 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.502988 21299 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.511216 21346 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.529711 21453 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.537145 21453 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.527047 21299 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:06.564967 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.565148 21453 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:06.572228 21263 leader_election.cc:343] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.581386 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.608898 21343 tablet_bootstrap.cc:654] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.612578 21341 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
W20260709 13:06:06.612787 21263 leader_election.cc:343] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.613061 21341 ts_tablet_manager.cc:1403] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.183s	user 0.048s	sys 0.062s
I20260709 13:06:06.613337 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.614925 21453 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.615705 21341 raft_consensus.cc:359] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.617022 21341 raft_consensus.cc:385] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.617309 21341 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.619318 21340 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.618916 21341 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.619900 21340 ts_tablet_manager.cc:1403] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.175s	user 0.005s	sys 0.013s
I20260709 13:06:06.624130 21341 ts_tablet_manager.cc:1434] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:06.625741 21341 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.627300 21047 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.635140 21340 raft_consensus.cc:359] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.635772 21340 raft_consensus.cc:385] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.636035 21340 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.636631 21340 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.636884 21502 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.638633 21340 ts_tablet_manager.cc:1434] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:06.639520 21340 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.646589 21341 tablet_bootstrap.cc:654] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.648101 21343 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.648569 21343 ts_tablet_manager.cc:1403] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.221s	user 0.006s	sys 0.023s
I20260709 13:06:06.652431 21340 tablet_bootstrap.cc:654] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.652146 21343 raft_consensus.cc:359] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.652887 21343 raft_consensus.cc:385] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.653069 21343 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.654042 21343 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.656404 21343 ts_tablet_manager.cc:1434] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:06.657411 21343 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.657959 21341 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.658377 21341 ts_tablet_manager.cc:1403] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 13:06:06.663800 21341 raft_consensus.cc:359] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.664465 21341 raft_consensus.cc:385] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.664737 21341 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.665509 21341 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.667867 21341 ts_tablet_manager.cc:1434] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:06.669574 21341 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.673328 21453 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.673794 21453 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.674960 21341 tablet_bootstrap.cc:654] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.675787 21453 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.677006 21545 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.677453 21545 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.677968 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.678586 21226 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:06.679612 21545 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.680156 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.681770 21544 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.682126 21544 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.682442 21544 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.683585 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:06.684168 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.684401 21296 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:06.684818 21149 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:06.685920 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:06.687636 21377 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.688117 21377 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.688539 21377 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.688954 21544 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.691711 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:06.692013 21226 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.692281 21149 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.698750 21149 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:06.699839 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:06.701972 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:06.702548 21225 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.702911 21453 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.703524 21453 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:06.704185 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.704324 21453 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.705622 21367 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.706077 21367 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.707648 21377 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.708107 21367 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.709218 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.710714 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.711282 21296 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:06.711618 21114 leader_election.cc:343] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.713963 21225 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:06.716360 21544 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.717188 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:06.717517 21189 leader_election.cc:343] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.717806 21299 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:06.719214 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:06.721413 21442 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.721758 21442 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.722061 21442 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.722421 21377 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.724256 21340 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.724668 21340 ts_tablet_manager.cc:1403] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.024s
I20260709 13:06:06.737282 21442 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.736279 21514 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.739629 21343 tablet_bootstrap.cc:654] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.739687 21514 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.741660 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.742050 21514 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.742321 21295 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.747073 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.748790 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:06.740965 21442 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.745698 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:06.736366 21377 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:06:06.764428 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:06.765139 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:06.765748 21114 leader_election.cc:343] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.740916 21296 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:06.780550 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:06.778684 21189 leader_election.cc:343] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.786670 21377 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.787386 21377 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:06.781507 21191 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:06.788249 21377 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.791821 21047 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.795588 21295 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:06.804471 21340 raft_consensus.cc:359] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.805294 21340 raft_consensus.cc:385] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.805330 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:06.806016 21340 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.806710 21340 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.811208 21340 ts_tablet_manager.cc:1434] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:06:06.812618 21340 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.813212 21341 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.813645 21341 ts_tablet_manager.cc:1403] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.009s
I20260709 13:06:06.811453 21514 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.815014 21514 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:06.817521 21341 raft_consensus.cc:359] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.818209 21341 raft_consensus.cc:385] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.818154 21502 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.818583 21341 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.819236 21341 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.817204 21514 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.822955 21343 tablet_bootstrap.cc:492] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.823432 21343 ts_tablet_manager.cc:1403] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.166s	user 0.019s	sys 0.032s
I20260709 13:06:06.825634 21341 ts_tablet_manager.cc:1434] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:06:06.826555 21341 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.827886 21340 tablet_bootstrap.cc:654] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.829159 21442 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.833544 21343 raft_consensus.cc:359] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.834223 21343 raft_consensus.cc:385] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.834470 21343 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.833952 21047 catalog_manager.cc:5697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.835330 21442 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.835955 21442 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.839623 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.840943 21149 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:06.842165 21189 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.847134 21514 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.847545 21514 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.847875 21514 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.846680 21453 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.849009 21453 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.850950 21453 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.854064 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.856837 21343 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.859532 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:06.859699 21263 leader_election.cc:343] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.860159 21299 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:06.860461 21442 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.861654 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:06.863077 21263 leader_election.cc:343] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.863526 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.864120 21343 ts_tablet_manager.cc:1434] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:06:06.864253 21453 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.865242 21343 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:06.870757 21453 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.871315 21453 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.873965 21453 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.877831 21341 tablet_bootstrap.cc:654] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.876875 21047 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.879040 21340 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.879528 21340 ts_tablet_manager.cc:1403] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.009s
I20260709 13:06:06.881081 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.881656 21514 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:06.882779 21263 leader_election.cc:343] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.883360 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.884160 21453 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.884656 21453 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.888517 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:06.889106 21149 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.893462 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:06.892436 21263 leader_election.cc:343] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.895246 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.895989 21544 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:06.897089 21263 leader_election.cc:343] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.900491 21514 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:06.904045 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:06.908676 21295 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.912559 21432 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.915845 21343 tablet_bootstrap.cc:654] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.907359 21453 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:06.917023 21377 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.920838 21453 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.921274 21453 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.924322 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.926575 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:06.929242 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:06.927423 21453 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:06.929256 21263 leader_election.cc:343] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:06.932559 21263 leader_election.cc:343] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.932770 21295 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:06.932986 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:06.935124 21263 leader_election.cc:343] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.935549 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:06.935739 21149 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:06.936304 21544 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.934865 21340 raft_consensus.cc:359] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.936944 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:06.937055 21340 raft_consensus.cc:385] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.937613 21340 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.936939 21544 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.937822 21514 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.938385 21514 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:06.939092 21340 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.939337 21514 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.944918 21545 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.945477 21340 ts_tablet_manager.cc:1434] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:06:06.946363 21340 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:06.952050 21340 tablet_bootstrap.cc:654] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.977210 21341 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:06.977500 21046 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.980123 21341 ts_tablet_manager.cc:1403] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.011s
I20260709 13:06:06.981366 21340 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:06.981791 21340 ts_tablet_manager.cc:1403] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:06:06.985318 21341 raft_consensus.cc:359] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.986140 21341 raft_consensus.cc:385] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.988238 21340 raft_consensus.cc:359] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.988881 21340 raft_consensus.cc:385] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.989193 21340 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.986423 21341 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.990284 21341 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.992367 21341 ts_tablet_manager.cc:1434] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:06.992712 21343 tablet_bootstrap.cc:492] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:06.993683 21341 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:06.993384 21340 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:06.997807 21343 ts_tablet_manager.cc:1403] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.004s
I20260709 13:06:07.003579 21341 tablet_bootstrap.cc:654] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.004943 21343 raft_consensus.cc:359] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.005600 21343 raft_consensus.cc:385] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.005856 21343 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.006628 21343 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.007505 21340 ts_tablet_manager.cc:1434] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:06:07.008388 21340 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.008745 21343 ts_tablet_manager.cc:1434] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:07.010074 21343 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.012241 21341 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:07.012701 21341 ts_tablet_manager.cc:1403] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:06:07.013690 21340 tablet_bootstrap.cc:654] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.015530 21442 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.015996 21442 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.017954 21442 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.019429 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.020130 21295 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:07.020547 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.021157 21149 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:07.021476 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:07.022680 21442 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.023030 21442 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.023388 21442 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.027009 21341 raft_consensus.cc:359] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.028020 21341 raft_consensus.cc:385] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.028415 21341 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.029120 21343 tablet_bootstrap.cc:654] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.033357 21442 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.040010 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:07.040681 21150 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.049697 21150 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:07.050953 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:07.051883 21514 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.052556 21514 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:07.052696 21442 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.053550 21514 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.054508 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.055217 21295 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.056264 21341 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.058691 21341 ts_tablet_manager.cc:1434] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:06:07.059134 21340 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.059631 21340 ts_tablet_manager.cc:1403] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.020s
I20260709 13:06:07.062077 21340 raft_consensus.cc:359] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.062985 21340 raft_consensus.cc:385] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.063306 21340 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.064154 21341 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:07.069414 21340 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.071632 21340 ts_tablet_manager.cc:1434] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:07.066298 21343 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.072645 21343 ts_tablet_manager.cc:1403] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.017s
I20260709 13:06:07.074313 21295 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:07.075379 21341 tablet_bootstrap.cc:654] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.076265 21340 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.078794 21343 raft_consensus.cc:359] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.082096 21343 raft_consensus.cc:385] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.082526 21343 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.083469 21343 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.086759 21343 ts_tablet_manager.cc:1434] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:07.087566 21340 tablet_bootstrap.cc:654] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.088307 21343 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.095909 21343 tablet_bootstrap.cc:654] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.101771 21047 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.105258 21150 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:07.089596 21341 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:07.107439 21341 ts_tablet_manager.cc:1403] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.006s
I20260709 13:06:07.109666 21453 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.127558 21514 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.128135 21514 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.130398 21514 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.137032 21340 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.137763 21340 ts_tablet_manager.cc:1403] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.025s
I20260709 13:06:07.141330 21340 raft_consensus.cc:359] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.142308 21340 raft_consensus.cc:385] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.142717 21340 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.143618 21340 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.144398 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.145795 21340 ts_tablet_manager.cc:1434] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:07.146998 21340 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.149415 21224 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:07.150516 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.151382 21295 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:07.152805 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:07.153658 21432 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.154186 21432 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.155315 21340 tablet_bootstrap.cc:654] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.155437 21514 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.156960 21432 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.159478 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.163966 21452 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.164875 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.165575 21295 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
W20260709 13:06:07.165959 21114 leader_election.cc:343] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.166774 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.167816 21340 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.167968 21545 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.168418 21545 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.168532 21340 ts_tablet_manager.cc:1403] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:06:07.168815 21545 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.171736 21340 raft_consensus.cc:359] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.173152 21340 raft_consensus.cc:385] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.173507 21340 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.174304 21340 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.175874 21340 ts_tablet_manager.cc:1434] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:07.176815 21340 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.177322 21341 raft_consensus.cc:359] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.178067 21341 raft_consensus.cc:385] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.178360 21341 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.179116 21341 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.183861 21340 tablet_bootstrap.cc:654] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.191340 21341 ts_tablet_manager.cc:1434] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:06:07.193403 21341 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:07.195953 21340 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.196628 21340 ts_tablet_manager.cc:1403] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:06:07.199203 21432 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.199999 21340 raft_consensus.cc:359] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.200930 21340 raft_consensus.cc:385] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.201296 21340 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.202373 21340 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.205169 21340 ts_tablet_manager.cc:1434] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:07.206485 21340 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.214195 21340 tablet_bootstrap.cc:654] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.214680 21545 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.217533 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:07.218911 21114 leader_election.cc:343] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.221174 21514 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.227272 21453 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.227532 21340 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.228194 21340 ts_tablet_manager.cc:1403] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:06:07.231765 21340 raft_consensus.cc:359] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.227831 21453 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.233934 21545 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.234508 21453 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:07.235277 21340 raft_consensus.cc:385] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.235752 21340 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.236599 21340 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.237215 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:07.239365 21263 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.239518 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.240711 21377 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.240970 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.241158 21377 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.241525 21296 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.242587 21263 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.243784 21263 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.244532 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.244763 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.245105 21453 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.243083 21377 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.247792 21340 ts_tablet_manager.cc:1434] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:07.248272 21295 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.248788 21340 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.254752 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:07.255566 21502 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:07.255673 21114 leader_election.cc:343] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.255975 21502 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.256313 21502 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.256556 21432 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.256853 21340 tablet_bootstrap.cc:654] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.266227 21432 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.266736 21432 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.267328 21502 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.268852 21340 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.269210 21502 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.269404 21340 ts_tablet_manager.cc:1403] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:06:07.270205 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.268803 21432 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.270812 21295 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.271670 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.272833 21340 raft_consensus.cc:359] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.273666 21340 raft_consensus.cc:385] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.273722 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:07.274065 21340 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
W20260709 13:06:07.274439 21114 leader_election.cc:343] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.272372 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.272454 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.274883 21340 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.275663 21299 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.276003 21346 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.276345 21346 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.276683 21346 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.279695 21114 leader_election.cc:343] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.281700 21340 ts_tablet_manager.cc:1434] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:07.282617 21340 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.274148 21296 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.283339 21346 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.284006 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.285481 21346 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.286203 21346 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.286757 21346 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.287904 21346 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.290055 21343 tablet_bootstrap.cc:492] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.290386 21514 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.291010 21343 ts_tablet_manager.cc:1403] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.203s	user 0.068s	sys 0.082s
I20260709 13:06:07.289901 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.291764 21297 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.292881 21341 tablet_bootstrap.cc:654] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.293643 21343 raft_consensus.cc:359] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.294289 21343 raft_consensus.cc:385] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.294533 21343 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.295616 21343 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.297128 21343 ts_tablet_manager.cc:1434] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:06:07.297933 21343 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.298856 21297 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.304814 21343 tablet_bootstrap.cc:654] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.308883 21502 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.309341 21502 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.313423 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.313661 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.314476 21296 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
W20260709 13:06:07.315235 21114 leader_election.cc:343] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.316421 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.319486 21346 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.319855 21346 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.320200 21346 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.327775 21502 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.319514 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:07.330717 21114 leader_election.cc:343] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.283895 21299 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.290452 21340 tablet_bootstrap.cc:654] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.342375 21150 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.348680 21340 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.349249 21340 ts_tablet_manager.cc:1403] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.001s
I20260709 13:06:07.350339 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.352219 21545 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.352742 21545 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.353523 21502 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.353641 21545 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.354297 21502 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.358372 21340 raft_consensus.cc:359] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.359119 21340 raft_consensus.cc:385] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.359727 21340 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.359881 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.360574 21340 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.360891 21047 catalog_manager.cc:5697] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.359606 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.363283 21502 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.363698 21377 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.364151 21377 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.364847 21377 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.365535 21514 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.366531 21515 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.378707 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.378876 21346 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.381055 21346 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.381953 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:07.383829 21114 leader_election.cc:343] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.384840 21340 ts_tablet_manager.cc:1434] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 13:06:07.388792 21340 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.385471 21116 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.392882 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.393468 21299 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.404429 21377 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.405046 21377 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.408563 21299 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.409402 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.411883 21377 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:07.412256 21114 leader_election.cc:343] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.416396 21346 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.417240 21341 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:07.417703 21341 ts_tablet_manager.cc:1403] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.224s	user 0.007s	sys 0.007s
I20260709 13:06:07.414542 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.419356 21340 tablet_bootstrap.cc:654] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.420316 21346 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.420810 21346 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.422761 21343 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.423206 21343 ts_tablet_manager.cc:1403] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.125s	user 0.057s	sys 0.058s
I20260709 13:06:07.421677 21346 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.424338 21341 raft_consensus.cc:359] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.425020 21341 raft_consensus.cc:385] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.425272 21341 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.425282 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.425971 21295 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.427488 21341 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.429963 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.431007 21377 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.431828 21377 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.432196 21377 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.436143 21343 raft_consensus.cc:359] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.438099 21343 raft_consensus.cc:385] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.438419 21343 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.439203 21343 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.439579 21514 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.438468 21453 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.442696 21453 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.446031 21343 ts_tablet_manager.cc:1434] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:06:07.447661 21343 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.449698 21515 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.450178 21515 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.451725 21453 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:07.452812 21515 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.453612 21343 tablet_bootstrap.cc:654] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.453670 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.454770 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:07.455165 21263 leader_election.cc:343] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.456897 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.456988 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.457815 21151 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:07.457886 21295 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:07.459672 21191 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:07.460917 21515 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.461369 21515 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.461793 21515 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.463191 21263 leader_election.cc:343] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.463809 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.465503 21453 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.470760 21442 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.477005 21343 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.477555 21343 ts_tablet_manager.cc:1403] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.006s
I20260709 13:06:07.480121 21343 raft_consensus.cc:359] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.480927 21343 raft_consensus.cc:385] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.487891 21343 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.486307 21502 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.488595 21502 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.488677 21343 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.490633 21502 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.491245 21343 ts_tablet_manager.cc:1434] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:06:07.492244 21343 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.492352 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.493063 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:07.493693 21114 leader_election.cc:343] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.494062 21297 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.498401 21442 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.499281 21343 tablet_bootstrap.cc:654] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.498898 21442 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.500401 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.501133 21442 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.450163 21377 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.502234 21502 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.502692 21502 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.503028 21502 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.505074 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.517732 21341 ts_tablet_manager.cc:1434] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 13:06:07.517134 21047 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.518929 21341 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:07.519563 21047 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.521641 21047 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.528249 21452 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.529105 21432 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.529758 21432 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.557500 21377 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.561141 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.560547 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:07.581629 21114 leader_election.cc:343] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.584822 21297 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:07.584682 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.585456 21295 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.634559 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:07.693627 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 59191.9us
I20260709 13:06:07.528925 21452 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.694221 21442 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.694316 21515 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.701082 21367 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.707834 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.707662 21367 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:07.709059 21114 leader_election.cc:343] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.711581 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.712282 21151 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:07.708755 21452 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:07.712749 21367 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.711143 21502 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.713534 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:07.713696 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.714287 21299 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.714787 21452 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.715351 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.715700 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.716089 21452 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.716468 21452 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.716984 21114 leader_election.cc:343] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.717710 21346 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.718039 21346 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.718159 21502 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.718361 21346 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.721583 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.722162 21299 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.723651 21343 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.724081 21343 ts_tablet_manager.cc:1403] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.232s	user 0.054s	sys 0.042s
I20260709 13:06:07.728380 21346 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.729050 21340 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.719815 21432 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.730409 21340 ts_tablet_manager.cc:1403] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.342s	user 0.032s	sys 0.087s
I20260709 13:06:07.732292 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.733057 21346 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.740577 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.740423 21340 raft_consensus.cc:359] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.741829 21340 raft_consensus.cc:385] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.742162 21340 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.742735 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:07.743162 21114 leader_election.cc:343] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.742812 21340 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.743613 21298 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:07.745221 21340 ts_tablet_manager.cc:1434] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:07.746656 21367 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.749289 21340 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.750234 21442 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.756646 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.763518 21515 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.766822 21299 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.768369 21295 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:07.770428 21343 raft_consensus.cc:359] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.773519 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.773874 21343 raft_consensus.cc:385] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.774333 21343 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.775199 21343 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.775841 21502 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.776470 21502 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.777544 21502 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.778450 21343 ts_tablet_manager.cc:1434] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:06:07.779490 21343 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.783650 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.784349 21346 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.784763 21346 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:07.787153 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.787735 21297 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.789011 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.785426 21346 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.800623 21341 tablet_bootstrap.cc:654] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:07.801018 21263 leader_election.cc:343] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.803431 21343 tablet_bootstrap.cc:654] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:07.810545 21114 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.807531 21432 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:07.828131 21452 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.829807 21296 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:07.833918 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.834828 21452 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:07.812880 21224 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.846843 21340 tablet_bootstrap.cc:654] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.814114 21297 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:07.835860 21502 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.857097 21049 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.859017 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:07.810340 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:07.866662 21191 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:07.867336 21150 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:07.867637 21222 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.868350 21596 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.868975 21596 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:07.870026 21596 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.861634 21049 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:07.875681 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 65428.6us
I20260709 13:06:07.879165 21514 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.879654 21514 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.881565 21514 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.882716 21377 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.883102 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.883723 21297 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:07.878582 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:07.885653 21149 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.885538 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.890937 21191 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:07.893105 21377 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.893550 21377 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.897099 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.894340 21515 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.898645 21515 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.899076 21515 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.913456 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:07.914130 21299 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:07.917390 21377 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.918071 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:07.918808 21149 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:07.919317 21452 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.920892 21114 leader_election.cc:343] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.918809 21377 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.921461 21377 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.921756 21377 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.923524 21341 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:07.924078 21341 ts_tablet_manager.cc:1403] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.405s	user 0.028s	sys 0.022s
W20260709 13:06:07.924539 21263 leader_election.cc:343] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.924942 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:07.925976 21453 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.919807 21452 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.927762 21343 tablet_bootstrap.cc:492] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:07.928135 21343 ts_tablet_manager.cc:1403] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.036s
I20260709 13:06:07.933871 21341 raft_consensus.cc:359] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.934587 21341 raft_consensus.cc:385] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.934865 21341 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.935506 21341 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.937206 21341 ts_tablet_manager.cc:1434] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:06:07.937973 21341 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:07.939595 21452 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:07.944649 21340 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:07.944633 21346 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.945243 21340 ts_tablet_manager.cc:1403] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.008s
I20260709 13:06:07.948125 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:07.949604 21377 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.951740 21377 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.951529 21343 raft_consensus.cc:359] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.952236 21343 raft_consensus.cc:385] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.953881 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.954001 21340 raft_consensus.cc:359] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.954435 21297 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.954653 21340 raft_consensus.cc:385] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.954979 21340 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.955677 21340 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.957612 21340 ts_tablet_manager.cc:1434] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:06:07.958436 21340 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:07.959470 21343 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.960191 21343 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.967016 21515 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:07.967188 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:07.963835 21502 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:07.970412 21343 ts_tablet_manager.cc:1434] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
W20260709 13:06:07.977926 21114 leader_election.cc:343] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.988545 21343 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:07.972323 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:07.972337 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:07.968294 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:07.991503 21149 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
W20260709 13:06:07.992641 21189 leader_election.cc:343] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:07.994777 21263 leader_election.cc:343] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.976423 21595 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.996099 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:07.973250 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:07.973172 21515 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:07.999857 21346 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.004923 21432 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:08.009128 21346 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.009410 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.011751 21452 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.012580 21452 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.013000 21452 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:08.015394 21189 leader_election.cc:343] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.003397 21297 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:08.022321 21341 tablet_bootstrap.cc:654] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.010902 21298 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.027570 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.029367 21432 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.029959 21432 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:08.031359 21432 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.034220 21298 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:08.035233 21191 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:08.037348 21596 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.037971 21596 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.037204 21595 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.040035 21595 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:08.039373 21343 tablet_bootstrap.cc:654] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.040844 21595 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.046651 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.052070 21297 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:08.043165 21596 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.067204 21452 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.074368 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:08.074981 21149 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.075461 21340 tablet_bootstrap.cc:654] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.077425 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.078239 21049 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.070026 21452 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.099143 21047 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.092567 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:08.133528 21596 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.119378 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:08.154047 21149 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:08.155593 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:08.152024 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 63440.9us
W20260709 13:06:08.175433 21263 leader_election.cc:343] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.164866 21452 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.177459 21452 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:08.177660 21596 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.178232 21341 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.178758 21341 ts_tablet_manager.cc:1403] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.241s	user 0.021s	sys 0.020s
I20260709 13:06:08.178328 21452 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:08.183151 21114 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.184401 21340 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.184607 21343 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.184856 21340 ts_tablet_manager.cc:1403] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.227s	user 0.024s	sys 0.009s
I20260709 13:06:08.185058 21343 ts_tablet_manager.cc:1403] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.197s	user 0.007s	sys 0.015s
I20260709 13:06:08.188167 21343 raft_consensus.cc:359] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.188915 21343 raft_consensus.cc:385] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.189180 21343 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.191064 21343 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.193428 21343 ts_tablet_manager.cc:1434] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:08.194628 21343 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.198796 21047 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.201354 21341 raft_consensus.cc:359] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.201963 21341 raft_consensus.cc:385] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.202219 21341 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.205021 21341 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.207315 21341 ts_tablet_manager.cc:1434] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:06:08.208704 21341 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.215471 21545 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.220050 21343 tablet_bootstrap.cc:654] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.221942 21340 raft_consensus.cc:359] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.222594 21340 raft_consensus.cc:385] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.222884 21340 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.223829 21340 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.237608 21340 ts_tablet_manager.cc:1434] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 13:06:08.238942 21340 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.244453 21346 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.244910 21346 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.246803 21346 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.249890 21341 tablet_bootstrap.cc:654] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.251828 21047 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.252595 21545 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.257305 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:08.259434 21116 leader_election.cc:343] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.258991 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:08.264509 21114 leader_election.cc:343] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.264914 21114 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.267488 21346 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.269316 21432 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.271803 21343 tablet_bootstrap.cc:492] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.272262 21343 ts_tablet_manager.cc:1403] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.004s
I20260709 13:06:08.293918 21343 raft_consensus.cc:359] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.294566 21343 raft_consensus.cc:385] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.294844 21343 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.295444 21343 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.299069 21343 ts_tablet_manager.cc:1434] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:06:08.299731 21343 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.306815 21340 tablet_bootstrap.cc:654] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.321115 21343 tablet_bootstrap.cc:654] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.327603 21341 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.328135 21341 ts_tablet_manager.cc:1403] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.009s
I20260709 13:06:08.329784 21343 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.330369 21343 ts_tablet_manager.cc:1403] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:06:08.333916 21343 raft_consensus.cc:359] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.334751 21343 raft_consensus.cc:385] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.335121 21343 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.336611 21343 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.334405 21341 raft_consensus.cc:359] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.340576 21341 raft_consensus.cc:385] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.340916 21341 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.341627 21341 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.343796 21341 ts_tablet_manager.cc:1434] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:06:08.345043 21343 ts_tablet_manager.cc:1434] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:06:08.345695 21341 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.349722 21343 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.356400 21343 tablet_bootstrap.cc:654] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.363722 21341 tablet_bootstrap.cc:654] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.365306 21340 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.365237 21453 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.365417 21515 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.366744 21453 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.367334 21515 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.369065 21453 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.370880 21340 ts_tablet_manager.cc:1403] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.013s
I20260709 13:06:08.370921 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.372700 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:08.374430 21263 leader_election.cc:343] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.374732 21340 raft_consensus.cc:359] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.375614 21340 raft_consensus.cc:385] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.375922 21340 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.376032 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.376834 21340 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:08.378005 21189 leader_election.cc:343] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:08.378897 21263 leader_election.cc:343] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.379436 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.380232 21453 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.382367 21343 tablet_bootstrap.cc:492] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.382433 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.382898 21343 ts_tablet_manager.cc:1403] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.019s
I20260709 13:06:08.383188 21298 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:08.384764 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:08.385893 21367 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.386289 21367 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.386044 21596 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.386063 21343 raft_consensus.cc:359] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.386756 21367 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.386932 21343 raft_consensus.cc:385] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.387241 21343 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.387902 21343 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.389106 21340 ts_tablet_manager.cc:1434] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:08.389976 21340 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.390157 21343 ts_tablet_manager.cc:1434] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:06:08.382953 21515 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.397382 21340 tablet_bootstrap.cc:654] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.399299 21343 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.397944 21367 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.404628 21367 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.450623 21453 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.461786 21453 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.464071 21220 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.469728 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:06:08.470445 21114 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.470815 21298 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.455751 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:06:08.483379 21189 leader_election.cc:343] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.487062 21596 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.496753 21453 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.498457 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.498855 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:08.500463 21263 leader_election.cc:343] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.501183 21343 tablet_bootstrap.cc:654] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.501957 21340 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.503085 21340 ts_tablet_manager.cc:1403] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.002s
I20260709 13:06:08.512725 21341 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.513603 21341 ts_tablet_manager.cc:1403] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.015s
W20260709 13:06:08.514421 21263 leader_election.cc:343] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.522243 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.531577 21452 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.532560 21452 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.533427 21452 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.542831 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.507584 21340 raft_consensus.cc:359] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.544368 21340 raft_consensus.cc:385] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.544780 21340 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
W20260709 13:06:08.545179 21263 leader_election.cc:343] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.547501 21340 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.548840 21341 raft_consensus.cc:359] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.549997 21341 raft_consensus.cc:385] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.550269 21341 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.554030 21452 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.559499 21298 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:08.553906 21341 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.561892 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:08.562937 21515 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.559754 21340 ts_tablet_manager.cc:1434] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:06:08.555743 21381 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.563597 21515 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:08.563836 21381 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.564685 21340 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.564879 21515 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.565915 21343 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.566257 21381 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:08.556701 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.567773 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.568427 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.569315 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.569118 21343 ts_tablet_manager.cc:1403] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.170s	user 0.011s	sys 0.015s
W20260709 13:06:08.569499 21114 leader_election.cc:343] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:08.570724 21263 leader_election.cc:343] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.571126 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:08.572281 21116 leader_election.cc:343] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.562754 21346 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.575655 21453 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.572795 21116 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.577467 21346 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.578450 21340 tablet_bootstrap.cc:654] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.582223 21341 ts_tablet_manager.cc:1434] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.004s
I20260709 13:06:08.586611 21452 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.595381 21343 raft_consensus.cc:359] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.596222 21343 raft_consensus.cc:385] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.596544 21343 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.597651 21343 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.601125 21343 ts_tablet_manager.cc:1434] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:06:08.602496 21343 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.613394 21224 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.671013 21341 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.671367 21340 tablet_bootstrap.cc:492] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.671856 21340 ts_tablet_manager.cc:1403] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.037s
I20260709 13:06:08.674203 21515 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.674793 21515 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:08.678489 21632 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:08.691825 21515 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.693535 21340 raft_consensus.cc:359] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.693167 21221 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.694633 21595 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.695319 21340 raft_consensus.cc:385] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.695785 21340 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.697007 21340 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.699716 21343 tablet_bootstrap.cc:654] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.700552 21340 ts_tablet_manager.cc:1434] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 13:06:08.701781 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.715615 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.719676 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:08.723735 21340 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.729717 21341 tablet_bootstrap.cc:654] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.737349 21452 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.740851 21596 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.749796 21047 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.750770 21340 tablet_bootstrap.cc:654] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.755668 21341 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.756158 21341 ts_tablet_manager.cc:1403] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.001s
I20260709 13:06:08.764873 21343 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.765302 21343 ts_tablet_manager.cc:1403] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.163s	user 0.008s	sys 0.011s
I20260709 13:06:08.766464 21432 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.766894 21432 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.767899 21343 raft_consensus.cc:359] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.768550 21343 raft_consensus.cc:385] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.768795 21343 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.768860 21432 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.769404 21343 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.770278 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.771811 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.759004 21341 raft_consensus.cc:359] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.772545 21295 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:08.772716 21341 raft_consensus.cc:385] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.772930 21341 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.773629 21341 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.774201 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.774935 21381 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.778575 21343 ts_tablet_manager.cc:1434] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:06:08.779567 21343 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.785790 21340 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.786231 21340 ts_tablet_manager.cc:1403] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.001s
I20260709 13:06:08.787034 21381 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.788544 21452 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.788892 21340 raft_consensus.cc:359] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.789043 21452 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.789565 21340 raft_consensus.cc:385] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.789850 21340 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.790424 21340 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.791841 21341 ts_tablet_manager.cc:1434] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 13:06:08.791782 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.792491 21452 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.793004 21341 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
W20260709 13:06:08.793063 21263 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.794160 21340 ts_tablet_manager.cc:1434] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:08.794237 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.795276 21340 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
W20260709 13:06:08.795787 21263 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.796219 21263 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.797349 21452 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.800268 21341 tablet_bootstrap.cc:654] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.803697 21340 tablet_bootstrap.cc:654] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.805348 21343 tablet_bootstrap.cc:654] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.814349 21341 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.814828 21341 ts_tablet_manager.cc:1403] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 13:06:08.815478 21381 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.816074 21381 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.817884 21341 raft_consensus.cc:359] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.818683 21341 raft_consensus.cc:385] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.819002 21341 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.819708 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.820088 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.819939 21341 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.820474 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
W20260709 13:06:08.821698 21114 leader_election.cc:343] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.822734 21341 ts_tablet_manager.cc:1434] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:08.822719 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.824002 21341 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.823913 21545 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.824405 21545 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.824849 21545 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.827180 21343 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.827708 21343 ts_tablet_manager.cc:1403] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:06:08.830305 21343 raft_consensus.cc:359] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.830951 21343 raft_consensus.cc:385] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.830401 21381 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.831223 21343 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.831887 21343 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.833933 21343 ts_tablet_manager.cc:1434] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:08.834878 21343 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.837065 21340 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.837674 21340 ts_tablet_manager.cc:1403] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.001s
I20260709 13:06:08.837895 21341 tablet_bootstrap.cc:654] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.848735 21343 tablet_bootstrap.cc:654] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.849402 21340 raft_consensus.cc:359] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.850313 21340 raft_consensus.cc:385] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.850757 21340 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.851657 21340 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.854642 21340 ts_tablet_manager.cc:1434] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:08.856271 21340 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.858471 21381 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.859676 21545 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.859756 21381 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.861915 21381 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.863204 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.863894 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.865024 21297 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:08.865276 21545 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:08.864498 21114 leader_election.cc:343] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.867205 21116 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.867420 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:08.868537 21114 leader_election.cc:343] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.868607 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:08.868917 21343 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.869217 21297 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.869495 21343 ts_tablet_manager.cc:1403] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:06:08.871984 21340 tablet_bootstrap.cc:654] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.872711 21367 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.874253 21367 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.873170 21343 raft_consensus.cc:359] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.875062 21343 raft_consensus.cc:385] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.876500 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:08.876741 21343 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.876870 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.877614 21545 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.877780 21147 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:08.878043 21545 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.878424 21545 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.878206 21343 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.879674 21367 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.880460 21343 ts_tablet_manager.cc:1434] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:08.881578 21343 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.882539 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:08.883402 21295 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:08.884502 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:08.885272 21596 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.885344 21545 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.888535 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:08.888643 21341 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.889256 21341 ts_tablet_manager.cc:1403] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.007s
W20260709 13:06:08.890277 21114 leader_election.cc:343] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.893348 21545 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.891114 21340 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.894374 21340 ts_tablet_manager.cc:1403] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 13:06:08.892560 21341 raft_consensus.cc:359] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.892797 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.896323 21341 raft_consensus.cc:385] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.891956 21343 tablet_bootstrap.cc:654] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.893214 21596 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.898738 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:08.896632 21341 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.899175 21545 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.899348 21297 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.899833 21545 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:08.899191 21340 raft_consensus.cc:359] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.900408 21340 raft_consensus.cc:385] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.900081 21341 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.900738 21340 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.901487 21340 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.902930 21341 ts_tablet_manager.cc:1434] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:06:08.904079 21340 ts_tablet_manager.cc:1434] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:08.905270 21340 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.900749 21545 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.909214 21341 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.911877 21340 tablet_bootstrap.cc:654] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.916101 21341 tablet_bootstrap.cc:654] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.923758 21340 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:08.924472 21340 ts_tablet_manager.cc:1403] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:06:08.928467 21340 raft_consensus.cc:359] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.929618 21340 raft_consensus.cc:385] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.930068 21340 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.931002 21340 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.933286 21594 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.933753 21594 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.934418 21340 ts_tablet_manager.cc:1434] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:06:08.935863 21340 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:08.935771 21594 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.937933 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:08.938668 21149 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:08.939700 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:08.941284 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:08.941509 21594 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.941951 21594 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.942338 21594 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.942374 21221 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:08.942497 21263 leader_election.cc:343] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.947814 21297 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:08.948300 21049 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.951212 21116 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:08.952253 21343 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:08.952346 21545 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.952790 21343 ts_tablet_manager.cc:1403] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.002s
I20260709 13:06:08.953038 21594 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.954914 21341 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:08.956640 21341 ts_tablet_manager.cc:1403] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.015s
I20260709 13:06:08.956907 21343 raft_consensus.cc:359] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.957734 21343 raft_consensus.cc:385] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.957988 21343 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.958590 21343 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.953233 21545 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:08.962008 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:08.959390 21341 raft_consensus.cc:359] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.963306 21341 raft_consensus.cc:385] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.963595 21341 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.962648 21149 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.964251 21341 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.966359 21340 tablet_bootstrap.cc:654] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.962117 21545 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:08.968246 21367 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.969285 21343 ts_tablet_manager.cc:1434] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:06:08.971982 21343 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:08.972649 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:08.974658 21263 leader_election.cc:343] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.976963 21594 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:08.978619 21341 ts_tablet_manager.cc:1434] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:06:08.979780 21341 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:08.991526 21150 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.000396 21367 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.007391 21596 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.007890 21596 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.001008 21367 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.026229 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.027652 21367 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:08.998469 21149 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
W20260709 13:06:09.031730 21191 leader_election.cc:343] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.033025 21343 tablet_bootstrap.cc:654] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.027150 21514 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.026559 21596 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.041849 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.043483 21452 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.043974 21452 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:09.044327 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.044920 21452 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.047945 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.048501 21295 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:09.048548 21514 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.050704 21514 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.051144 21346 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.051576 21346 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.052291 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:09.053257 21346 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:09.053344 21189 leader_election.cc:343] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.053697 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.053790 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:09.054334 21298 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:09.051178 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.055532 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.056178 21151 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:09.057888 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:06:09.058247 21189 leader_election.cc:343] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.057019 21515 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.055570 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.060376 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.059278 21594 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.061856 21341 tablet_bootstrap.cc:654] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.061932 21594 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:09.067991 21114 leader_election.cc:343] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.069258 21116 leader_election.cc:343] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.069813 21116 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.068234 21367 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.070736 21367 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.071159 21367 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.075634 21340 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:09.076483 21340 ts_tablet_manager.cc:1403] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.029s
I20260709 13:06:09.067919 21596 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.068830 21595 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.074769 21381 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.081768 21596 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.086361 21596 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.098635 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:09.100080 21263 leader_election.cc:343] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.101807 21343 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.102366 21343 ts_tablet_manager.cc:1403] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.016s
I20260709 13:06:09.108564 21594 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.133467 21596 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.135926 21596 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.139346 21047 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.143402 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:06:09.144973 21189 leader_election.cc:343] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.157114 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.164206 21343 raft_consensus.cc:359] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.165109 21343 raft_consensus.cc:385] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.165411 21343 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
W20260709 13:06:09.182165 21263 leader_election.cc:343] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.182808 21263 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.183537 21340 raft_consensus.cc:359] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.184432 21340 raft_consensus.cc:385] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.184243 21594 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.184929 21340 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.166292 21343 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.190779 21343 ts_tablet_manager.cc:1434] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.088s	user 0.003s	sys 0.004s
I20260709 13:06:09.192327 21343 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:09.185899 21340 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.197121 21367 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.203807 21367 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.204262 21340 ts_tablet_manager.cc:1434] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.005s
I20260709 13:06:09.204907 21343 tablet_bootstrap.cc:654] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.205529 21340 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:09.206521 21341 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:09.206971 21341 ts_tablet_manager.cc:1403] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.228s	user 0.004s	sys 0.009s
I20260709 13:06:09.209614 21341 raft_consensus.cc:359] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.210253 21341 raft_consensus.cc:385] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.210557 21341 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.205530 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:09.211925 21150 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.219944 21663 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.223790 21341 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.225549 21341 ts_tablet_manager.cc:1434] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:06:09.226485 21341 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:09.222986 21663 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.221962 21150 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:09.232717 21049 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:09.291625 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52906.3us
I20260709 13:06:09.308182 21189 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:09.308269 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.302958 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:06:09.312031 21263 leader_election.cc:343] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.310783 21452 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.315105 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.309963 21515 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.317598 21515 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:09.318888 21343 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.319360 21343 ts_tablet_manager.cc:1403] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.039s
I20260709 13:06:09.321132 21515 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.311239 21545 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.323534 21545 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:09.326879 21263 leader_election.cc:343] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.310321 21663 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.327214 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.313879 21297 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.325636 21452 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.329954 21663 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.344877 21341 tablet_bootstrap.cc:654] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.349946 21452 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.356478 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.356345 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.358811 21545 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.360548 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.361182 21300 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:09.362327 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.356309 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:09.363564 21298 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.366439 21116 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:09.367498 21377 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.367813 21377 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.368079 21377 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:09.373273 21263 leader_election.cc:343] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.373862 21263 leader_election.cc:343] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.374155 21263 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:09.345755 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:09.376348 21114 leader_election.cc:343] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.357089 21343 raft_consensus.cc:359] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.379812 21343 raft_consensus.cc:385] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.381029 21343 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.386044 21047 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.379554 21662 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.386819 21377 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.393569 21343 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.397215 21343 ts_tablet_manager.cc:1434] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
I20260709 13:06:09.402475 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:09.403918 21343 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
W20260709 13:06:09.404865 21114 leader_election.cc:343] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.406505 21377 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.418193 21297 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:09.423626 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:09.423960 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:09.424556 21295 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.424675 21514 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.425364 21514 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:09.426158 21514 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.431008 21295 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:09.432231 21116 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.432972 21298 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
W20260709 13:06:09.434736 21114 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.433660 21381 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.437009 21341 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:09.437580 21341 ts_tablet_manager.cc:1403] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.021s
I20260709 13:06:09.436878 21381 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:09.439092 21381 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.441709 21340 tablet_bootstrap.cc:654] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.447593 21668 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.448768 21341 raft_consensus.cc:359] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.449486 21341 raft_consensus.cc:385] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.449781 21341 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.450532 21341 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.452723 21341 ts_tablet_manager.cc:1434] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:06:09.453989 21343 tablet_bootstrap.cc:654] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.454854 21340 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:09.454119 21047 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.456547 21341 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:09.457769 21340 ts_tablet_manager.cc:1403] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.252s	user 0.009s	sys 0.011s
W20260709 13:06:09.460691 21114 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.464485 21048 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.469950 21340 raft_consensus.cc:359] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.470677 21340 raft_consensus.cc:385] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.470942 21340 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.471393 21668 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.471853 21668 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.474984 21340 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.477918 21340 ts_tablet_manager.cc:1434] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:06:09.478878 21340 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:09.488572 21224 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.493606 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:09.506327 21263 leader_election.cc:343] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.507606 21341 tablet_bootstrap.cc:654] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.513448 21340 tablet_bootstrap.cc:654] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.514590 21452 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:09.516230 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.517982 21224 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:09.518996 21263 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:09.519892 21452 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.520480 21452 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.528283 21672 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:09.526976 21452 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.523810 21381 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.531101 21381 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.533500 21381 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.534938 21343 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.535552 21343 ts_tablet_manager.cc:1403] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.132s	user 0.027s	sys 0.020s
I20260709 13:06:09.520291 21668 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.542706 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.543756 21672 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.540764 21545 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:09.547569 21515 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.556525 21672 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.560714 21515 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.568513 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.569367 21226 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:09.570204 21515 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.572202 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.572783 21149 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:09.578498 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.578896 21189 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:09.579489 21298 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:09.580179 21515 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.580094 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:09.581473 21191 leader_election.cc:343] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.581367 21116 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.583868 21346 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.598278 21432 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.598933 21432 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.583067 21515 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.589272 21672 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.600673 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:09.603892 21343 raft_consensus.cc:359] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.605396 21343 raft_consensus.cc:385] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.605654 21343 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.608320 21343 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.602559 21515 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.610152 21432 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.612316 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:09.613829 21114 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.613893 21452 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.622172 21452 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.623332 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:09.623582 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:06:09.625057 21263 leader_election.cc:343] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.623921 21221 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.624107 21381 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.630419 21381 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.630787 21381 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.636107 21367 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.636699 21367 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.644163 21367 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.644436 21346 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.647579 21343 ts_tablet_manager.cc:1434] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.112s	user 0.018s	sys 0.014s
I20260709 13:06:09.649547 21340 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:09.649993 21340 ts_tablet_manager.cc:1403] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.000s
W20260709 13:06:09.650903 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 69622.2us
I20260709 13:06:09.652832 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.658897 21221 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:09.664750 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.665431 21294 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:09.665807 21381 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.664558 21515 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.668916 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.672154 21263 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:09.672256 21116 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.672559 21298 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:09.673239 21668 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.673508 21343 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:09.673730 21668 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:09.674541 21668 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.677053 21341 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:09.677491 21341 ts_tablet_manager.cc:1403] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.006s
I20260709 13:06:09.680721 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.682008 21346 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.682370 21346 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.682701 21346 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.687160 21191 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:09.689782 21514 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.692370 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:09.693095 21150 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.708703 21381 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.713119 21343 tablet_bootstrap.cc:654] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.716754 21150 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:09.719195 21346 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.717684 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:09.728099 21221 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.728116 21189 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:09.728958 21596 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.729400 21596 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:09.730172 21596 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.731089 21341 raft_consensus.cc:359] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.731757 21341 raft_consensus.cc:385] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.732012 21341 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.732743 21341 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.740835 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:09.741099 21340 raft_consensus.cc:359] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.741458 21291 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.741813 21340 raft_consensus.cc:385] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.742316 21340 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.742811 21340 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.750979 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:09.756842 21341 ts_tablet_manager.cc:1434] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.002s
I20260709 13:06:09.751027 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:09.758296 21298 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.763504 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:09.764439 21114 leader_election.cc:343] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.767336 21515 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.768296 21291 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:09.769649 21221 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:09.765945 21298 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:09.774832 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:09.770630 21346 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.771478 21341 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:09.765086 21340 ts_tablet_manager.cc:1434] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 13:06:09.772704 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:09.775449 21291 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.776675 21340 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:09.783337 21343 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.783783 21343 ts_tablet_manager.cc:1403] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.003s
I20260709 13:06:09.785039 21346 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.786227 21343 raft_consensus.cc:359] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.794596 21343 raft_consensus.cc:385] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.794786 21346 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:09.794919 21343 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.789557 21340 tablet_bootstrap.cc:654] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.795629 21346 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.795656 21343 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.791447 21341 tablet_bootstrap.cc:654] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.792409 21685 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.793092 21049 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.798280 21343 ts_tablet_manager.cc:1434] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:09.799669 21343 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:09.800704 21291 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:09.801781 21116 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.802655 21681 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.803187 21681 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:09.804001 21681 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.807030 21343 tablet_bootstrap.cc:654] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.815876 21340 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:09.816300 21340 ts_tablet_manager.cc:1403] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.005s
I20260709 13:06:09.826529 21341 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:09.826962 21341 ts_tablet_manager.cc:1403] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.004s
I20260709 13:06:09.829141 21343 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.829670 21343 ts_tablet_manager.cc:1403] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.007s
I20260709 13:06:09.824692 21340 raft_consensus.cc:359] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.830263 21340 raft_consensus.cc:385] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.830565 21340 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.831209 21340 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.832284 21049 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 2, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.832710 21343 raft_consensus.cc:359] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.833262 21340 ts_tablet_manager.cc:1434] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:09.833559 21343 raft_consensus.cc:385] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.833890 21343 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.834213 21340 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:09.829260 21341 raft_consensus.cc:359] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.834654 21343 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.835332 21341 raft_consensus.cc:385] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.834638 21049 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.837186 21343 ts_tablet_manager.cc:1434] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:09.838418 21343 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:09.844404 21343 tablet_bootstrap.cc:654] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.849057 21341 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.851372 21341 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.853432 21341 ts_tablet_manager.cc:1434] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:06:09.856420 21515 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.860896 21340 tablet_bootstrap.cc:654] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.871418 21341 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:09.871197 21681 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.888558 21341 tablet_bootstrap.cc:654] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:09.917842 21114 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.920141 21343 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:09.920684 21343 ts_tablet_manager.cc:1403] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.010s
I20260709 13:06:09.922729 21341 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:09.923362 21343 raft_consensus.cc:359] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.926183 21343 raft_consensus.cc:385] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.926457 21343 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.927073 21341 ts_tablet_manager.cc:1403] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.003s
I20260709 13:06:09.928686 21340 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:09.929152 21340 ts_tablet_manager.cc:1403] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.004s
I20260709 13:06:09.933102 21340 raft_consensus.cc:359] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.933723 21340 raft_consensus.cc:385] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.934010 21340 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.935747 21668 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.936908 21668 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.936995 21340 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.938898 21668 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.939153 21340 ts_tablet_manager.cc:1434] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:06:09.927120 21343 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.940699 21346 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.941156 21346 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.942883 21346 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.942965 21343 ts_tablet_manager.cc:1434] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:06:09.940135 21340 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:09.944258 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.944161 21343 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
W20260709 13:06:09.946926 21263 leader_election.cc:343] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.947613 21377 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.948952 21377 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.949494 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.950372 21221 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:09.952950 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:09.953442 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.953564 21224 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:09.954690 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.955331 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:09.956048 21341 raft_consensus.cc:359] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.956701 21341 raft_consensus.cc:385] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.956951 21341 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.957134 21668 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.957505 21668 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.957829 21668 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.961053 21343 tablet_bootstrap.cc:654] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.962647 21340 tablet_bootstrap.cc:654] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:09.963653 21116 leader_election.cc:343] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.963996 21341 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.968142 21341 ts_tablet_manager.cc:1434] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.002s
I20260709 13:06:09.969099 21341 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:09.968957 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.970124 21432 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.971462 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:09.974841 21114 leader_election.cc:343] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.975240 21114 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:09.976346 21346 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.979573 21668 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.981495 21668 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:09.953461 21377 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.982715 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:09.983296 21224 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.989506 21432 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.990391 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:09.992408 21515 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.992980 21341 tablet_bootstrap.cc:654] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.992867 21515 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:09.994939 21515 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:09.996585 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:09.998657 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:09.999399 21291 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:10.000497 21191 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:10.000942 21263 leader_election.cc:343] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.001489 21515 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.007426 21224 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.009865 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:10.011312 21668 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.012153 21668 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:10.013154 21668 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.014436 21224 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.018976 21515 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.025348 21341 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:10.025851 21341 ts_tablet_manager.cc:1403] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.003s
I20260709 13:06:10.027787 21340 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.028236 21340 ts_tablet_manager.cc:1403] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.007s
I20260709 13:06:10.030778 21340 raft_consensus.cc:359] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.031458 21340 raft_consensus.cc:385] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.031713 21340 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.032327 21340 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.034313 21340 ts_tablet_manager.cc:1434] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:10.082784 21367 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.041531 21685 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:06:10.087710 21367 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.036481 21341 raft_consensus.cc:359] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.088795 21341 raft_consensus.cc:385] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.089082 21341 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.089720 21341 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.090159 21367 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.036481 21343 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.091094 21343 ts_tablet_manager.cc:1403] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.029s
I20260709 13:06:10.053606 21048 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.090699 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.093709 21343 raft_consensus.cc:359] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.093816 21452 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.094352 21343 raft_consensus.cc:385] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.094636 21343 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.095225 21343 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:10.096860 21189 leader_election.cc:343] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.097151 21343 ts_tablet_manager.cc:1434] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:06:10.098065 21343 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.098178 21367 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.037249 21340 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.111531 21346 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.112102 21340 tablet_bootstrap.cc:654] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.111979 21346 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.112614 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.113852 21346 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.115703 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:10.117035 21114 leader_election.cc:343] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.117244 21343 tablet_bootstrap.cc:654] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.117638 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:10.118033 21191 leader_election.cc:343] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.118291 21297 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:10.119480 21116 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.118592 21191 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:10.120707 21346 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.122004 21346 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.122386 21346 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.122854 21515 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.124894 21377 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.125741 21340 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.125514 21377 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.126349 21340 ts_tablet_manager.cc:1403] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.022s
I20260709 13:06:10.130270 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.130640 21340 raft_consensus.cc:359] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.131345 21340 raft_consensus.cc:385] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.131613 21340 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.132211 21340 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:10.132508 21114 leader_election.cc:343] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.134315 21340 ts_tablet_manager.cc:1434] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:06:10.135527 21340 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.143164 21662 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:10.144331 21341 ts_tablet_manager.cc:1434] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.001s
I20260709 13:06:10.145335 21341 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:10.151145 21340 tablet_bootstrap.cc:654] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.157423 21377 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.158501 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:10.159750 21116 leader_election.cc:343] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.160145 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.161805 21377 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.164527 21346 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.167297 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:10.167814 21297 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.168386 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:10.171912 21114 leader_election.cc:343] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.174567 21297 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:10.174851 21340 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.175289 21340 ts_tablet_manager.cc:1403] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:06:10.175675 21116 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.176448 21377 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.176863 21377 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:10.177660 21377 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.182973 21340 raft_consensus.cc:359] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.183743 21340 raft_consensus.cc:385] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.184005 21340 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.187587 21340 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.190253 21340 ts_tablet_manager.cc:1434] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:06:10.191150 21340 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.204262 21340 tablet_bootstrap.cc:654] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.215391 21340 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.222841 21340 ts_tablet_manager.cc:1403] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.005s
I20260709 13:06:10.218992 21346 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.245445 21661 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:10.261099 21432 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.261623 21432 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.263517 21432 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.267503 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.268153 21222 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:10.269035 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.269927 21114 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:06:10.270464 21116 leader_election.cc:343] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.270736 21681 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.271118 21681 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.271449 21681 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.273227 21343 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.273658 21343 ts_tablet_manager.cc:1403] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.176s	user 0.035s	sys 0.064s
I20260709 13:06:10.276779 21341 tablet_bootstrap.cc:654] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.277554 21340 raft_consensus.cc:359] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.279150 21340 raft_consensus.cc:385] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.278954 21681 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.279531 21340 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.280279 21340 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.281029 21681 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.278784 21298 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:10.282503 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:10.282514 21681 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:06:10.299853 21343 raft_consensus.cc:359] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.306931 21343 raft_consensus.cc:385] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.307327 21343 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.311087 21343 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.406175 21662 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.406750 21662 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.408782 21662 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.416508 21340 ts_tablet_manager.cc:1434] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.193s	user 0.007s	sys 0.002s
I20260709 13:06:10.416970 21343 ts_tablet_manager.cc:1434] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.143s	user 0.017s	sys 0.014s
I20260709 13:06:10.417694 21340 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.418309 21343 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.425709 21685 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.425235 21048 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.437170 21341 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:10.437721 21341 ts_tablet_manager.cc:1403] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.293s	user 0.006s	sys 0.005s
I20260709 13:06:10.444847 21343 tablet_bootstrap.cc:654] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.444689 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:10.445238 21222 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.452234 21222 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:10.456005 21224 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:10.456638 21114 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:10.457337 21681 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:10.458663 21116 leader_election.cc:343] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.442999 21341 raft_consensus.cc:359] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.457790 21681 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:10.463991 21681 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.464887 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.465483 21151 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:10.467628 21341 raft_consensus.cc:385] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.467967 21341 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.468604 21341 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.472425 21662 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.473073 21662 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.475307 21662 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.478856 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.479439 21149 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:10.483963 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:10.486056 21341 ts_tablet_manager.cc:1434] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 13:06:10.487002 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.487715 21222 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:10.489620 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.491873 21662 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.492259 21662 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.492581 21662 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.497538 21681 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.501106 21545 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.502067 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:10.502755 21452 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.503095 21452 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.503463 21452 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:10.505281 21263 leader_election.cc:343] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.506316 21545 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.511885 21340 tablet_bootstrap.cc:654] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.511404 21343 tablet_bootstrap.cc:492] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.515390 21343 ts_tablet_manager.cc:1403] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.007s
I20260709 13:06:10.522063 21049 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.518023 21343 raft_consensus.cc:359] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.524695 21343 raft_consensus.cc:385] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.525094 21340 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.525288 21343 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.525701 21340 ts_tablet_manager.cc:1403] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.004s
I20260709 13:06:10.529889 21340 raft_consensus.cc:359] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.530798 21340 raft_consensus.cc:385] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.531186 21340 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.533888 21340 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.540151 21340 ts_tablet_manager.cc:1434] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:06:10.541602 21340 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.537230 21343 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.546257 21343 ts_tablet_manager.cc:1434] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:06:10.548221 21343 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.553966 21452 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.487083 21341 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:10.557487 21685 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.558219 21685 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.562103 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.565846 21685 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.570065 21340 tablet_bootstrap.cc:654] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.571740 21343 tablet_bootstrap.cc:654] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.577757 21685 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.578414 21685 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.582325 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.582984 21297 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
I20260709 13:06:10.584182 21191 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:10.585104 21661 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.585520 21661 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.585855 21661 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.594462 21661 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.595278 21685 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.597301 21662 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:10.599359 21116 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.19.145.62:44287, user_credentials={real_user=slave}} blocked reactor thread for 62814.1us
I20260709 13:06:10.613549 21661 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.630244 21662 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.631662 21724 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.632095 21724 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.633993 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:10.634146 21724 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.634543 21297 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.639400 21681 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.639864 21681 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.641099 21297 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:10.641788 21681 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.642130 21191 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:06:10.645466 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45933.7us
I20260709 13:06:10.648180 21661 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.648677 21661 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:10.649473 21661 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.652513 21452 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.655730 21340 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.656250 21340 ts_tablet_manager.cc:1403] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.005s
I20260709 13:06:10.656798 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.660277 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.663092 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:10.665530 21114 leader_election.cc:343] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.670279 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.670910 21149 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 0.
W20260709 13:06:10.672618 21116 leader_election.cc:343] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.673017 21116 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.673637 21346 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.674059 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:10.674556 21224 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.674484 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:10.675236 21149 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.676491 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:10.677237 21222 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 1: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:10.682253 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:10.682886 21149 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
W20260709 13:06:10.689164 21263 leader_election.cc:343] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.690099 21224 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.691069 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:10.691601 21725 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:10.694465 21725 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.694983 21725 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:10.695904 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:10.696481 21150 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.695854 21725 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.706068 21150 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.723589 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.726855 21340 raft_consensus.cc:359] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.729789 21340 raft_consensus.cc:385] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.730162 21340 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.731631 21340 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.733248 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:10.733780 21150 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.746428 21341 tablet_bootstrap.cc:654] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.749104 21150 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.749318 21343 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.749716 21343 ts_tablet_manager.cc:1403] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.202s	user 0.007s	sys 0.017s
I20260709 13:06:10.754719 21263 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.755209 21340 ts_tablet_manager.cc:1434] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 13:06:10.756129 21340 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Bootstrap starting.
I20260709 13:06:10.757349 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.757601 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:10.759734 21685 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.762588 21343 raft_consensus.cc:359] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.763247 21343 raft_consensus.cc:385] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.763526 21343 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.764370 21343 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.768193 21662 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.768692 21725 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.769187 21725 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:10.776859 21725 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:10.780047 21263 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.783011 21343 ts_tablet_manager.cc:1434] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:06:10.787171 21681 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:10.790856 21343 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.794713 21662 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:10.804813 21114 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:10.807013 21097 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:10.808131 21048 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.810339 21048 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.812952 21341 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:10.813894 21341 ts_tablet_manager.cc:1403] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.327s	user 0.021s	sys 0.000s
I20260709 13:06:10.816361 21341 raft_consensus.cc:359] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.816989 21341 raft_consensus.cc:385] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.817252 21341 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.818131 21340 tablet_bootstrap.cc:654] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.818794 21343 tablet_bootstrap.cc:654] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.817888 21341 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.823179 21341 ts_tablet_manager.cc:1434] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:10.825956 21047 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.827690 21341 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Bootstrap starting.
I20260709 13:06:10.835094 21341 tablet_bootstrap.cc:654] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.837930 21725 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.838388 21725 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.840449 21725 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.847479 21340 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: No bootstrap required, opened a new log
I20260709 13:06:10.848063 21340 ts_tablet_manager.cc:1403] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.004s
I20260709 13:06:10.854485 21341 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: No bootstrap required, opened a new log
I20260709 13:06:10.854998 21341 ts_tablet_manager.cc:1403] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 13:06:10.857630 21341 raft_consensus.cc:359] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.858381 21341 raft_consensus.cc:385] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.858673 21341 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.859359 21341 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.861579 21341 ts_tablet_manager.cc:1434] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:10.851151 21340 raft_consensus.cc:359] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.864341 21340 raft_consensus.cc:385] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.864648 21340 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.865641 21340 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.867221 21340 ts_tablet_manager.cc:1434] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:06:10.868829 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.869451 21146 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:10.869935 21226 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.871651 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:10.873121 21263 leader_election.cc:343] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.880741 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:10.881771 21725 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.882136 21725 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.882468 21725 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.889751 21343 tablet_bootstrap.cc:492] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.890192 21343 ts_tablet_manager.cc:1403] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.020s
I20260709 13:06:10.892807 21343 raft_consensus.cc:359] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.893611 21343 raft_consensus.cc:385] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.894034 21343 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.894867 21343 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.898130 21343 ts_tablet_manager.cc:1434] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:06:10.896025 21725 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.899431 21343 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.906513 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:10.907195 21221 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.907536 21343 tablet_bootstrap.cc:654] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.908771 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:10.909358 21146 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.920006 21725 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:10.921461 21221 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.922646 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:10.922967 21146 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:10.923506 21725 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.924199 21725 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:10.925043 21725 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.934904 21343 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:10.935457 21343 ts_tablet_manager.cc:1403] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.023s
I20260709 13:06:10.941308 21346 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.942353 21343 raft_consensus.cc:359] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.943023 21343 raft_consensus.cc:385] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.943528 21343 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.942982 21049 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.944162 21343 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.946244 21343 ts_tablet_manager.cc:1434] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:06:10.947077 21343 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:10.952302 21343 tablet_bootstrap.cc:654] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.960033 21377 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.963932 21661 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.964563 21661 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:10.970067 21326 tablet.cc:2406] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:10.972170 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:10.972935 21146 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 1: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:10.979354 21661 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:10.980830 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:10.983489 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:10.993181 21596 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.995373 21377 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.995843 21377 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:10.998200 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:11.004068 21596 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.003180 21377 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:11.005223 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:11.007169 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:11.007915 21545 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.008160 21343 tablet_bootstrap.cc:492] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:11.008641 21343 ts_tablet_manager.cc:1403] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.014s
I20260709 13:06:11.011103 21343 raft_consensus.cc:359] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.011672 21343 raft_consensus.cc:385] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.011894 21343 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.012756 21343 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.014393 21343 ts_tablet_manager.cc:1434] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:11.015695 21343 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:11.021674 21343 tablet_bootstrap.cc:654] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.022217 21226 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.027603 21343 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:11.028033 21343 ts_tablet_manager.cc:1403] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:06:11.030390 21343 raft_consensus.cc:359] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.031066 21343 raft_consensus.cc:385] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.031348 21343 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.031955 21343 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.033592 21343 ts_tablet_manager.cc:1434] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:11.034714 21343 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Bootstrap starting.
I20260709 13:06:11.039968 21343 tablet_bootstrap.cc:654] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.041138 21149 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.044698 21343 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: No bootstrap required, opened a new log
I20260709 13:06:11.045130 21343 ts_tablet_manager.cc:1403] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:06:11.047086 21343 raft_consensus.cc:359] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.047704 21343 raft_consensus.cc:385] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.047964 21343 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.048640 21343 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.050426 21343 ts_tablet_manager.cc:1434] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:11.063908 21346 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.064352 21346 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.066686 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:11.067210 21221 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:11.067363 21346 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:11.067556 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:11.068121 21298 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 0.
I20260709 13:06:11.068722 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:11.069598 21346 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.069911 21346 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.070230 21346 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.076498 21346 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.078452 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:11.078656 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:11.078949 21221 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.079193 21298 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.083619 21346 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:11.084365 21221 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:11.084537 21298 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:11.085335 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:11.086184 21346 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.086582 21346 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:11.087246 21346 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.095765 21047 catalog_manager.cc:5697] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.142309 21725 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.142761 21725 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.144454 21725 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:11.145117 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:11.145485 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:11.145706 21149 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:11.146275 21221 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 0.
I20260709 13:06:11.147081 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:11.147838 21725 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.148196 21725 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.148497 21725 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.154686 21725 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.156168 21725 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:11.156749 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:11.157056 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:11.157258 21149 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.157758 21226 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.161909 21514 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.162508 21226 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:11.162626 21149 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:11.163627 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:11.164728 21725 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.165194 21725 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:11.165973 21725 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:11.181869 21661 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.182643 21047 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.193293 21662 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.198062 21725 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.216907 21727 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.219364 21725 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.304605 21725 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.306825 21725 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.389873 21221 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.567001 21377 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.576974 21377 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.653546 21760 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:11.662989 21725 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:12.138135 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:12.165199 21767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.165233 21768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:12.165961 21770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:12.166620 20036 server_base.cc:1061] running on GCE node
I20260709 13:06:12.167958 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:12.168162 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:12.168363 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602372168348 us; error 0 us; skew 500 ppm
I20260709 13:06:12.168933 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:12.171850 20036 webserver.cc:533] Webserver started at http://127.19.145.4:33349/ using document root <none> and password file <none>
I20260709 13:06:12.172340 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:12.172559 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:12.172907 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:12.174286 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-3-root/instance:
uuid: "5e66e7254b764832b244bb5b07b4a208"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-cd6k"
I20260709 13:06:12.180217 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:06:12.184037 21775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.184800 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:06:12.185135 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
uuid: "5e66e7254b764832b244bb5b07b4a208"
format_stamp: "Formatted at 2026-07-09 13:06:12 on dist-test-slave-cd6k"
I20260709 13:06:12.185436 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:12.198696 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:12.200290 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:12.201917 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:12.204146 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:12.204346 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.204618 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:12.204798 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:12.278371 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.4:43709
I20260709 13:06:12.278469 21838 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.4:43709 every 8 connection(s)
I20260709 13:06:12.284207 20036 auto_leader_rebalancer-test.cc:384] add a tserver: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:12.299455 21839 heartbeater.cc:344] Connected to a master server at 127.19.145.62:44287
I20260709 13:06:12.299952 21839 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:12.300796 21839 heartbeater.cc:507] Master 127.19.145.62:44287 requested a full tablet report, sending...
I20260709 13:06:12.302896 21047 ts_manager.cc:194] Registered new tserver with Master: 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:12.304685 21047 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52726
I20260709 13:06:12.945241 21295 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:12.952142 21146 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.953552 21221 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.954023 21849 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.955461 21662 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:12.972263 21760 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:12.977267 21221 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:12.978900 21146 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:12.996439 21048 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:13.000804 21264 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fc65b57b7ce480581c0933f52538838. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.016752 21146 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.033085 21226 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.033515 21295 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.034579 21843 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.035820 21762 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.045190 21762 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.052340 21226 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.056842 21295 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:13.060292 21115 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33f9268b51e14a8d82c0377b1596e9ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.066817 21049 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.087571 21297 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.106412 21221 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:13.107352 21264 consensus_peers.cc:597] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ede0f4ec7554d9597f6e9c64ce23e46. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.107944 21849 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.109177 21150 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.110478 21849 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.116473 21662 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.120592 21221 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.122020 21150 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.132164 21297 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.135448 21048 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:13.141127 21264 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d142716765ff4750912c13d99d61a1df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.143237 21221 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.144105 21150 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.145960 21662 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:13.148592 21849 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.161002 21849 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.162506 21150 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.184906 21047 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.195648 21220 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:13.307299 21839 heartbeater.cc:499] Master 127.19.145.62:44287 was elected leader, sending a full tablet report...
I20260709 13:06:13.475873 21870 ts_tablet_manager.cc:933] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:13.478025 21870 tablet_copy_client.cc:323] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:13.505229 21310 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 2fc65b57b7ce480581c0933f52538838 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:13.505756 21310 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 2fc65b57b7ce480581c0933f52538838 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-2fc65b57b7ce480581c0933f52538838
I20260709 13:06:13.511305 21310 tablet_copy_source_session.cc:215] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.515352 21870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc65b57b7ce480581c0933f52538838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.531520 21870 tablet_copy_client.cc:806] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.532181 21870 tablet_copy_client.cc:670] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.536028 21870 tablet_copy_client.cc:538] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.545447 21870 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:13.568254 21870 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.569223 21870 tablet_bootstrap.cc:492] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:13.569907 21870 ts_tablet_manager.cc:1403] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:06:13.572842 21870 raft_consensus.cc:359] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.573715 21870 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:13.574409 21870 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.577235 21870 ts_tablet_manager.cc:1434] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:13.579079 21310 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-2fc65b57b7ce480581c0933f52538838 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:13.579571 21310 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-2fc65b57b7ce480581c0933f52538838 on tablet 2fc65b57b7ce480581c0933f52538838 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:13.634033 21870 ts_tablet_manager.cc:933] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:13.659600 21870 tablet_copy_client.cc:323] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:13.674834 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 33f9268b51e14a8d82c0377b1596e9ce from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:13.675386 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 33f9268b51e14a8d82c0377b1596e9ce from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-33f9268b51e14a8d82c0377b1596e9ce
I20260709 13:06:13.681087 21161 tablet_copy_source_session.cc:215] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.683992 21870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f9268b51e14a8d82c0377b1596e9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.692631 21880 ts_tablet_manager.cc:933] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:13.695920 21880 tablet_copy_client.cc:323] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:13.697461 21310 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet d142716765ff4750912c13d99d61a1df from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:13.697988 21310 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet d142716765ff4750912c13d99d61a1df from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-d142716765ff4750912c13d99d61a1df
I20260709 13:06:13.705171 21870 tablet_copy_client.cc:806] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.705389 21310 tablet_copy_source_session.cc:215] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.706149 21870 tablet_copy_client.cc:670] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.709700 21870 tablet_copy_client.cc:538] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.710844 21880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d142716765ff4750912c13d99d61a1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.722389 21870 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:13.728169 21882 ts_tablet_manager.cc:933] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:13.742396 21882 tablet_copy_client.cc:323] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:13.744202 21310 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:13.744712 21310 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 0ede0f4ec7554d9597f6e9c64ce23e46 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-0ede0f4ec7554d9597f6e9c64ce23e46
I20260709 13:06:13.751649 21310 tablet_copy_source_session.cc:215] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.754944 21882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ede0f4ec7554d9597f6e9c64ce23e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.772410 21882 tablet_copy_client.cc:806] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.778946 21882 tablet_copy_client.cc:670] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.795094 21882 tablet_copy_client.cc:538] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.795619 21870 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.797123 21870 tablet_bootstrap.cc:492] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:13.798962 21880 tablet_copy_client.cc:806] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.799580 21880 tablet_copy_client.cc:670] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.799857 21870 ts_tablet_manager.cc:1403] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.005s
I20260709 13:06:13.806070 21880 tablet_copy_client.cc:538] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.808974 21870 raft_consensus.cc:359] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.813623 21870 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:13.814353 21870 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.817394 21882 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:13.820266 21870 ts_tablet_manager.cc:1434] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:06:13.822734 21880 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:13.822814 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-33f9268b51e14a8d82c0377b1596e9ce received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:13.823439 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-33f9268b51e14a8d82c0377b1596e9ce on tablet 33f9268b51e14a8d82c0377b1596e9ce with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:13.861088 21882 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.861380 21880 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.861991 21882 tablet_bootstrap.cc:492] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:13.862190 21880 tablet_bootstrap.cc:492] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:13.862728 21882 ts_tablet_manager.cc:1403] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.011s
I20260709 13:06:13.862772 21880 ts_tablet_manager.cc:1403] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.010s
I20260709 13:06:13.869102 21882 raft_consensus.cc:359] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.864200 21814 raft_consensus.cc:1217] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.870024 21882 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:13.871948 21880 raft_consensus.cc:359] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.870962 21882 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.873932 21880 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:13.874598 21880 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:13.875710 21882 ts_tablet_manager.cc:1434] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:06:13.878582 21880 ts_tablet_manager.cc:1434] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:13.881924 21310 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-0ede0f4ec7554d9597f6e9c64ce23e46 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:13.882375 21310 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-0ede0f4ec7554d9597f6e9c64ce23e46 on tablet 0ede0f4ec7554d9597f6e9c64ce23e46 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:13.883003 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-d142716765ff4750912c13d99d61a1df received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:13.883430 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-d142716765ff4750912c13d99d61a1df on tablet d142716765ff4750912c13d99d61a1df with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:14.089583 21814 raft_consensus.cc:1217] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.130507 21814 raft_consensus.cc:1217] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.247537 21814 raft_consensus.cc:1217] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.414834 21760 raft_consensus.cc:1064] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:14.416972 21760 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.422905 21814 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.424530 21221 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.424533 21146 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.424635 21760 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.426113 21891 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.427034 21890 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.450523 21890 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.457630 21146 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.491715 21814 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.493988 21047 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.510038 21221 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.525386 21297 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.537765 21814 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.538435 21150 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.539592 21760 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.541874 21760 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.547505 21890 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.550962 21150 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.551673 21814 raft_consensus.cc:2955] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.565213 21048 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.572094 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fc65b57b7ce480581c0933f52538838 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.580447 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc65b57b7ce480581c0933f52538838 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:14.594007 21901 tablet_replica.cc:333] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:14.595001 21901 raft_consensus.cc:2243] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.595750 21901 raft_consensus.cc:2272] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.599241 21901 ts_tablet_manager.cc:1916] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.613246 21901 ts_tablet_manager.cc:1929] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.613687 21901 log.cc:1199] T 2fc65b57b7ce480581c0933f52538838 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/2fc65b57b7ce480581c0933f52538838
I20260709 13:06:14.615324 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 2fc65b57b7ce480581c0933f52538838 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:14.620877 21890 raft_consensus.cc:1064] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:14.623584 21890 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.630471 21226 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.630613 21814 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.632118 21150 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.632097 21891 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.633682 21890 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.635588 21891 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.655226 21890 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.657351 21226 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.670320 21814 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.671921 21146 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.671952 21048 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.710407 21297 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.715039 21814 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.715301 21146 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.716144 21890 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.718024 21891 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.728176 21760 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.742782 21863 raft_consensus.cc:1064] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:14.744907 21863 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.756696 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d142716765ff4750912c13d99d61a1df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.756302 21813 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.748996 21146 raft_consensus.cc:2955] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.767899 21048 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.774412 21814 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.775926 21843 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.779172 21221 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.786741 21297 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.788388 21885 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.790947 21885 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:14.813876 21760 raft_consensus.cc:1064] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:14.816406 21760 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.820044 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet d142716765ff4750912c13d99d61a1df with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:14.820930 21901 tablet_replica.cc:333] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:14.822474 21906 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.828723 21221 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.830152 21297 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.855753 21901 raft_consensus.cc:2243] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.856501 21901 raft_consensus.cc:2272] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.859619 21901 ts_tablet_manager.cc:1916] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.859022 21813 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.868355 21047 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.881877 21813 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.882603 21901 ts_tablet_manager.cc:1929] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.883035 21901 log.cc:1199] T d142716765ff4750912c13d99d61a1df P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/d142716765ff4750912c13d99d61a1df
I20260709 13:06:14.883510 21891 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.885658 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet d142716765ff4750912c13d99d61a1df (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:14.892908 21149 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:14.901921 21813 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.902216 21226 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.903226 21885 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.906260 21149 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.906261 21906 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:14.913781 21226 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.913859 21891 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.915565 21885 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.923763 21890 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.931147 21812 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.935518 21049 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.938259 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33f9268b51e14a8d82c0377b1596e9ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.953572 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f9268b51e14a8d82c0377b1596e9ce with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:14.956032 21226 raft_consensus.cc:2955] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.962855 21891 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.976907 21917 tablet_replica.cc:333] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:14.978384 21917 raft_consensus.cc:2243] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.979056 21917 raft_consensus.cc:2272] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.983151 21917 ts_tablet_manager.cc:1916] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.991791 21812 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:14.987819 21146 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.000391 21048 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.992002 21226 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.017756 21917 ts_tablet_manager.cc:1929] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.018277 21917 log.cc:1199] T 33f9268b51e14a8d82c0377b1596e9ce P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/33f9268b51e14a8d82c0377b1596e9ce
I20260709 13:06:15.020244 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 33f9268b51e14a8d82c0377b1596e9ce (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:15.024165 21297 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:15.029870 21812 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.031433 21891 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.032595 21221 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.037168 21889 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:15.040302 21891 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.041831 21814 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.064314 21047 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.072799 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.074914 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ede0f4ec7554d9597f6e9c64ce23e46 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:15.075145 21221 raft_consensus.cc:2955] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:15.092681 21918 tablet_replica.cc:333] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:15.093683 21918 raft_consensus.cc:2243] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.094743 21918 raft_consensus.cc:2272] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.097724 21918 ts_tablet_manager.cc:1916] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.109278 21918 ts_tablet_manager.cc:1929] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.109540 21918 log.cc:1199] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/0ede0f4ec7554d9597f6e9c64ce23e46
I20260709 13:06:15.110826 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 0ede0f4ec7554d9597f6e9c64ce23e46 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:16.143009 21146 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.148679 21221 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:16.148888 21115 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99d11247a80d4fb5b4034e0a238c9388. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.148922 21297 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.149986 21920 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.150707 21885 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.157982 21885 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.159461 21297 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.160030 21221 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.174540 21048 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.198383 21226 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.206357 21146 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.207650 21298 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.208863 21876 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.209949 21919 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.223240 21919 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:16.224265 21190 consensus_peers.cc:597] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c22f29b50b474596adeb0f179b9eb385. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.226596 21298 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.228160 21146 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.235833 21226 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.243515 21049 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:16.254405 21190 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17378a57c1c3434a8411ab6894114acb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.255658 21295 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.256862 21146 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.259600 21876 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.267988 21940 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.283743 21939 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.286499 21297 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.311728 21149 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.314189 21047 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.327744 21146 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:16.334509 21115 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 217f5315ea524ce28a596c2aa95cb43f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.351176 21295 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.353600 21220 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.361841 21920 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.362721 21946 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.378206 21920 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.378929 21221 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.395452 21049 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.408888 21295 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:16.605499 21950 ts_tablet_manager.cc:933] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:16.608325 21950 tablet_copy_client.cc:323] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:16.609747 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 99d11247a80d4fb5b4034e0a238c9388 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:16.610271 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 99d11247a80d4fb5b4034e0a238c9388 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-99d11247a80d4fb5b4034e0a238c9388
I20260709 13:06:16.618873 21161 tablet_copy_source_session.cc:215] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.622208 21950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d11247a80d4fb5b4034e0a238c9388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.635082 21950 tablet_copy_client.cc:806] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.635627 21950 tablet_copy_client.cc:670] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.638980 21950 tablet_copy_client.cc:538] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.644512 21950 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:16.664680 21950 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.665666 21950 tablet_bootstrap.cc:492] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:16.666581 21950 ts_tablet_manager.cc:1403] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.007s
I20260709 13:06:16.669965 21950 raft_consensus.cc:359] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.670830 21950 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:16.675855 21950 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.684072 21950 ts_tablet_manager.cc:1434] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:06:16.686959 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-99d11247a80d4fb5b4034e0a238c9388 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:16.687453 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-99d11247a80d4fb5b4034e0a238c9388 on tablet 99d11247a80d4fb5b4034e0a238c9388 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:16.708294 21950 ts_tablet_manager.cc:933] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:16.710325 21950 tablet_copy_client.cc:323] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:16.733826 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet c22f29b50b474596adeb0f179b9eb385 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:16.734408 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet c22f29b50b474596adeb0f179b9eb385 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-c22f29b50b474596adeb0f179b9eb385
I20260709 13:06:16.741705 21236 tablet_copy_source_session.cc:215] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.742736 21957 ts_tablet_manager.cc:933] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:16.745332 21950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22f29b50b474596adeb0f179b9eb385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.745388 21957 tablet_copy_client.cc:323] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:16.747177 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 17378a57c1c3434a8411ab6894114acb from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:16.747716 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 17378a57c1c3434a8411ab6894114acb from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-17378a57c1c3434a8411ab6894114acb
I20260709 13:06:16.754433 21236 tablet_copy_source_session.cc:215] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.759423 21957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17378a57c1c3434a8411ab6894114acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.762720 21950 tablet_copy_client.cc:806] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.763343 21950 tablet_copy_client.cc:670] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.766750 21950 tablet_copy_client.cc:538] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.773394 21957 tablet_copy_client.cc:806] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.773950 21957 tablet_copy_client.cc:670] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.774933 21950 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:16.779178 21957 tablet_copy_client.cc:538] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.788039 21957 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:16.801309 21950 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.802165 21950 tablet_bootstrap.cc:492] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:16.803965 21950 ts_tablet_manager.cc:1403] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:06:16.806720 21950 raft_consensus.cc:359] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.808058 21950 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:16.808665 21950 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.811890 21950 ts_tablet_manager.cc:1434] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:16.815160 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-c22f29b50b474596adeb0f179b9eb385 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:16.815577 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-c22f29b50b474596adeb0f179b9eb385 on tablet c22f29b50b474596adeb0f179b9eb385 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:16.821362 21957 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.822261 21957 tablet_bootstrap.cc:492] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:16.822906 21957 ts_tablet_manager.cc:1403] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.001s
I20260709 13:06:16.825594 21957 raft_consensus.cc:359] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.826257 21957 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:16.826896 21957 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:16.829392 21957 ts_tablet_manager.cc:1434] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:16.830976 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-17378a57c1c3434a8411ab6894114acb received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:16.831368 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-17378a57c1c3434a8411ab6894114acb on tablet 17378a57c1c3434a8411ab6894114acb with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:16.929304 21957 ts_tablet_manager.cc:933] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:16.943476 21957 tablet_copy_client.cc:323] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:16.945050 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 217f5315ea524ce28a596c2aa95cb43f from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:16.945564 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 217f5315ea524ce28a596c2aa95cb43f from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-217f5315ea524ce28a596c2aa95cb43f
I20260709 13:06:16.952739 21161 tablet_copy_source_session.cc:215] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.955825 21957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217f5315ea524ce28a596c2aa95cb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.973295 21957 tablet_copy_client.cc:806] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.973845 21957 tablet_copy_client.cc:670] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.979167 21957 tablet_copy_client.cc:538] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.987927 21957 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:17.011197 21957 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.012051 21957 tablet_bootstrap.cc:492] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:17.012694 21957 ts_tablet_manager.cc:1403] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:06:17.015543 21957 raft_consensus.cc:359] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:17.016366 21957 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:17.016971 21957 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:17.019289 21957 ts_tablet_manager.cc:1434] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:17.021344 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-217f5315ea524ce28a596c2aa95cb43f received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:17.021739 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-217f5315ea524ce28a596c2aa95cb43f on tablet 217f5315ea524ce28a596c2aa95cb43f with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:17.058672 21814 raft_consensus.cc:1217] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.104616 21814 raft_consensus.cc:1217] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.244760 21814 raft_consensus.cc:1217] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.466010 21814 raft_consensus.cc:1217] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.494956 21947 raft_consensus.cc:1064] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:17.497493 21947 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.515555 21814 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.515800 21297 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.517958 21963 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.519387 21920 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.522342 21221 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.524446 21947 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.552587 21814 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.550442 21963 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.556699 21297 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.565341 21047 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.591112 21221 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.637012 21146 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.646262 21814 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.646817 21221 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.647761 21963 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.648924 21969 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.656142 21947 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.657992 21814 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.668355 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99d11247a80d4fb5b4034e0a238c9388 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.669149 21221 raft_consensus.cc:2955] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.675310 21046 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.685323 21941 raft_consensus.cc:1064] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:17.687901 21941 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.694062 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 99d11247a80d4fb5b4034e0a238c9388 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:17.700673 21812 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.702842 21974 tablet_replica.cc:333] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:17.703845 21295 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.703959 21974 raft_consensus.cc:2243] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.704741 21974 raft_consensus.cc:2272] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.705808 21941 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.707064 21146 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.707435 21939 raft_consensus.cc:1064] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:17.708665 21937 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.710474 21937 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.711980 21939 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.719640 21974 ts_tablet_manager.cc:1916] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.743656 21812 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.745450 21937 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.750103 21295 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.757876 21941 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.760907 21937 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.766986 21149 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.784416 21941 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.791467 21046 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.814301 21298 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.789572 21974 ts_tablet_manager.cc:1929] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.784631 21295 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.820305 21814 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.803113 21149 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.838116 21974 log.cc:1199] T 99d11247a80d4fb5b4034e0a238c9388 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/99d11247a80d4fb5b4034e0a238c9388
I20260709 13:06:17.864362 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 99d11247a80d4fb5b4034e0a238c9388 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:17.868419 21986 raft_consensus.cc:1064] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:17.870955 21986 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.878448 21985 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.878886 21046 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.921371 21221 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:17.911168 21814 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.927917 21146 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.931205 21812 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.932660 21812 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.932813 21969 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.934549 21941 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.946671 21985 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.948437 21295 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.950883 21947 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.948433 21813 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.963449 21226 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.969324 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c22f29b50b474596adeb0f179b9eb385 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.971150 21295 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.973843 21983 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.978953 21969 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.979017 21295 raft_consensus.cc:2955] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:17.989065 21049 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.992666 21969 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.006098 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet c22f29b50b474596adeb0f179b9eb385 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:18.009366 21813 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.016324 21220 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.024308 21992 tablet_replica.cc:333] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:18.025238 21992 raft_consensus.cc:2243] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.025871 21992 raft_consensus.cc:2272] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.026916 21047 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.998162 21295 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.049086 21146 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:18.054596 21992 ts_tablet_manager.cc:1916] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.077091 21992 ts_tablet_manager.cc:1929] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.077466 21992 log.cc:1199] T c22f29b50b474596adeb0f179b9eb385 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/c22f29b50b474596adeb0f179b9eb385
I20260709 13:06:18.079161 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet c22f29b50b474596adeb0f179b9eb385 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:18.081705 21295 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.081845 21813 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.082849 21969 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.084748 21947 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.090651 21969 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.098512 21295 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.099764 21813 raft_consensus.cc:2955] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.104929 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 217f5315ea524ce28a596c2aa95cb43f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.112941 21047 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.128183 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 217f5315ea524ce28a596c2aa95cb43f with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:18.141530 21993 tablet_replica.cc:333] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:18.145738 21993 raft_consensus.cc:2243] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.146664 21993 raft_consensus.cc:2272] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.153105 21993 ts_tablet_manager.cc:1916] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.163695 21993 ts_tablet_manager.cc:1929] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.164090 21993 log.cc:1199] T 217f5315ea524ce28a596c2aa95cb43f P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/217f5315ea524ce28a596c2aa95cb43f
I20260709 13:06:18.165655 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 217f5315ea524ce28a596c2aa95cb43f (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:18.488296 21220 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:18.578033 21150 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.596377 21813 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.621833 21985 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:18.624784 21983 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.641837 21983 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.644348 21150 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:18.661149 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17378a57c1c3434a8411ab6894114acb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.684223 21813 raft_consensus.cc:2955] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:06:18.690285 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 87912.4us
I20260709 13:06:18.722947 21047 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.791993 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 17378a57c1c3434a8411ab6894114acb with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:18.795014 22006 tablet_replica.cc:333] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:18.796823 22006 raft_consensus.cc:2243] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.798187 22006 raft_consensus.cc:2272] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.804970 22006 ts_tablet_manager.cc:1916] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.816009 22006 ts_tablet_manager.cc:1929] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.816426 22006 log.cc:1199] T 17378a57c1c3434a8411ab6894114acb P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/17378a57c1c3434a8411ab6894114acb
I20260709 13:06:18.818575 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 17378a57c1c3434a8411ab6894114acb (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:19.868170 21220 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:06:19.874511 21190 consensus_peers.cc:597] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 605603ac2631443292cd7278cf055b51. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.874982 21297 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.875128 21150 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.876401 21937 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.877100 21983 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.886370 21937 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.888082 21297 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.891744 21150 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.903829 21149 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:19.905189 21049 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.920652 21226 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.923651 21963 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.925685 21297 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.927908 22014 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:19.938175 21115 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa95e198a0404e91adecdec5338443a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.943769 22007 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.955654 21222 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.971931 21297 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:19.975642 21220 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:19.996222 21047 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:20.008028 21190 consensus_peers.cc:597] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08a13eedafd74dabb8f0219f4c7e9288. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.013330 21297 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.014037 21149 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.014848 21937 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.016347 22012 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:20.029942 21983 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.032704 21150 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.047904 21150 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.052278 21291 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.053913 21047 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.057229 21220 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:20.057734 21115 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2308648f35c4faf94816331179c44aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.058570 21963 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.065586 21297 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.068890 21963 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.084437 22022 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.085722 21220 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.087747 21298 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:20.103294 21047 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.312889 22031 ts_tablet_manager.cc:933] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:20.314654 22031 tablet_copy_client.cc:323] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:20.316584 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 605603ac2631443292cd7278cf055b51 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:20.317026 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 605603ac2631443292cd7278cf055b51 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-605603ac2631443292cd7278cf055b51
I20260709 13:06:20.322268 21236 tablet_copy_source_session.cc:215] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.325026 22031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605603ac2631443292cd7278cf055b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.339361 22031 tablet_copy_client.cc:806] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.340013 22031 tablet_copy_client.cc:670] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.343726 22031 tablet_copy_client.cc:538] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.352253 22031 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:20.373575 22031 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.374483 22031 tablet_bootstrap.cc:492] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:20.375222 22031 ts_tablet_manager.cc:1403] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.013s
I20260709 13:06:20.378383 22031 raft_consensus.cc:359] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.379233 22031 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:20.379956 22031 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.398237 22031 ts_tablet_manager.cc:1434] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:06:20.400188 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-605603ac2631443292cd7278cf055b51 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:20.400663 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-605603ac2631443292cd7278cf055b51 on tablet 605603ac2631443292cd7278cf055b51 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:20.462045 22031 ts_tablet_manager.cc:933] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:20.463742 22031 tablet_copy_client.cc:323] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:20.465373 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet aa95e198a0404e91adecdec5338443a0 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:20.465816 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet aa95e198a0404e91adecdec5338443a0 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-aa95e198a0404e91adecdec5338443a0
I20260709 13:06:20.471208 21161 tablet_copy_source_session.cc:215] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.474181 22031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa95e198a0404e91adecdec5338443a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.486539 22031 tablet_copy_client.cc:806] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.487157 22031 tablet_copy_client.cc:670] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.490777 22031 tablet_copy_client.cc:538] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.497697 22031 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:20.516738 22031 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.517524 22031 tablet_bootstrap.cc:492] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:20.518157 22031 ts_tablet_manager.cc:1403] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:06:20.520922 22031 raft_consensus.cc:359] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.521533 22031 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:20.522153 22031 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.524631 22037 ts_tablet_manager.cc:933] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:20.525377 22031 ts_tablet_manager.cc:1434] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:20.527494 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-aa95e198a0404e91adecdec5338443a0 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:20.527921 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-aa95e198a0404e91adecdec5338443a0 on tablet aa95e198a0404e91adecdec5338443a0 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:20.530654 22037 tablet_copy_client.cc:323] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:20.532351 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 08a13eedafd74dabb8f0219f4c7e9288 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:20.532851 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 08a13eedafd74dabb8f0219f4c7e9288 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-08a13eedafd74dabb8f0219f4c7e9288
I20260709 13:06:20.538410 21236 tablet_copy_source_session.cc:215] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.541448 22037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a13eedafd74dabb8f0219f4c7e9288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.556814 22037 tablet_copy_client.cc:806] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.557372 22037 tablet_copy_client.cc:670] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.560545 22037 tablet_copy_client.cc:538] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.572530 22037 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:20.591979 22037 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.592715 22037 tablet_bootstrap.cc:492] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:20.593349 22037 ts_tablet_manager.cc:1403] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:06:20.596094 22031 ts_tablet_manager.cc:933] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:20.596499 22037 raft_consensus.cc:359] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.597483 22037 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:20.597836 22031 tablet_copy_client.cc:323] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:20.598218 22037 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.599532 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet c2308648f35c4faf94816331179c44aa from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:20.600046 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet c2308648f35c4faf94816331179c44aa from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-c2308648f35c4faf94816331179c44aa
I20260709 13:06:20.605999 22037 ts_tablet_manager.cc:1434] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:20.606317 21161 tablet_copy_source_session.cc:215] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.608589 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-08a13eedafd74dabb8f0219f4c7e9288 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:20.609019 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-08a13eedafd74dabb8f0219f4c7e9288 on tablet 08a13eedafd74dabb8f0219f4c7e9288 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:20.609651 22031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2308648f35c4faf94816331179c44aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.621282 22031 tablet_copy_client.cc:806] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.622192 22031 tablet_copy_client.cc:670] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.625810 22031 tablet_copy_client.cc:538] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.632185 22031 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:20.650455 22031 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.651418 22031 tablet_bootstrap.cc:492] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:20.652104 22031 ts_tablet_manager.cc:1403] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:06:20.655900 22031 raft_consensus.cc:359] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.656464 22031 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:20.657174 22031 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:20.659236 22031 ts_tablet_manager.cc:1434] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:20.663801 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-c2308648f35c4faf94816331179c44aa received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:20.664201 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-c2308648f35c4faf94816331179c44aa on tablet c2308648f35c4faf94816331179c44aa with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:20.757990 21813 raft_consensus.cc:1217] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.065104 21813 raft_consensus.cc:1217] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.105504 21813 raft_consensus.cc:1217] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.166414 21937 raft_consensus.cc:1064] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:21.168572 21937 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.182917 21813 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.185304 22027 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.188519 21291 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.196064 22045 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:21.204206 21149 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.217657 21937 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.208143 21813 raft_consensus.cc:1217] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.226572 21291 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.225020 21937 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.248867 21047 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.256210 21813 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.253064 21149 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.299791 21220 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.306161 21812 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.307401 21291 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.308612 21983 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.309492 21937 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.315760 22045 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.317184 21291 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.334574 21046 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.323962 21812 raft_consensus.cc:2955] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.337461 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 605603ac2631443292cd7278cf055b51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.354352 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 605603ac2631443292cd7278cf055b51 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:21.374287 22053 tablet_replica.cc:333] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:21.375562 22053 raft_consensus.cc:2243] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.376296 22053 raft_consensus.cc:2272] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.379869 22053 ts_tablet_manager.cc:1916] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.395751 22053 ts_tablet_manager.cc:1929] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.396109 22053 log.cc:1199] T 605603ac2631443292cd7278cf055b51 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/605603ac2631443292cd7278cf055b51
I20260709 13:06:21.397497 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 605603ac2631443292cd7278cf055b51 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:21.564159 21963 raft_consensus.cc:1064] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:21.566390 21963 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.572644 21298 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.573751 21963 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.574035 21812 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.575525 22043 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.576105 21220 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.582695 21963 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.593360 22045 raft_consensus.cc:1064] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:21.596240 22045 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.608610 21814 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.610653 21149 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.610653 21298 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.612146 22045 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.613068 21937 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.616295 22043 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.626456 21983 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.627332 21812 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.637719 21046 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.641441 21298 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.649149 21220 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.668529 21937 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.674225 21149 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.685262 21146 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.689093 21298 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.698344 21814 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.710110 21049 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.711472 21812 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.714324 22022 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.730440 21221 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.733696 21226 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.735554 22022 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.739882 21963 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.745087 21226 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.748021 21812 raft_consensus.cc:2955] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.758397 21813 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.759339 21291 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.759895 21937 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.760748 22045 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.768141 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa95e198a0404e91adecdec5338443a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.777917 22027 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.785175 21812 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.793107 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08a13eedafd74dabb8f0219f4c7e9288 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.788667 21049 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.811980 21963 raft_consensus.cc:1064] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:21.813328 21298 raft_consensus.cc:2955] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.814267 21963 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.823514 21046 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.825814 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet aa95e198a0404e91adecdec5338443a0 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:21.835495 22067 tablet_replica.cc:333] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:21.837631 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 08a13eedafd74dabb8f0219f4c7e9288 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:21.838585 22053 tablet_replica.cc:333] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:21.839708 22053 raft_consensus.cc:2243] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.840327 22053 raft_consensus.cc:2272] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.844060 22067 raft_consensus.cc:2243] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.846112 22053 ts_tablet_manager.cc:1916] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.847898 22067 raft_consensus.cc:2272] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.853637 21811 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.855300 21221 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.856889 22043 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.859138 22067 ts_tablet_manager.cc:1916] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.858860 22043 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.868788 22053 ts_tablet_manager.cc:1929] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.869267 22053 log.cc:1199] T 08a13eedafd74dabb8f0219f4c7e9288 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/08a13eedafd74dabb8f0219f4c7e9288
I20260709 13:06:21.871307 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 08a13eedafd74dabb8f0219f4c7e9288 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:21.874266 21298 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.877156 21963 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.886660 22067 ts_tablet_manager.cc:1929] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.893411 22067 log.cc:1199] T aa95e198a0404e91adecdec5338443a0 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/aa95e198a0404e91adecdec5338443a0
I20260709 13:06:21.897070 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet aa95e198a0404e91adecdec5338443a0 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:21.918215 22043 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.921129 21298 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.922051 21811 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.933722 21226 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.954517 21047 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.980949 21146 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:21.986239 21811 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.987516 21963 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.988070 21298 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.993820 21963 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:21.996178 21811 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:22.000725 22058 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:22.005192 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2308648f35c4faf94816331179c44aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:22.012677 21297 raft_consensus.cc:2955] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:22.013000 21048 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:22.024542 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet c2308648f35c4faf94816331179c44aa with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:22.026562 22072 tablet_replica.cc:333] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:22.033980 22072 raft_consensus.cc:2243] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:22.034804 22072 raft_consensus.cc:2272] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:22.037535 22072 ts_tablet_manager.cc:1916] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:22.048828 22072 ts_tablet_manager.cc:1929] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:22.049103 22072 log.cc:1199] T c2308648f35c4faf94816331179c44aa P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/c2308648f35c4faf94816331179c44aa
I20260709 13:06:22.050405 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet c2308648f35c4faf94816331179c44aa (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:23.095391 21297 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.101414 21221 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:23.104076 21264 consensus_peers.cc:597] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe2e5a8d491c4a22ac81fce79a27a7ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.104175 21146 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.104216 22076 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.105866 22074 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.112843 22064 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.114015 21221 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.122418 21146 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.128736 21297 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.129930 21048 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:23.141263 21264 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef66c45b466e4acb83723f82bb2be36e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.142315 21146 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.142505 21221 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.144433 22076 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.146665 22064 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.158552 22074 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.169073 21149 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.169456 21226 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.187995 21146 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.189311 21049 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.203491 21297 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.206472 22073 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:23.210278 21115 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a837dff96224f8b8795bace63448d84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.210449 21226 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.211849 22073 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.226548 22073 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.228755 21297 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.229816 21226 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.241900 21149 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.242815 21048 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.249724 21297 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:23.249747 21115 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 797a6a3b284c4ce2b664a3f7e63dfb7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.249805 21226 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.251134 22071 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.252169 22073 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.261519 22073 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.263569 21297 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.274912 21220 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.313361 21047 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:23.574409 22097 ts_tablet_manager.cc:933] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:23.576409 22097 tablet_copy_client.cc:323] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:23.578357 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet ef66c45b466e4acb83723f82bb2be36e from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:23.578923 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet ef66c45b466e4acb83723f82bb2be36e from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-ef66c45b466e4acb83723f82bb2be36e
I20260709 13:06:23.586509 21309 tablet_copy_source_session.cc:215] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.589749 22097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66c45b466e4acb83723f82bb2be36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.612838 22097 tablet_copy_client.cc:806] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.613507 22097 tablet_copy_client.cc:670] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.616876 22097 tablet_copy_client.cc:538] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.625588 22097 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:23.642402 22099 ts_tablet_manager.cc:933] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:23.653623 22097 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.654583 22097 tablet_bootstrap.cc:492] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:23.655297 22097 ts_tablet_manager.cc:1403] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:06:23.660266 22097 raft_consensus.cc:359] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.661113 22097 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:23.661792 22097 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.672016 22099 tablet_copy_client.cc:323] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:23.672864 22097 ts_tablet_manager.cc:1434] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:06:23.674345 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 7a837dff96224f8b8795bace63448d84 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:23.675004 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-ef66c45b466e4acb83723f82bb2be36e received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:23.674952 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 7a837dff96224f8b8795bace63448d84 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-7a837dff96224f8b8795bace63448d84
I20260709 13:06:23.675550 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-ef66c45b466e4acb83723f82bb2be36e on tablet ef66c45b466e4acb83723f82bb2be36e with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:23.684499 21161 tablet_copy_source_session.cc:215] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.687855 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a837dff96224f8b8795bace63448d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.707026 22099 tablet_copy_client.cc:806] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.707655 22099 tablet_copy_client.cc:670] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.710209 22097 ts_tablet_manager.cc:933] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:23.711845 22099 tablet_copy_client.cc:538] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.715992 22097 tablet_copy_client.cc:323] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:23.717657 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet fe2e5a8d491c4a22ac81fce79a27a7ea from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:23.718176 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet fe2e5a8d491c4a22ac81fce79a27a7ea from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-fe2e5a8d491c4a22ac81fce79a27a7ea
I20260709 13:06:23.720546 22099 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:23.735824 21309 tablet_copy_source_session.cc:215] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.740635 22097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2e5a8d491c4a22ac81fce79a27a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.753952 22099 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.754992 22099 tablet_bootstrap.cc:492] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:23.755734 22099 ts_tablet_manager.cc:1403] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.012s
I20260709 13:06:23.756408 22097 tablet_copy_client.cc:806] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.757038 22097 tablet_copy_client.cc:670] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.758934 22099 raft_consensus.cc:359] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.759873 22099 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:23.760800 22097 tablet_copy_client.cc:538] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.760596 22099 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.763688 22099 ts_tablet_manager.cc:1434] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:23.769074 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-7a837dff96224f8b8795bace63448d84 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:23.769500 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-7a837dff96224f8b8795bace63448d84 on tablet 7a837dff96224f8b8795bace63448d84 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:23.769814 22097 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:23.780211 22105 ts_tablet_manager.cc:933] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:23.796864 22105 tablet_copy_client.cc:323] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:23.799165 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:23.799688 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 797a6a3b284c4ce2b664a3f7e63dfb7e from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-797a6a3b284c4ce2b664a3f7e63dfb7e
I20260709 13:06:23.803586 22097 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.804540 22097 tablet_bootstrap.cc:492] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:23.805352 22097 ts_tablet_manager.cc:1403] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.012s
I20260709 13:06:23.809731 22097 raft_consensus.cc:359] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.810530 22097 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:23.811136 22097 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.812808 21161 tablet_copy_source_session.cc:215] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.816593 22097 ts_tablet_manager.cc:1434] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:23.816654 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.819221 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-fe2e5a8d491c4a22ac81fce79a27a7ea received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:23.819638 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-fe2e5a8d491c4a22ac81fce79a27a7ea on tablet fe2e5a8d491c4a22ac81fce79a27a7ea with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:23.839818 22105 tablet_copy_client.cc:806] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.840535 22105 tablet_copy_client.cc:670] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.844535 22105 tablet_copy_client.cc:538] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.851722 22105 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:23.869313 22105 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.870100 22105 tablet_bootstrap.cc:492] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:23.870635 22105 ts_tablet_manager.cc:1403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:06:23.872920 22105 raft_consensus.cc:359] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.873736 22105 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:23.874404 22105 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:23.876946 22105 ts_tablet_manager.cc:1434] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:06:23.880285 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-797a6a3b284c4ce2b664a3f7e63dfb7e received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:23.880689 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-797a6a3b284c4ce2b664a3f7e63dfb7e on tablet 797a6a3b284c4ce2b664a3f7e63dfb7e with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:24.064375 21812 raft_consensus.cc:1217] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.099123 21812 raft_consensus.cc:1217] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.262179 21812 raft_consensus.cc:1217] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.296701 21812 raft_consensus.cc:1217] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.506332 22110 raft_consensus.cc:1064] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:24.508857 22110 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.515502 21812 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.515625 21291 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.517020 22073 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.517421 21222 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.518180 22110 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.519023 22071 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.539474 22073 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.541381 21222 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.544370 21291 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.568132 22074 raft_consensus.cc:1064] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:24.572410 22074 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.576839 21048 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.580287 21812 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.588428 21811 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.588997 21222 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.590070 22064 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.590966 22109 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.596995 21150 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.598284 22064 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.632795 22064 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.639186 21150 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.641215 21812 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.651991 21222 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.672200 21150 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.674727 21047 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.694329 21811 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.696398 22095 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.706471 21226 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.711519 22115 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.716643 22116 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.716944 21812 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.727669 21291 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.735839 21221 raft_consensus.cc:2955] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.740393 21811 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.741885 22109 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.747035 21047 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.748219 21149 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.749377 22064 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.751075 22074 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.765756 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef66c45b466e4acb83723f82bb2be36e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.766314 21812 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.777112 21149 raft_consensus.cc:2955] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.788581 21049 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.790571 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a837dff96224f8b8795bace63448d84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.792527 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a837dff96224f8b8795bace63448d84 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:24.805066 22128 tablet_replica.cc:333] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:24.806083 22128 raft_consensus.cc:2243] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.806741 22128 raft_consensus.cc:2272] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.821151 22128 ts_tablet_manager.cc:1916] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.821676 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet ef66c45b466e4acb83723f82bb2be36e with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:24.823853 22129 tablet_replica.cc:333] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:24.824896 22129 raft_consensus.cc:2243] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.825652 22129 raft_consensus.cc:2272] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.829432 22127 raft_consensus.cc:1064] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:24.835861 22129 ts_tablet_manager.cc:1916] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.837036 22127 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.838340 22128 ts_tablet_manager.cc:1929] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:24.838819 22128 log.cc:1199] T 7a837dff96224f8b8795bace63448d84 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/7a837dff96224f8b8795bace63448d84
I20260709 13:06:24.840603 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 7a837dff96224f8b8795bace63448d84 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:24.846692 21812 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.848352 21297 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.848363 22095 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.849915 22115 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.858281 22129 ts_tablet_manager.cc:1929] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:24.858794 22129 log.cc:1199] T ef66c45b466e4acb83723f82bb2be36e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/ef66c45b466e4acb83723f82bb2be36e
I20260709 13:06:24.860671 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet ef66c45b466e4acb83723f82bb2be36e (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:24.862682 21221 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.864181 22095 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.870353 22127 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.874984 21297 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.899740 22126 raft_consensus.cc:1064] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:24.902458 22126 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.899859 21812 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.920086 21220 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.930076 21812 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.930215 21048 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.933346 22109 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.938125 21150 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.939337 22109 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.947561 21221 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.948006 21150 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:24.958103 22126 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.964468 21811 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.976451 22095 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.981129 21297 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.984567 22127 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.992794 22073 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.994282 22064 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:24.998485 21297 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.004350 21811 raft_consensus.cc:2955] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.018491 21812 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.019850 21049 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.021849 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.031823 21220 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.034384 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 797a6a3b284c4ce2b664a3f7e63dfb7e with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:25.035326 22129 tablet_replica.cc:333] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:25.036299 22129 raft_consensus.cc:2243] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.037009 22129 raft_consensus.cc:2272] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.049459 21146 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.053227 21048 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.061724 22129 ts_tablet_manager.cc:1916] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:06:25.072311 22074 consensus_queue.cc:1175] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3585d99c303e453c8c3762b294caba4e" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 13:06:25.077564 21295 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:25.086673 22129 ts_tablet_manager.cc:1929] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.087216 22129 log.cc:1199] T 797a6a3b284c4ce2b664a3f7e63dfb7e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/797a6a3b284c4ce2b664a3f7e63dfb7e
I20260709 13:06:25.089377 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 797a6a3b284c4ce2b664a3f7e63dfb7e (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:25.092832 21226 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.094321 21811 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.095314 22074 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.096155 22064 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.104923 22109 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.106443 21226 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.116520 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe2e5a8d491c4a22ac81fce79a27a7ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.115192 21812 raft_consensus.cc:2955] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:25.125464 21046 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.137269 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet fe2e5a8d491c4a22ac81fce79a27a7ea with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:25.139117 22138 tablet_replica.cc:333] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:25.139938 22138 raft_consensus.cc:2243] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.140532 22138 raft_consensus.cc:2272] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.143950 22138 ts_tablet_manager.cc:1916] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.155689 22138 ts_tablet_manager.cc:1929] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.156035 22138 log.cc:1199] T fe2e5a8d491c4a22ac81fce79a27a7ea P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/fe2e5a8d491c4a22ac81fce79a27a7ea
I20260709 13:06:25.157266 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet fe2e5a8d491c4a22ac81fce79a27a7ea (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:26.199484 21226 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.206693 21146 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.206702 21190 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67fb461d83104dcc8a40aac647f74899. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.208292 21295 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.208535 22122 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.209618 22086 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.220291 22122 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.221794 21295 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.224146 21146 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.239420 21049 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.244464 21220 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.256536 21297 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.257881 22139 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:26.260568 21190 consensus_peers.cc:597] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5918dc9de89b4d149ecb2548872e4642. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.261862 21150 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.264091 22122 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.311290 22122 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.313324 21295 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.340829 21295 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.347081 21048 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.371439 21150 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.416307 21220 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.417346 21264 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f88661ef8d64aa7893277b13b46ff04. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.417773 22064 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.425151 21150 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.426494 22155 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.428875 22155 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.431581 21226 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.432026 21150 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.446506 21220 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.447243 21046 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:26.455127 21190 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fccd55284a3547968acf752c8d6f9f4d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.456957 21295 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.459233 21150 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.460601 22151 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.462425 22154 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.482384 21149 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.482499 22151 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.483848 21295 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:26.503506 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.599550 22162 ts_tablet_manager.cc:933] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:26.602797 22162 tablet_copy_client.cc:323] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:26.604928 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 67fb461d83104dcc8a40aac647f74899 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:26.605523 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 67fb461d83104dcc8a40aac647f74899 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-67fb461d83104dcc8a40aac647f74899
I20260709 13:06:26.612758 21236 tablet_copy_source_session.cc:215] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.615923 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb461d83104dcc8a40aac647f74899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.627816 22162 tablet_copy_client.cc:806] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.628363 22162 tablet_copy_client.cc:670] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.632591 22162 tablet_copy_client.cc:538] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.640097 22162 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:26.655781 22162 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.656453 22162 tablet_bootstrap.cc:492] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:26.656980 22162 ts_tablet_manager.cc:1403] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.002s
I20260709 13:06:26.659189 22162 raft_consensus.cc:359] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.660115 22162 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:26.660691 22162 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.669184 22162 ts_tablet_manager.cc:1434] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:06:26.675076 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-67fb461d83104dcc8a40aac647f74899 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:26.675479 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-67fb461d83104dcc8a40aac647f74899 on tablet 67fb461d83104dcc8a40aac647f74899 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:26.816820 22162 ts_tablet_manager.cc:933] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:26.818336 22162 tablet_copy_client.cc:323] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:26.819757 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 5918dc9de89b4d149ecb2548872e4642 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:26.820246 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 5918dc9de89b4d149ecb2548872e4642 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-5918dc9de89b4d149ecb2548872e4642
I20260709 13:06:26.827473 21236 tablet_copy_source_session.cc:215] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.830314 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5918dc9de89b4d149ecb2548872e4642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.845002 22162 tablet_copy_client.cc:806] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.845588 22162 tablet_copy_client.cc:670] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.848749 22162 tablet_copy_client.cc:538] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.857375 22162 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:26.876837 22162 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.877779 22162 tablet_bootstrap.cc:492] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:26.878458 22162 ts_tablet_manager.cc:1403] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.009s
I20260709 13:06:26.883682 22162 raft_consensus.cc:359] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.884474 22162 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:26.885102 22162 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.889364 22162 ts_tablet_manager.cc:1434] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:26.891759 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-5918dc9de89b4d149ecb2548872e4642 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:26.892174 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-5918dc9de89b4d149ecb2548872e4642 on tablet 5918dc9de89b4d149ecb2548872e4642 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:26.901903 22162 ts_tablet_manager.cc:933] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:26.904392 22162 tablet_copy_client.cc:323] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:26.905790 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 9f88661ef8d64aa7893277b13b46ff04 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:26.906227 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 9f88661ef8d64aa7893277b13b46ff04 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-9f88661ef8d64aa7893277b13b46ff04
I20260709 13:06:26.912447 21309 tablet_copy_source_session.cc:215] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.915238 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f88661ef8d64aa7893277b13b46ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.930138 22162 tablet_copy_client.cc:806] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.930932 22162 tablet_copy_client.cc:670] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.931619 22169 ts_tablet_manager.cc:933] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:26.934832 22169 tablet_copy_client.cc:323] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:26.937422 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet fccd55284a3547968acf752c8d6f9f4d from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:26.937912 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet fccd55284a3547968acf752c8d6f9f4d from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-fccd55284a3547968acf752c8d6f9f4d
I20260709 13:06:26.947029 21236 tablet_copy_source_session.cc:215] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.950541 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccd55284a3547968acf752c8d6f9f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.951345 22162 tablet_copy_client.cc:538] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.964452 22162 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:26.972103 22169 tablet_copy_client.cc:806] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.972680 22169 tablet_copy_client.cc:670] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.976255 22169 tablet_copy_client.cc:538] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.984129 22162 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.984450 22169 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:26.984936 22162 tablet_bootstrap.cc:492] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:26.985603 22162 ts_tablet_manager.cc:1403] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:06:26.988549 22162 raft_consensus.cc:359] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.989300 22162 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:26.990061 22162 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:26.994246 22162 ts_tablet_manager.cc:1434] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:26.997385 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-9f88661ef8d64aa7893277b13b46ff04 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:26.997776 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-9f88661ef8d64aa7893277b13b46ff04 on tablet 9f88661ef8d64aa7893277b13b46ff04 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:27.017985 22169 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.020196 22169 tablet_bootstrap.cc:492] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:27.020884 22169 ts_tablet_manager.cc:1403] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.037s	user 0.027s	sys 0.004s
I20260709 13:06:27.023661 22169 raft_consensus.cc:359] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:27.024365 22169 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:27.024971 22169 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:27.027362 22169 ts_tablet_manager.cc:1434] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:27.029068 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-fccd55284a3547968acf752c8d6f9f4d received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:27.029466 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-fccd55284a3547968acf752c8d6f9f4d on tablet fccd55284a3547968acf752c8d6f9f4d with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:27.102946 21812 raft_consensus.cc:1217] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.394889 21812 raft_consensus.cc:1217] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.400431 21812 raft_consensus.cc:1217] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.407640 21811 raft_consensus.cc:1217] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.551363 22154 raft_consensus.cc:1064] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:27.553829 22154 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:27.560108 21812 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.560670 21150 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.562505 21298 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.561597 22154 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.565049 22139 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.565744 22151 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.590662 22151 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.592557 21150 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.597249 21298 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.610258 21049 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.619061 21812 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.645203 21221 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:27.650344 21812 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.651571 21149 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.653317 22086 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.654196 22151 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.665607 22174 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.667526 21812 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.676899 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67fb461d83104dcc8a40aac647f74899 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:27.676890 21149 raft_consensus.cc:2955] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.686040 21046 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.699919 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 67fb461d83104dcc8a40aac647f74899 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:27.708935 22182 tablet_replica.cc:333] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:27.710011 22182 raft_consensus.cc:2243] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:27.710790 22182 raft_consensus.cc:2272] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:27.716567 22182 ts_tablet_manager.cc:1916] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:27.731680 22182 ts_tablet_manager.cc:1929] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:27.732056 22182 log.cc:1199] T 67fb461d83104dcc8a40aac647f74899 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/67fb461d83104dcc8a40aac647f74899
I20260709 13:06:27.733480 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 67fb461d83104dcc8a40aac647f74899 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:27.836221 22174 raft_consensus.cc:1064] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:27.839063 22174 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:27.852049 21811 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.853772 22174 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.854018 21149 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.854581 21298 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.855573 22086 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.856503 22174 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.875640 22139 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.878350 21150 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.883962 21298 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.894052 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.900486 21811 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.931834 21221 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:27.937036 21150 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.937732 21811 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.938427 22086 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.939401 22154 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.945997 22139 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.949409 21811 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.960703 21150 raft_consensus.cc:2955] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.965688 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fccd55284a3547968acf752c8d6f9f4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:27.968782 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:27.981287 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet fccd55284a3547968acf752c8d6f9f4d with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:27.982245 22182 tablet_replica.cc:333] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:27.983302 22182 raft_consensus.cc:2243] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:27.984054 22182 raft_consensus.cc:2272] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:27.988332 22182 ts_tablet_manager.cc:1916] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:27.994657 22086 raft_consensus.cc:1064] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:27.997156 22086 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:28.007050 22157 raft_consensus.cc:1064] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:28.009627 22157 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:28.013868 22182 ts_tablet_manager.cc:1929] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.014564 22182 log.cc:1199] T fccd55284a3547968acf752c8d6f9f4d P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/fccd55284a3547968acf752c8d6f9f4d
I20260709 13:06:28.016141 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet fccd55284a3547968acf752c8d6f9f4d (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:28.045809 21221 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.047880 21150 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.050246 22064 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.051821 22064 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.079454 21811 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.087218 22157 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:06:28.095971 22188 log.cc:927] Time spent T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:28.100795 21812 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.099709 22189 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.101747 21221 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.102837 22139 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.107887 21150 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.109308 22154 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.112038 21295 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.114913 22154 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.124233 21146 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.143246 21047 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.155488 22151 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.157008 21150 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.178737 21046 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.180166 21811 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.190011 21297 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.193614 21812 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.208104 21221 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:28.215772 21297 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:28.219292 21812 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.220891 21298 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.220718 22139 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.222447 22139 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.229646 21811 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.230068 22151 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.234035 22189 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.235461 21811 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.242040 22064 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.249495 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5918dc9de89b4d149ecb2548872e4642 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.250144 21812 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.248464 21298 raft_consensus.cc:2955] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.258095 21146 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.260514 22157 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.265035 21047 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.265362 21146 raft_consensus.cc:2955] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.270321 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f88661ef8d64aa7893277b13b46ff04 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.276080 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 5918dc9de89b4d149ecb2548872e4642 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:28.278065 22196 tablet_replica.cc:333] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:28.286090 21047 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:28.279070 22196 raft_consensus.cc:2243] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.292999 22196 raft_consensus.cc:2272] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.297442 22196 ts_tablet_manager.cc:1916] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.303977 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f88661ef8d64aa7893277b13b46ff04 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:28.318843 22197 tablet_replica.cc:333] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:28.320887 22197 raft_consensus.cc:2243] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.321620 22197 raft_consensus.cc:2272] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.324903 22197 ts_tablet_manager.cc:1916] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.327826 22196 ts_tablet_manager.cc:1929] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.328330 22196 log.cc:1199] T 5918dc9de89b4d149ecb2548872e4642 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/5918dc9de89b4d149ecb2548872e4642
I20260709 13:06:28.329890 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 5918dc9de89b4d149ecb2548872e4642 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:28.337347 22197 ts_tablet_manager.cc:1929] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.337814 22197 log.cc:1199] T 9f88661ef8d64aa7893277b13b46ff04 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/9f88661ef8d64aa7893277b13b46ff04
I20260709 13:06:28.339176 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 9f88661ef8d64aa7893277b13b46ff04 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:29.381459 21220 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:06:29.389899 21190 consensus_peers.cc:597] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98b79eeda2784ff4ac1d2f6696c48563. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.390311 21146 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.390100 21295 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.392074 22174 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.393261 22139 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.402089 22203 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.403891 21295 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.404522 21146 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.423985 21146 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:29.426424 21047 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:29.431200 21115 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aff8a809ecee49028cc5d6587518d7c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.431749 21295 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.433166 22143 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.433862 21220 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.442590 22143 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.446074 22199 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.485911 21220 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.502556 21295 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:29.506259 21298 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:29.511556 21264 consensus_peers.cc:597] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e36ad000b4a9410f80c7796396b878f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.512559 21220 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.515749 21150 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.515540 22189 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.524403 22157 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.537276 22157 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.530857 21047 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.541309 21146 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.548322 21220 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.561450 21150 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:29.570501 21046 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:29.584525 21115 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 116d5e82da354208af66a0e6f7a51dcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.585311 21295 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.586381 21220 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.587988 22210 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.589038 22201 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.597368 22213 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.598659 21226 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.603938 21295 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:29.620986 21048 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.829245 22224 ts_tablet_manager.cc:933] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:29.831180 22224 tablet_copy_client.cc:323] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:29.833205 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 98b79eeda2784ff4ac1d2f6696c48563 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:29.833806 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 98b79eeda2784ff4ac1d2f6696c48563 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-98b79eeda2784ff4ac1d2f6696c48563
I20260709 13:06:29.843518 21236 tablet_copy_source_session.cc:215] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.846558 22224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b79eeda2784ff4ac1d2f6696c48563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.865991 22224 tablet_copy_client.cc:806] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:29.866698 22224 tablet_copy_client.cc:670] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:29.870713 22224 tablet_copy_client.cc:538] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.876753 22224 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:29.892418 22224 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.893124 22224 tablet_bootstrap.cc:492] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:29.893671 22224 ts_tablet_manager.cc:1403] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 13:06:29.896034 22224 raft_consensus.cc:359] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:29.896659 22224 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:29.897177 22224 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:29.903498 22224 ts_tablet_manager.cc:1434] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:06:29.906998 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-98b79eeda2784ff4ac1d2f6696c48563 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:29.907495 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-98b79eeda2784ff4ac1d2f6696c48563 on tablet 98b79eeda2784ff4ac1d2f6696c48563 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:29.968878 22224 ts_tablet_manager.cc:933] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:29.970472 22224 tablet_copy_client.cc:323] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:29.972169 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 116d5e82da354208af66a0e6f7a51dcf from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:29.972607 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 116d5e82da354208af66a0e6f7a51dcf from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-116d5e82da354208af66a0e6f7a51dcf
I20260709 13:06:29.979547 21161 tablet_copy_source_session.cc:215] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:29.982775 22224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116d5e82da354208af66a0e6f7a51dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.999655 22224 tablet_copy_client.cc:806] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.000274 22224 tablet_copy_client.cc:670] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.011919 22224 tablet_copy_client.cc:538] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.030651 22224 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:30.035601 22230 ts_tablet_manager.cc:933] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:30.046890 22230 tablet_copy_client.cc:323] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:30.052834 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet aff8a809ecee49028cc5d6587518d7c8 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:30.053411 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet aff8a809ecee49028cc5d6587518d7c8 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-aff8a809ecee49028cc5d6587518d7c8
I20260709 13:06:30.058928 22224 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.059898 22224 tablet_bootstrap.cc:492] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:30.060562 22224 ts_tablet_manager.cc:1403] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.005s
I20260709 13:06:30.064069 22224 raft_consensus.cc:359] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.064800 22224 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:30.065054 21161 tablet_copy_source_session.cc:215] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.065323 22224 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.068442 22230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8a809ecee49028cc5d6587518d7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.069198 22224 ts_tablet_manager.cc:1434] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:06:30.070928 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-116d5e82da354208af66a0e6f7a51dcf received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:30.071398 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-116d5e82da354208af66a0e6f7a51dcf on tablet 116d5e82da354208af66a0e6f7a51dcf with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:30.081348 22224 ts_tablet_manager.cc:933] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:30.083393 22224 tablet_copy_client.cc:323] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:30.085465 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet e36ad000b4a9410f80c7796396b878f5 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:30.086021 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet e36ad000b4a9410f80c7796396b878f5 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-e36ad000b4a9410f80c7796396b878f5
I20260709 13:06:30.087530 22230 tablet_copy_client.cc:806] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.088100 22230 tablet_copy_client.cc:670] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.092694 22230 tablet_copy_client.cc:538] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.100323 21309 tablet_copy_source_session.cc:215] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.102905 22230 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:30.104367 22224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ad000b4a9410f80c7796396b878f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.120918 22230 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.121882 22230 tablet_bootstrap.cc:492] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:30.122398 22224 tablet_copy_client.cc:806] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.122583 22230 ts_tablet_manager.cc:1403] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.004s
I20260709 13:06:30.122977 22224 tablet_copy_client.cc:670] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.127643 22230 raft_consensus.cc:359] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.128661 22230 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:30.129356 22230 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.132550 22224 tablet_copy_client.cc:538] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.134793 22230 ts_tablet_manager.cc:1434] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:06:30.136658 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-aff8a809ecee49028cc5d6587518d7c8 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:30.137108 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-aff8a809ecee49028cc5d6587518d7c8 on tablet aff8a809ecee49028cc5d6587518d7c8 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:30.159442 22224 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:30.176844 22224 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.177812 22224 tablet_bootstrap.cc:492] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:30.178428 22224 ts_tablet_manager.cc:1403] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.003s
I20260709 13:06:30.181193 22224 raft_consensus.cc:359] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.181938 22224 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:30.182582 22224 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:30.184988 22224 ts_tablet_manager.cc:1434] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:06:30.193087 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-e36ad000b4a9410f80c7796396b878f5 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:30.193521 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-e36ad000b4a9410f80c7796396b878f5 on tablet e36ad000b4a9410f80c7796396b878f5 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:30.275933 21811 raft_consensus.cc:1217] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.420451 21811 raft_consensus.cc:1217] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.527876 21811 raft_consensus.cc:1217] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.641460 21811 raft_consensus.cc:1217] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.815397 22139 raft_consensus.cc:1064] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:30.817337 22139 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:30.824415 21811 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.826695 21146 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.825856 21297 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.828223 22229 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.829537 22139 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.830564 22229 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:30.856848 22139 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.858978 21146 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.868800 21298 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.875415 21811 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.883152 21046 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.918562 21226 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:30.924496 21811 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.924644 21298 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:30.927564 22229 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:30.928442 22203 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:30.930944 22213 raft_consensus.cc:1064] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:30.933454 22213 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:30.937579 22229 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.940646 21811 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.947739 21295 raft_consensus.cc:2955] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:30.951386 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98b79eeda2784ff4ac1d2f6696c48563 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:30.960130 21049 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.968560 21298 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.969902 21811 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.970788 22214 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.971743 22210 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.968550 21226 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.982360 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 98b79eeda2784ff4ac1d2f6696c48563 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:30.988006 22210 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.011341 22248 tablet_replica.cc:333] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:31.028689 22248 raft_consensus.cc:2243] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.027690 22201 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.029605 22248 raft_consensus.cc:2272] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.029361 21811 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.038733 22248 ts_tablet_manager.cc:1916] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.044340 21226 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.054565 21049 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.064857 22214 raft_consensus.cc:1064] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:31.062481 21298 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.071146 22248 ts_tablet_manager.cc:1929] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.071717 22248 log.cc:1199] T 98b79eeda2784ff4ac1d2f6696c48563 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/98b79eeda2784ff4ac1d2f6696c48563
I20260709 13:06:31.067166 22214 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:31.074874 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 98b79eeda2784ff4ac1d2f6696c48563 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:31.091759 21811 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.094144 22213 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.100637 21298 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.101872 21146 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:31.102720 22201 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.110558 21812 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.112776 22201 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.125959 21812 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.130594 21226 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.131949 22213 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.123243 22210 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.141481 21297 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.147403 21047 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.149281 21221 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.150842 22201 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.138423 22214 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.161580 21221 raft_consensus.cc:2955] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.177127 21048 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.193733 21812 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.197986 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aff8a809ecee49028cc5d6587518d7c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.200623 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet aff8a809ecee49028cc5d6587518d7c8 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:31.206625 21226 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.210927 22257 tablet_replica.cc:333] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:31.213586 22257 raft_consensus.cc:2243] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.215797 22257 raft_consensus.cc:2272] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.224220 22257 ts_tablet_manager.cc:1916] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.234118 22236 raft_consensus.cc:1064] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:31.236812 22236 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:31.245975 22257 ts_tablet_manager.cc:1929] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.246709 22257 log.cc:1199] T aff8a809ecee49028cc5d6587518d7c8 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/aff8a809ecee49028cc5d6587518d7c8
I20260709 13:06:31.249114 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet aff8a809ecee49028cc5d6587518d7c8 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:31.257808 21146 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:31.258610 21811 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.260895 21150 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.263782 22220 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.266376 21297 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.268533 22220 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.269927 22252 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.270591 21221 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.271826 21812 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.276611 22214 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.277570 22220 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.279453 22213 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.289562 21297 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.292068 21812 raft_consensus.cc:2955] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.306942 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 116d5e82da354208af66a0e6f7a51dcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.316457 21047 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.316154 22236 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.318962 21221 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.329780 21812 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.333482 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 116d5e82da354208af66a0e6f7a51dcf with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:31.342094 21049 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.352638 22262 tablet_replica.cc:333] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:31.355062 22262 raft_consensus.cc:2243] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.356459 22262 raft_consensus.cc:2272] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.361580 21150 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.363886 22262 ts_tablet_manager.cc:1916] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.370203 21295 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:31.377839 21221 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.379309 22157 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.381664 21812 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.383710 22157 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.401504 22220 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.408149 21221 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.421592 21814 raft_consensus.cc:2955] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.425463 21048 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:31.427090 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e36ad000b4a9410f80c7796396b878f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.435715 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet e36ad000b4a9410f80c7796396b878f5 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:31.437897 22248 tablet_replica.cc:333] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:31.438834 22248 raft_consensus.cc:2243] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.439530 22248 raft_consensus.cc:2272] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.442972 22262 ts_tablet_manager.cc:1929] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.443449 22262 log.cc:1199] T 116d5e82da354208af66a0e6f7a51dcf P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/116d5e82da354208af66a0e6f7a51dcf
I20260709 13:06:31.444445 22248 ts_tablet_manager.cc:1916] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.445326 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 116d5e82da354208af66a0e6f7a51dcf (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:31.458541 22248 ts_tablet_manager.cc:1929] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.458925 22248 log.cc:1199] T e36ad000b4a9410f80c7796396b878f5 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/e36ad000b4a9410f80c7796396b878f5
I20260709 13:06:31.460121 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet e36ad000b4a9410f80c7796396b878f5 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:32.285472 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.342398 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:32.343021 21150 raft_consensus.cc:606] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:32.346200 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:32.346611 21150 raft_consensus.cc:606] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:32.348748 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:32.349196 21150 raft_consensus.cc:606] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:32.351333 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:32.351763 21150 raft_consensus.cc:606] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:32.353870 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:32.354385 21150 raft_consensus.cc:606] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:32.374365 21221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:32.374783 21221 raft_consensus.cc:606] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:32.375811 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:32.376818 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:32.499814 21150 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:32.506295 21297 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:32.507946 21115 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 688a48cc2bc64a7a9e78bf41a84d44ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.508128 21221 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.508114 22201 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.510090 22267 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.515954 22201 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.517428 21297 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.518399 21221 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.530030 21220 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:32.531654 21047 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.543921 21297 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:32.544570 21190 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dee37f119694b8cbc658fd3b84b0563. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.544986 21150 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.546016 22229 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.547065 22238 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.562683 22238 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.566133 21150 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.589030 21297 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:32.592262 21295 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:32.614243 21264 consensus_peers.cc:597] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67929a23f7cc4a9a8f64f854df93b149. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.614861 21221 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.614137 21047 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.616005 21150 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.616811 22236 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.617605 22157 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.628957 22236 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.636430 22201 raft_consensus.cc:993] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.636945 22267 raft_consensus.cc:1081] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.636962 21150 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.643610 21295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:32.644243 21295 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.644641 21295 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.655853 22267 raft_consensus.cc:993] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.656468 22214 raft_consensus.cc:1081] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.656823 22229 raft_consensus.cc:993] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.657346 22279 raft_consensus.cc:1081] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.658807 21297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:32.659505 21297 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.659899 21297 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.660187 21292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:32.661007 21292 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.661463 21292 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.668947 21297 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.658445 21048 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.677148 21297 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:32.678144 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:32.678522 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:32.678731 21150 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.674773 21292 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.679086 21220 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.679450 21150 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:32.673123 21295 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.680408 21150 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.681540 21150 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.683372 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:32.683876 21146 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.684151 21146 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:32.684343 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:32.684870 21226 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.684891 21146 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.686241 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:32.686607 21146 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.686754 21149 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.690647 21226 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.693241 21150 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.692956 21151 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:32.693980 21220 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.695983 21292 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:32.697665 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:32.698374 22283 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:32.698484 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:32.693483 21149 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.699033 22283 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:32.702049 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:32.705415 21226 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.711387 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:32.684168 21295 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:32.703560 22283 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.712198 21220 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.713495 21220 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:32.699790 21146 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.700474 22157 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:32.723474 21220 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.725991 21220 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.732668 22236 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:32.746325 21220 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.758630 22201 raft_consensus.cc:993] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.759018 22201 raft_consensus.cc:1081] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.760654 21297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:32.761171 21297 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.761528 21297 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.764842 21048 catalog_manager.cc:5697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.770056 22157 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:32.772347 21297 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.776278 21297 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:32.776176 22157 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.781821 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:32.782436 21220 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.785799 21297 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.787720 22214 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:32.789203 21220 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:32.793691 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:32.777588 22236 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:32.800169 22236 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.798321 22290 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:32.822319 21220 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.822995 22290 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:32.823980 22290 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.835623 22214 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:32.834359 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58849.6us
I20260709 13:06:32.862924 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:06:32.906901 21115 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c0599d67fb34b91a3afc1c32163efa4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.895507 21151 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:32.911334 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 85849.1us
I20260709 13:06:32.912798 21151 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:32.920435 22267 raft_consensus.cc:993] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:32.921113 22267 raft_consensus.cc:1081] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:32.938090 21151 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:32.941834 21151 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:32.963238 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69159.5us
I20260709 13:06:32.967320 21297 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.967650 22303 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:32.963759 21151 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:06:32.965251 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56400.8us
I20260709 13:06:32.980260 21812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:32.980803 21812 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.981174 21812 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.986505 22214 raft_consensus.cc:993] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.987178 22201 raft_consensus.cc:1081] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:32.990341 21295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:32.990821 21295 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.991146 21295 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:32.996258 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 172894us
I20260709 13:06:33.008948 21295 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:33.020771 21812 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:33.019745 21048 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.024823 21048 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.027431 21295 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:33.041865 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:33.042371 21812 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:33.042490 21147 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.041998 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:33.042825 21147 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:33.043720 21147 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:33.045066 21147 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.052448 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:33.054303 21295 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.053264 21151 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.055734 21151 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:33.056731 21151 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:33.058409 21151 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.057930 21049 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.026675 21048 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.076889 22310 ts_tablet_manager.cc:933] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:33.078800 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:33.079396 21222 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.088706 21151 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:33.090034 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:33.094936 21222 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:33.096261 21263 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:33.103575 22286 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.106174 22310 tablet_copy_client.cc:323] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:33.104215 22286 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:33.109333 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:33.112334 22286 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:33.115032 21221 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:33.105598 21147 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:06:33.135926 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45981.3us
I20260709 13:06:33.137691 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 688a48cc2bc64a7a9e78bf41a84d44ca from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:33.138387 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 688a48cc2bc64a7a9e78bf41a84d44ca from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-688a48cc2bc64a7a9e78bf41a84d44ca
I20260709 13:06:33.149863 21161 tablet_copy_source_session.cc:215] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.155390 22314 ts_tablet_manager.cc:933] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:33.151219 22312 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.184562 22312 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:33.185506 22312 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:33.189323 21221 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.191735 21147 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.194267 22291 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:33.195957 22291 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.198028 21047 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.205065 22310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688a48cc2bc64a7a9e78bf41a84d44ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.212144 22317 ts_tablet_manager.cc:933] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:33.232803 21149 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.239392 22291 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:33.253787 22317 tablet_copy_client.cc:323] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:33.255445 22314 tablet_copy_client.cc:323] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:33.264936 22322 ts_tablet_manager.cc:933] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:33.272161 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 3dee37f119694b8cbc658fd3b84b0563 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:33.272761 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 3dee37f119694b8cbc658fd3b84b0563 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-3dee37f119694b8cbc658fd3b84b0563
I20260709 13:06:33.272855 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 67929a23f7cc4a9a8f64f854df93b149 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:33.273356 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 67929a23f7cc4a9a8f64f854df93b149 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-67929a23f7cc4a9a8f64f854df93b149
I20260709 13:06:33.265358 21048 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.280347 21236 tablet_copy_source_session.cc:215] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.284842 22314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dee37f119694b8cbc658fd3b84b0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.296583 22322 tablet_copy_client.cc:323] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:33.298245 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 3c0599d67fb34b91a3afc1c32163efa4 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:33.298712 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 3c0599d67fb34b91a3afc1c32163efa4 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-3c0599d67fb34b91a3afc1c32163efa4
I20260709 13:06:33.301136 21149 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.302552 22291 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.305749 21161 tablet_copy_source_session.cc:215] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.308703 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0599d67fb34b91a3afc1c32163efa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.309747 21309 tablet_copy_source_session.cc:215] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.313918 22317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67929a23f7cc4a9a8f64f854df93b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.495077 22310 tablet_copy_client.cc:806] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.495201 22314 tablet_copy_client.cc:806] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.495718 22310 tablet_copy_client.cc:670] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.495852 22314 tablet_copy_client.cc:670] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.498383 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:33.591600 22314 tablet_copy_client.cc:538] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.573280 22322 tablet_copy_client.cc:806] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.594307 22322 tablet_copy_client.cc:670] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.574548 22317 tablet_copy_client.cc:806] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.601007 22317 tablet_copy_client.cc:670] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.666587 21149 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:33.724020 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85896.4us
I20260709 13:06:33.745496 21222 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.759133 21222 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.736966 22291 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:06:33.777936 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 80678.7us
W20260709 13:06:33.778164 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 46805.7us
I20260709 13:06:33.779445 21222 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.804303 22317 tablet_copy_client.cc:538] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.810405 21222 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.840929 21291 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:33.854447 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 75744.3us
W20260709 13:06:33.860057 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58456.1us
I20260709 13:06:33.871522 22312 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:33.902544 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 47466.9us
I20260709 13:06:33.913612 22317 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:33.929519 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:33.938041 22314 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:33.942386 21151 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.961971 22333 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.987700 22344 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:33.989960 22344 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.992321 22344 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.994047 22344 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.996879 22317 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.998075 22317 tablet_bootstrap.cc:492] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:33.998734 22317 ts_tablet_manager.cc:1403] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.007s
I20260709 13:06:34.005918 22317 raft_consensus.cc:359] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.006764 22317 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:34.007439 22317 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.012766 22317 ts_tablet_manager.cc:1434] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:06:34.014722 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-67929a23f7cc4a9a8f64f854df93b149 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:34.015157 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-67929a23f7cc4a9a8f64f854df93b149 on tablet 67929a23f7cc4a9a8f64f854df93b149 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.045338 22322 tablet_copy_client.cc:538] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.051391 22310 tablet_copy_client.cc:538] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.073791 22310 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
W20260709 13:06:34.081955 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 57683.7us
I20260709 13:06:34.085812 21150 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.087915 22351 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:34.088747 22322 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
W20260709 13:06:34.149276 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 70065.8us
I20260709 13:06:34.175631 21814 raft_consensus.cc:1217] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.186575 22322 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.188162 22310 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.189145 22310 tablet_bootstrap.cc:492] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:34.189851 22310 ts_tablet_manager.cc:1403] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.007s
I20260709 13:06:34.199649 22322 tablet_bootstrap.cc:492] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:34.200404 22322 ts_tablet_manager.cc:1403] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.009s
I20260709 13:06:34.203372 22322 raft_consensus.cc:359] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.204154 22322 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:34.217007 22310 raft_consensus.cc:359] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.217912 22310 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:34.218535 22310 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.204788 22322 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.233528 22310 ts_tablet_manager.cc:1434] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:06:34.235482 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-688a48cc2bc64a7a9e78bf41a84d44ca received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:34.235705 22322 ts_tablet_manager.cc:1434] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:06:34.235955 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-688a48cc2bc64a7a9e78bf41a84d44ca on tablet 688a48cc2bc64a7a9e78bf41a84d44ca with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.238689 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-3c0599d67fb34b91a3afc1c32163efa4 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:34.239120 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-3c0599d67fb34b91a3afc1c32163efa4 on tablet 3c0599d67fb34b91a3afc1c32163efa4 with peer 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:34.255896 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44432.4us
I20260709 13:06:34.266144 21225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09568f2c2c854929b369d24083d81717"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:34.266883 21225 raft_consensus.cc:606] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:34.314255 22276 raft_consensus.cc:993] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:34.314920 22276 raft_consensus.cc:1081] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:34.333585 22314 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.334560 22314 tablet_bootstrap.cc:492] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:34.335239 22314 ts_tablet_manager.cc:1403] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.397s	user 0.094s	sys 0.162s
I20260709 13:06:34.339926 22314 raft_consensus.cc:359] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.340775 22314 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:34.341385 22314 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:34.344449 22314 ts_tablet_manager.cc:1434] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:34.345939 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-3dee37f119694b8cbc658fd3b84b0563 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:34.346376 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-3dee37f119694b8cbc658fd3b84b0563 on tablet 3dee37f119694b8cbc658fd3b84b0563 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.354735 21812 raft_consensus.cc:1217] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.357409 21149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09568f2c2c854929b369d24083d81717"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:06:34.358121 21149 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.358600 21149 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.379438 21149 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.396705 21149 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:34.397699 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:34.398286 21297 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.398710 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:34.399260 21221 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.399626 21221 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:34.400326 21221 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.401309 21221 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.407953 21221 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:34.412197 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:34.413419 22339 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.413872 22339 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:34.432559 21297 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:34.414726 22339 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.448083 21812 raft_consensus.cc:1217] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.449935 21298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:34.450527 21298 raft_consensus.cc:606] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:34.453015 21149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:34.453605 21149 raft_consensus.cc:606] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.460742 21151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:34.461269 21151 raft_consensus.cc:606] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.463210 22344 raft_consensus.cc:993] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:34.463853 22344 raft_consensus.cc:1081] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:34.465595 21149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:34.466131 21149 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.466446 21149 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.465108 21151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:34.472206 21151 raft_consensus.cc:606] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:34.476081 21146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:34.476611 21146 raft_consensus.cc:606] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:34.479609 22292 raft_consensus.cc:993] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.479723 21146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:34.480057 22292 raft_consensus.cc:1081] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.480345 21146 raft_consensus.cc:606] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:34.481333 22348 raft_consensus.cc:993] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.481597 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:06:34.481753 22348 raft_consensus.cc:1081] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.483182 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.483672 21811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:34.484189 21811 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.484701 21811 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.484127 21812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:34.485256 21812 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.485143 21149 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.485707 21812 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.487186 21149 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:34.488204 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:34.488760 21292 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.489082 21292 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:34.489848 21292 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.490909 21292 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.493290 21812 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.496057 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:34.496680 21224 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.497320 21292 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:34.498598 21116 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:34.500034 22308 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.504524 22308 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:34.505432 22308 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.506208 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:34.506822 21149 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.507141 21149 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:34.507889 21812 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:34.507916 21149 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.509768 21149 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.511530 21811 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.511803 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:34.512398 21295 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.516126 21048 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.517611 21224 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:34.518982 21295 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:34.520141 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:34.520948 22351 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.522565 21149 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:34.528409 21811 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:34.528568 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:34.529134 21146 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.529424 21146 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:34.530150 21146 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.531826 21146 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.543641 21146 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:34.544708 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:34.548293 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:34.548913 22351 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:34.549357 22374 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.550052 22351 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.550050 22374 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:34.552490 22374 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.548928 21224 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.588965 21224 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:34.592864 21046 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.609831 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.634894 21046 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.657061 21812 raft_consensus.cc:1217] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.712610 22337 raft_consensus.cc:1064] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:34.715193 22337 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.729676 21812 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.731482 22349 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.733702 22339 raft_consensus.cc:1064] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:34.739719 22339 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.756546 21226 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.762929 22287 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.775110 21146 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.777978 22283 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.781904 21812 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.783823 22348 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.789570 21295 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.790971 21224 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.791066 22308 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:34.792737 22348 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.805928 22287 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.814047 22348 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.821197 21812 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.827864 21814 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.837339 21048 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.838375 21046 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.839855 21226 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.833521 21146 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.856563 21295 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.860062 22339 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.886318 21297 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.887339 21226 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.890089 21226 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.891673 22342 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.884188 21224 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.888813 22348 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:34.901284 21292 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.905189 22339 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.917469 21146 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:34.929410 21297 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.932385 22348 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.933279 21814 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.935189 22292 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.940079 22292 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.942435 22348 raft_consensus.cc:993] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:34.942924 22348 raft_consensus.cc:1081] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:34.943641 21298 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.950346 21297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:34.951022 21297 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.952984 21297 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.957420 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 688a48cc2bc64a7a9e78bf41a84d44ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.951757 21814 raft_consensus.cc:2955] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:34.962015 21146 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.963409 22351 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.975227 21048 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.983836 21297 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:34.997327 22308 raft_consensus.cc:993] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.997850 22308 raft_consensus.cc:1081] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:34.999701 21811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:35.000212 21811 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.000576 21811 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.002424 21295 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:35.003851 22376 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.004347 21292 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.008155 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:35.008697 21146 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.008965 21146 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:35.009588 21146 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:35.010535 21146 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.010593 21811 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.017571 21812 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.019220 22283 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.020524 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:35.021152 21151 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.021493 21151 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:35.022599 21151 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.026647 21151 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.027789 21297 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:35.028743 22344 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.034072 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:35.034680 21221 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.035418 21811 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:35.038218 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:35.036803 21146 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:35.038570 22339 raft_consensus.cc:993] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:35.038787 21224 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.039098 22339 raft_consensus.cc:1081] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:35.041109 21225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:35.041641 21225 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.041967 21225 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.044386 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:35.044510 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 688a48cc2bc64a7a9e78bf41a84d44ca with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:35.056795 21221 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:35.065212 22308 raft_consensus.cc:1064] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:35.045660 21151 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:35.038648 21226 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.066115 21225 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:35.046767 21224 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:35.048763 21811 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.054543 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67929a23f7cc4a9a8f64f854df93b149 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:35.067984 22333 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.068908 21225 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:35.071573 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:35.072075 21146 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.072347 21146 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:35.072973 21146 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:35.073843 21146 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.055719 22283 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.075537 22278 raft_consensus.cc:1064] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:35.076570 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:35.077118 21295 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.078542 22278 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.075997 22283 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:35.084193 22308 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.086489 21225 raft_consensus.cc:2955] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.091845 21146 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:35.092906 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:35.096378 21295 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:35.097693 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:35.098464 22376 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.098929 22376 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:35.099741 22376 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:35.083240 22283 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:35.116866 21146 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:35.118988 22376 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:35.107606 22276 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.183276 21046 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.184798 21046 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.185699 22400 tablet_replica.cc:333] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:35.186756 22400 raft_consensus.cc:2243] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.187481 22400 raft_consensus.cc:2272] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.192585 22400 ts_tablet_manager.cc:1916] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.213454 22276 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:35.238242 22276 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:35.241151 21224 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:35.242699 22374 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.263451 21814 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:35.363240 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 108487us
W20260709 13:06:35.363001 22414 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:06:35.395782 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 109353us
I20260709 13:06:35.398306 22421 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.400775 21295 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.419461 22409 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:35.468326 21814 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.475246 22422 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.498754 21221 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.487414 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.532586 21047 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.546598 21146 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.545401 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 67929a23f7cc4a9a8f64f854df93b149 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:35.546507 22308 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:06:35.588642 22408 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:35.675015 21146 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:35.679714 22430 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:06:35.683589 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 106936us
I20260709 13:06:35.684317 21295 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.669255 22400 ts_tablet_manager.cc:1929] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:35.697021 22400 log.cc:1199] T 688a48cc2bc64a7a9e78bf41a84d44ca P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/688a48cc2bc64a7a9e78bf41a84d44ca
I20260709 13:06:35.711546 22428 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:35.749568 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 688a48cc2bc64a7a9e78bf41a84d44ca (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
W20260709 13:06:35.750319 22433 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:35.787176 21225 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:35.798156 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 98939us
W20260709 13:06:35.807813 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 335523us
I20260709 13:06:35.826440 22439 tablet_replica.cc:333] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:35.791926 22351 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:35.856683 21151 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.884292 21295 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.885268 21219 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:35.897594 22443 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:35.907596 22337 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:35.910765 22439 raft_consensus.cc:2243] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.911603 22439 raft_consensus.cc:2272] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.901697 22415 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.917303 21147 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:35.903148 21291 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.934145 22351 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.919399 22439 ts_tablet_manager.cc:1916] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.947376 22443 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:35.959045 22404 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:06:36.022782 21814 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:35.990615 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:36.079897 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51825.4us
I20260709 13:06:36.073449 21049 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:06:36.089154 21049 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.128477 21814 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.114189 22407 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:06:36.192299 22452 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:36.222537 22439 ts_tablet_manager.cc:1929] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.237893 22439 log.cc:1199] T 67929a23f7cc4a9a8f64f854df93b149 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/67929a23f7cc4a9a8f64f854df93b149
I20260709 13:06:36.284148 21217 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.310498 21295 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.283460 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 67929a23f7cc4a9a8f64f854df93b149 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:36.327786 21150 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.448618 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:36.449281 21145 raft_consensus.cc:606] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:36.452777 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:36.453316 21145 raft_consensus.cc:606] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:36.456985 22339 raft_consensus.cc:993] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:36.457420 22339 raft_consensus.cc:1081] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:36.460763 21047 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.461551 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:36.463429 21142 raft_consensus.cc:606] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:36.462785 21217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:36.464581 21217 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.464942 21217 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.473384 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:36.474071 21145 raft_consensus.cc:606] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:36.478336 21217 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.480536 21217 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:36.484359 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:36.485193 21217 raft_consensus.cc:606] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:36.487063 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:36.487679 21291 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.488310 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:36.488919 21142 raft_consensus.cc:606] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:36.491891 21150 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:36.488359 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:36.501724 21145 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.503386 21145 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:36.504966 21812 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.506928 21145 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.507966 22418 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.515074 22417 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.516408 21812 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.518020 21145 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.526788 21145 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:36.528304 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:36.529896 22407 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.530371 22407 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:36.531210 22407 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.535492 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c0599d67fb34b91a3afc1c32163efa4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:36.542202 21217 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:36.542986 22422 raft_consensus.cc:993] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:36.543506 22422 raft_consensus.cc:1081] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:36.505956 21291 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:36.506057 21295 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.549367 21298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:36.549944 21298 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.550324 21298 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.551231 21814 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.553825 22406 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:36.558828 21150 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.564926 21298 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.562319 22406 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:06:36.566056 22339 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.560604 21046 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.570573 22406 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.572441 21300 raft_consensus.cc:2955] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.573935 21150 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.579994 21810 raft_consensus.cc:2955] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.595553 21298 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:36.610817 21297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:36.611502 21297 raft_consensus.cc:606] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:36.631361 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:06:36.632781 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:36.635941 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43684.8us
I20260709 13:06:36.637912 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:36.638437 21220 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.643564 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c0599d67fb34b91a3afc1c32163efa4 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:36.646816 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:36.661362 21144 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.661710 21144 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:36.662456 21144 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.663813 21144 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.649518 21048 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:36.676008 21220 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:36.692031 21263 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:36.693797 22469 tablet_replica.cc:333] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:36.697966 22437 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.706463 22437 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:36.707324 22437 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.699358 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3dee37f119694b8cbc658fd3b84b0563 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:36.699586 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dee37f119694b8cbc658fd3b84b0563 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:36.713136 22471 tablet_replica.cc:333] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:36.714300 22471 raft_consensus.cc:2243] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.715161 22471 raft_consensus.cc:2272] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.717935 22469 raft_consensus.cc:2243] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.722148 22339 raft_consensus.cc:993] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:36.722642 22339 raft_consensus.cc:1081] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:36.722759 22469 raft_consensus.cc:2272] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.718407 22471 ts_tablet_manager.cc:1916] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:36.727715 21222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:36.728263 21222 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.728605 21222 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.729054 22469 ts_tablet_manager.cc:1916] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:36.720323 21046 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.718498 21144 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:36.736726 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.737329 21222 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.744640 21222 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:36.745564 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:36.746114 21291 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.746102 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:36.746863 21145 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.747196 21145 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:36.749012 21145 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.753197 21145 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.755719 21291 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:36.757259 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:36.758142 22407 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.758621 22407 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:36.759761 22407 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.761972 22418 raft_consensus.cc:993] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:36.762485 22418 raft_consensus.cc:1081] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:36.764534 21810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:36.765107 21810 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.765470 21810 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.770160 22471 ts_tablet_manager.cc:1929] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.770682 22471 log.cc:1199] T 3dee37f119694b8cbc658fd3b84b0563 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/3dee37f119694b8cbc658fd3b84b0563
I20260709 13:06:36.773994 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 3dee37f119694b8cbc658fd3b84b0563 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:36.774207 21810 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:36.789304 22469 ts_tablet_manager.cc:1929] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.789716 22469 log.cc:1199] T 3c0599d67fb34b91a3afc1c32163efa4 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/3c0599d67fb34b91a3afc1c32163efa4
I20260709 13:06:36.791339 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 3c0599d67fb34b91a3afc1c32163efa4 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:36.793051 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:36.794277 21144 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.794625 21144 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:36.795239 21810 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:36.795444 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:36.795564 21144 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:36.796803 21144 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.797046 21291 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.799160 21145 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:36.805845 21144 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:36.807158 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:36.807289 21291 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:36.807924 22376 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.808295 22437 raft_consensus.cc:993] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:36.808350 22376 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:36.808764 22437 raft_consensus.cc:1081] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:36.809271 22376 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:36.813431 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:36.814079 21144 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.814460 21144 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.816424 21048 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.826949 21144 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.829087 21046 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.830082 21144 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:36.830514 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:36.831183 21222 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.830550 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:36.832029 21291 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.832291 21291 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:36.832945 21291 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:36.833747 22287 consensus_queue.cc:1175] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:06:36.834282 21291 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.839112 21222 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:36.842525 21291 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:36.842530 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:36.843837 22422 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.844326 22422 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:36.845261 22422 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:36.862718 21048 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.998914 22406 raft_consensus.cc:993] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:36.999397 22436 raft_consensus.cc:1081] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:37.000669 21810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52780
I20260709 13:06:37.001123 21810 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.001413 21810 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.005904 21810 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.007483 21810 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:37.008385 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:37.008085 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:37.009124 21222 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.009212 21144 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.009495 21222 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:37.010301 21222 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.011418 21222 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.011701 22418 raft_consensus.cc:993] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:37.012189 22339 raft_consensus.cc:1081] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:37.013687 21810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:37.014194 21810 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.014560 21810 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.016654 21222 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:37.017752 21144 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:37.017892 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:37.018700 22376 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.022235 22376 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:37.023088 22376 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.023044 21810 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.029577 21810 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:37.030431 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:37.030975 21298 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.031344 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:37.031955 21144 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.032270 21144 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:37.032974 21144 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.034138 21144 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.037017 21298 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:37.038143 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:37.038755 22376 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.039245 22376 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:37.040076 22376 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:37.040724 21144 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:37.041148 21048 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.053550 21048 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.062916 21298 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:37.064229 22406 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.073274 21144 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:37.075284 22407 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.155793 21298 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:37.157075 22436 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.167404 21144 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:37.168895 22406 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.237018 21144 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.238219 22287 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.251370 21224 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.252792 22437 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.353319 21297 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.354364 22475 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.366308 21145 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.369187 22475 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:37.380478 21224 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.382347 22417 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.383292 21297 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.384647 22417 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.538311 21145 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.539561 22475 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.544811 21298 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.546857 22490 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.633440 21224 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.633700 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.634865 22490 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.640245 21144 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.642282 22475 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.704299 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.759429 21298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:37.759958 21298 raft_consensus.cc:606] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:37.762524 21298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:37.763024 21298 raft_consensus.cc:606] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:37.765468 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:37.765982 21224 raft_consensus.cc:606] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:37.768595 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:37.769088 21224 raft_consensus.cc:606] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:37.774411 21297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:37.774950 21297 raft_consensus.cc:606] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:37.776417 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:37.777663 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:37.787782 21224 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:37.793720 21297 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:37.794237 21190 consensus_peers.cc:597] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a0495c200ee4175916ed50c64ff61a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.794836 21144 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.795011 22401 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.796247 22443 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.804381 22443 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.805449 21297 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.810727 21144 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.820091 21145 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:37.822793 21048 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.850771 21297 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:37.851666 21115 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02e32a83beeb475fa3edaac416334c5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.852001 21222 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.852216 22422 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.853401 22339 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.864349 22441 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.866591 21297 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.882661 21046 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.883982 21222 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.895706 21224 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:37.907166 21297 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:37.907925 21190 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 198128dc1acc4c9bbe56ff48a07e23a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.909026 21142 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:37.910235 22406 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.911060 22401 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.916978 22401 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.920320 21297 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.923949 21142 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.937297 21144 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:37.938829 21046 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.956291 21297 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.959851 22417 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:37.966637 21115 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 398cfd943855433fb7159548a64fbe6e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.968974 21224 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.971083 22417 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.995419 21298 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:37.997676 22427 raft_consensus.cc:993] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:37.998181 22427 raft_consensus.cc:1081] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:38.001308 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:37.993481 22422 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:38.001868 21144 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.002312 21144 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.005566 21222 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:38.015610 21048 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:38.019587 21144 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.022662 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:38.023188 21297 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.023515 21297 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:38.024173 21297 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.025158 21297 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.027913 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:38.028472 21217 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.033950 21297 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:38.034832 21144 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:38.035213 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:38.036267 22422 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.034960 21217 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:38.036899 22422 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:38.037979 22422 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.052356 21049 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.086326 22427 raft_consensus.cc:993] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:38.086861 22437 raft_consensus.cc:1081] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:38.088249 21814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52758
I20260709 13:06:38.088656 21814 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.088910 21814 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.094172 21814 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.096376 21814 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:38.096783 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:38.096864 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:38.097842 21217 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.097982 21297 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.098387 21297 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:38.099098 21297 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.100275 21297 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.105937 21217 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:38.107105 21297 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:38.107275 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:38.108151 22489 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.108618 22489 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:38.109437 22489 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.112444 22443 raft_consensus.cc:993] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:38.112914 22401 raft_consensus.cc:1081] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:38.114197 21297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:38.114602 21297 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.114899 21297 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.120407 21297 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.122335 21297 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:38.123425 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:38.124001 21217 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.124290 21217 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:38.125135 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:38.125502 21814 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.127036 21049 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.132732 21814 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:38.134429 21264 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:38.135802 22287 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.136264 22287 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:38.137102 22287 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.138875 21217 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.140224 21217 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.146919 22406 raft_consensus.cc:993] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:38.147403 22406 raft_consensus.cc:1081] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:38.155015 21297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:38.155992 21297 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.156342 21297 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.165442 21297 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.166518 21217 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:38.167402 21049 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.169284 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:38.170058 21142 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.170729 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:38.171337 21297 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:38.172055 21217 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.172405 21217 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:38.173240 21217 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.174460 21217 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.176853 21142 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:38.178222 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:38.178973 22437 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.179492 22437 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:38.180310 22437 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:38.193890 21217 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:38.196542 21049 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.213115 22427 raft_consensus.cc:993] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:38.213531 22437 raft_consensus.cc:1081] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:38.214902 21814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52758
I20260709 13:06:38.215378 21814 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.215691 21814 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.225492 21814 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.228226 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:38.228346 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:38.228770 21814 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:38.228909 21297 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.229297 21297 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:38.230249 21142 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.230006 21297 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.231180 21297 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.234953 21142 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:38.235944 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:38.236563 22489 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.236991 22489 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:38.237179 21297 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:38.237807 22489 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:38.253171 21049 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.278564 22515 ts_tablet_manager.cc:933] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:38.286226 22515 tablet_copy_client.cc:323] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:38.287822 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 02e32a83beeb475fa3edaac416334c5d from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:38.288342 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 02e32a83beeb475fa3edaac416334c5d from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-02e32a83beeb475fa3edaac416334c5d
I20260709 13:06:38.293334 21161 tablet_copy_source_session.cc:215] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:38.296147 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e32a83beeb475fa3edaac416334c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.312489 22515 tablet_copy_client.cc:806] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:38.313097 22515 tablet_copy_client.cc:670] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:38.317019 22515 tablet_copy_client.cc:538] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:38.324486 22515 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:38.339929 22515 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.340654 22515 tablet_bootstrap.cc:492] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:38.341279 22515 ts_tablet_manager.cc:1403] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:06:38.344249 22515 raft_consensus.cc:359] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.345049 22515 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:38.345691 22515 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.349566 22515 ts_tablet_manager.cc:1434] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:38.350200 22518 ts_tablet_manager.cc:933] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:38.353947 22518 tablet_copy_client.cc:323] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:38.355545 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 198128dc1acc4c9bbe56ff48a07e23a4 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:38.356060 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 198128dc1acc4c9bbe56ff48a07e23a4 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-198128dc1acc4c9bbe56ff48a07e23a4
I20260709 13:06:38.358006 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-02e32a83beeb475fa3edaac416334c5d received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:38.358448 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-02e32a83beeb475fa3edaac416334c5d on tablet 02e32a83beeb475fa3edaac416334c5d with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:38.365128 21236 tablet_copy_source_session.cc:215] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:38.368685 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198128dc1acc4c9bbe56ff48a07e23a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.385643 22518 tablet_copy_client.cc:806] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:38.386245 22518 tablet_copy_client.cc:670] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:38.391520 22518 tablet_copy_client.cc:538] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:38.396498 22515 ts_tablet_manager.cc:933] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:38.400950 22518 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:38.412351 22515 tablet_copy_client.cc:323] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:38.414078 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 0a0495c200ee4175916ed50c64ff61a7 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:38.414605 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 0a0495c200ee4175916ed50c64ff61a7 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-0a0495c200ee4175916ed50c64ff61a7
I20260709 13:06:38.421908 21236 tablet_copy_source_session.cc:215] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:38.425216 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0495c200ee4175916ed50c64ff61a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.444942 22522 ts_tablet_manager.cc:933] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:38.447933 22515 tablet_copy_client.cc:806] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:38.449610 22522 tablet_copy_client.cc:323] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:38.450382 22515 tablet_copy_client.cc:670] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:38.451511 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 398cfd943855433fb7159548a64fbe6e from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:38.452059 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 398cfd943855433fb7159548a64fbe6e from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-398cfd943855433fb7159548a64fbe6e
I20260709 13:06:38.454072 22518 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.454981 22518 tablet_bootstrap.cc:492] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:38.455384 22515 tablet_copy_client.cc:538] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:38.457252 22518 ts_tablet_manager.cc:1403] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.039s
I20260709 13:06:38.460413 22518 raft_consensus.cc:359] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.461244 22518 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:38.461859 22518 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.464637 22518 ts_tablet_manager.cc:1434] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:38.474957 22515 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:38.476478 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-198128dc1acc4c9bbe56ff48a07e23a4 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:38.476967 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-198128dc1acc4c9bbe56ff48a07e23a4 on tablet 198128dc1acc4c9bbe56ff48a07e23a4 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:38.482065 21161 tablet_copy_source_session.cc:215] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:38.492584 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398cfd943855433fb7159548a64fbe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.502380 22515 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.503423 22515 tablet_bootstrap.cc:492] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:38.504150 22515 ts_tablet_manager.cc:1403] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.012s
I20260709 13:06:38.507190 22515 raft_consensus.cc:359] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.508046 22515 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:38.508648 22515 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:38.512022 22515 ts_tablet_manager.cc:1434] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:06:38.515779 21224 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.523517 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-0a0495c200ee4175916ed50c64ff61a7 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:38.523945 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-0a0495c200ee4175916ed50c64ff61a7 on tablet 0a0495c200ee4175916ed50c64ff61a7 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:38.524003 22489 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.533512 21217 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.533654 21222 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.535009 22427 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.535279 22422 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.563771 22522 tablet_copy_client.cc:806] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:38.564407 22522 tablet_copy_client.cc:670] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:38.575943 21814 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.576495 22522 tablet_copy_client.cc:538] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:38.590602 22522 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:38.590729 21297 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.595510 22437 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.597045 22475 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.658506 21298 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.658955 21224 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.660341 22475 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.660642 22427 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:38.727844 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 129508us
I20260709 13:06:38.737850 21291 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.781695 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.769256 22539 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:38.815121 21810 raft_consensus.cc:1217] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:38.822192 21144 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.873765 22522 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.875696 22522 tablet_bootstrap.cc:492] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:38.894793 21814 raft_consensus.cc:1217] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 13:06:38.956992 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 76371.4us
I20260709 13:06:38.958505 22522 ts_tablet_manager.cc:1403] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.368s	user 0.039s	sys 0.048s
I20260709 13:06:38.969007 21143 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.969549 21814 raft_consensus.cc:1217] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:38.978389 22489 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.006116 22522 raft_consensus.cc:359] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:39.011642 22522 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
W20260709 13:06:39.074961 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43513.8us
I20260709 13:06:39.082958 22546 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:39.077705 22522 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:39.133201 22522 ts_tablet_manager.cc:1434] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.174s	user 0.010s	sys 0.000s
I20260709 13:06:39.135150 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-398cfd943855433fb7159548a64fbe6e received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:39.135717 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-398cfd943855433fb7159548a64fbe6e on tablet 398cfd943855433fb7159548a64fbe6e with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:39.227490 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.230487 22533 raft_consensus.cc:1064] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:39.232555 22533 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.240474 21300 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.241806 21814 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.243995 22537 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.245762 22541 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.254341 21224 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.256096 22541 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.283404 22533 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.285187 21300 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.290045 21810 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.303556 21049 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.321445 21224 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.329423 21814 raft_consensus.cc:1217] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:39.361654 21144 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.373193 21224 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:39.373957 21810 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:39.374648 22533 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.375582 22541 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.382272 22537 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.383872 21217 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.394078 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:39.396392 21810 raft_consensus.cc:2955] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.407902 21046 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.419827 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 02e32a83beeb475fa3edaac416334c5d with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:39.434047 22401 raft_consensus.cc:1064] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:39.434748 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02e32a83beeb475fa3edaac416334c5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:39.438587 21144 raft_consensus.cc:606] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:39.437879 22401 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.443979 21300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:39.444490 21300 raft_consensus.cc:606] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:39.448132 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:39.449096 21217 raft_consensus.cc:606] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:39.455699 22441 raft_consensus.cc:993] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:39.456135 22441 raft_consensus.cc:1081] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:39.457698 21297 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:39.458648 21812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:39.459199 21812 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.459518 21812 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.460745 21144 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:39.461027 21810 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:39.461597 21300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:39.462110 21300 raft_consensus.cc:606] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:39.463949 22552 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.465950 22552 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.467047 22554 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.472287 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:39.468528 21812 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.473150 21217 raft_consensus.cc:606] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:39.476796 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:39.474920 21812 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:39.478475 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:39.482200 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:39.482906 21143 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.483341 21143 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:39.483506 22287 raft_consensus.cc:993] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.484118 21143 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.485141 22556 raft_consensus.cc:1081] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.485353 21143 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.487353 21142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:39.488081 21142 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.488616 21142 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.493552 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:39.494604 21224 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.499483 22554 raft_consensus.cc:1064] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:39.502696 22554 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.514590 21143 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
W20260709 13:06:39.515285 22568 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:06:39.524178 21810 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.524698 21297 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.527726 21145 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.536075 22567 tablet_replica.cc:333] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:39.536445 22554 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.539727 21142 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.542174 22567 raft_consensus.cc:2243] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.537912 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:39.540783 22551 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.528379 21224 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:39.543897 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:39.547930 21217 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.548126 22490 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.548537 22490 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:39.549360 22490 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.545799 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:39.554383 21292 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.554733 21292 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:39.555648 21292 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.556797 21292 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.556613 22552 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.558158 22567 raft_consensus.cc:2272] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.564576 21217 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.566049 21114 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:39.568136 22538 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.546231 21142 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:39.568637 22538 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:39.569907 22538 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.566316 22554 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.571550 21300 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.576151 22567 ts_tablet_manager.cc:1916] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:39.575465 21145 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.598246 22551 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.599114 21047 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.600147 21046 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.612664 22287 raft_consensus.cc:993] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.620373 22550 raft_consensus.cc:1081] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.623116 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:39.623680 21144 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.624039 21144 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.605101 21297 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.642838 21814 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.656044 21292 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.665984 21144 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.674595 21144 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:39.686594 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:39.687239 21297 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.687561 21297 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:39.698705 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:39.722172 21811 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.731624 21297 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.732815 21297 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.732254 21047 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.746446 22554 raft_consensus.cc:993] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.718967 21046 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.747068 22554 raft_consensus.cc:1081] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:39.759864 21142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:06:39.764356 21142 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.770558 21142 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.772173 21145 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.766992 22567 ts_tablet_manager.cc:1929] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:39.781113 22567 log.cc:1199] T 02e32a83beeb475fa3edaac416334c5d P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/02e32a83beeb475fa3edaac416334c5d
I20260709 13:06:39.774245 21810 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.785074 21297 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.789372 22554 raft_consensus.cc:993] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:39.789896 22554 raft_consensus.cc:1081] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:39.789151 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:39.799310 22537 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.799777 22537 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:39.800688 22537 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.775051 21811 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.783486 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 02e32a83beeb475fa3edaac416334c5d (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:39.796145 21142 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.811187 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:39.811748 21224 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.812016 21224 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:39.812688 21224 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.813709 21224 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.816262 21217 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.817806 21142 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:39.821506 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:39.822024 21810 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.826485 21142 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:39.828209 21300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:39.828797 21300 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.829284 21810 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.829507 21300 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.831501 22578 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.832509 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:39.833320 22539 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.834605 21814 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:39.833856 22539 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:39.835812 22539 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.836663 22582 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.843281 21046 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.846889 21224 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:39.849427 22401 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:06:39.852706 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45505.3us
I20260709 13:06:39.852679 21811 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.860669 21217 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.861335 21300 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.863086 21300 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:39.869135 21814 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:39.869343 21297 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:39.870457 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:39.871024 21222 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.870858 22554 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.871431 21222 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:39.872014 22544 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.872196 21222 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.873247 21222 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.878775 21145 raft_consensus.cc:2955] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.880272 22544 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.888379 22537 raft_consensus.cc:1064] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:39.897014 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 198128dc1acc4c9bbe56ff48a07e23a4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:39.890885 22537 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:39.896306 21814 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.904368 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a0495c200ee4175916ed50c64ff61a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:39.909828 21048 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 4 to 5, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.915095 21222 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:39.916131 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:39.916332 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:39.916956 22550 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.917436 22550 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:39.918262 22550 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:39.915247 21297 raft_consensus.cc:2955] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.921059 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 198128dc1acc4c9bbe56ff48a07e23a4 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:39.921897 22567 tablet_replica.cc:333] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:39.922850 22567 raft_consensus.cc:2243] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.923564 22567 raft_consensus.cc:2272] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.926661 22567 ts_tablet_manager.cc:1916] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:39.933072 21814 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.933524 21292 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.934654 21220 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:39.935211 22538 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.936100 22539 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.936460 21047 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:39.937949 22539 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.937846 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.953768 22567 ts_tablet_manager.cc:1929] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:39.954334 22567 log.cc:1199] T 198128dc1acc4c9bbe56ff48a07e23a4 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/198128dc1acc4c9bbe56ff48a07e23a4
I20260709 13:06:39.957787 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 198128dc1acc4c9bbe56ff48a07e23a4 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:39.916961 21142 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.960098 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a0495c200ee4175916ed50c64ff61a7 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:39.961648 21049 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:40.018198 22588 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:06:40.026671 22591 tablet_replica.cc:333] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:40.046855 21142 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:40.053608 22591 raft_consensus.cc:2243] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.054702 22591 raft_consensus.cc:2272] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.060580 22591 ts_tablet_manager.cc:1916] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:40.066232 22441 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.073027 21222 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:40.075012 21222 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.081127 22539 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:40.184818 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 159660us
W20260709 13:06:40.205971 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 104510us
I20260709 13:06:40.232331 22591 ts_tablet_manager.cc:1929] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:40.235652 22591 log.cc:1199] T 0a0495c200ee4175916ed50c64ff61a7 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/0a0495c200ee4175916ed50c64ff61a7
I20260709 13:06:40.246397 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 0a0495c200ee4175916ed50c64ff61a7 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:40.250010 21222 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.250172 21220 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.252708 22538 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.258492 21810 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.265601 21049 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.276151 21291 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.280423 21297 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:40.288712 22533 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.317497 21220 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:40.319274 22437 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.322466 21291 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.327227 22537 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:40.336851 21142 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:40.361729 21142 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:40.363902 22581 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.365293 21292 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:40.379601 22533 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:40.385385 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 87357.8us
I20260709 13:06:40.388164 21143 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.398566 22489 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.405329 21811 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.406666 21814 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.408890 21810 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:40.408756 22489 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.413515 22537 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.415767 22538 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.416090 22592 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:40.418699 22533 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.419677 21297 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.432717 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 398cfd943855433fb7159548a64fbe6e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:40.444404 21812 raft_consensus.cc:2955] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.446851 21049 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:40.482046 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:40.506104 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 398cfd943855433fb7159548a64fbe6e with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:40.517230 22609 tablet_replica.cc:333] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:40.518343 22609 raft_consensus.cc:2243] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.519124 22609 raft_consensus.cc:2272] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.522634 22609 ts_tablet_manager.cc:1916] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:40.537681 22609 ts_tablet_manager.cc:1929] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:40.538170 22609 log.cc:1199] T 398cfd943855433fb7159548a64fbe6e P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/398cfd943855433fb7159548a64fbe6e
I20260709 13:06:40.540508 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 398cfd943855433fb7159548a64fbe6e (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:40.578763 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:40.614969 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:40.615546 21145 raft_consensus.cc:606] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:40.618001 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:40.618494 21142 raft_consensus.cc:606] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:40.620575 21292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:40.620965 21292 raft_consensus.cc:606] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:40.623049 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:40.623430 21142 raft_consensus.cc:606] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:40.624280 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:40.625362 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:40.646765 22538 raft_consensus.cc:993] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:40.647346 22533 raft_consensus.cc:1081] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:40.648792 21220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:40.649199 21220 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.649461 21220 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.654379 21220 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.655750 21220 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:40.656343 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:40.656680 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:40.656942 21142 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.657241 21142 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:40.657256 21292 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.657974 21142 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.658836 21142 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.662252 21292 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:40.663034 21142 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:40.663520 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:40.664240 22544 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.664844 22544 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:40.665527 22544 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.675244 21047 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.705730 22556 raft_consensus.cc:993] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:40.706176 22437 raft_consensus.cc:1081] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:40.707612 21220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55554
I20260709 13:06:40.708033 21220 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.708381 21220 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.714365 21220 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:40.716053 21220 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:40.716615 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:40.717187 21292 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.717408 21292 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:40.718106 21292 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:40.719025 21292 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.720141 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:40.720569 21812 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.724444 21292 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:40.725521 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:40.725615 21812 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:40.726204 22544 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.726933 22544 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:40.727783 22544 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:40.737717 21047 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.811975 22537 raft_consensus.cc:993] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:40.812476 22538 raft_consensus.cc:1081] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:40.813735 21292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d3af139eae4d85981a3afde9289604"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:40.814196 21292 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.814487 21292 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.819005 21292 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.822734 21292 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:40.823963 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:40.824532 21222 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.825495 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:40.826078 21145 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:40.826350 21145 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:40.827044 21145 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.828299 21145 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.831849 21222 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:06:40.833304 21263 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:40.834020 22437 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:40.834807 22437 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:40.835196 21145 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:06:40.835925 22437 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:40.844442 21047 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 4, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.994045 22533 raft_consensus.cc:993] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:40.994549 22538 raft_consensus.cc:1081] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:40.996003 21812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:40.996547 21812 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.996883 21812 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.003998 21812 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.006318 21812 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:41.006376 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:41.007021 21142 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.007356 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:41.008108 21292 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.007352 21142 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:41.009717 21142 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.010658 21142 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.012990 21292 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:41.014007 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:41.014761 22598 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.015612 21142 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:41.017300 22598 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:41.018256 22598 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.025291 21047 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.079522 21292 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.080544 22544 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.089439 21142 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.093593 22544 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.159606 21292 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.160923 22544 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.170615 21812 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.173307 22554 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:41.323081 21143 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:41.324642 22437 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:41.335824 21220 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:41.337482 22625 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:41.469956 21143 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.471415 22613 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.479336 21292 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.480978 22613 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.577373 21220 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:41.582598 21143 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:41.583771 21190 consensus_peers.cc:597] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba1398186a7e4fe393aecbc014b953c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:41.583917 22554 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.583771 21292 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:41.586705 22554 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.591240 22620 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.596494 21292 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.602129 21143 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.616742 21220 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:41.617210 21047 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.626101 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:41.626667 21190 consensus_peers.cc:597] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28a3e5fa488f4d4f813752adf6415abe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:41.627378 21292 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:41.628775 22622 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.634462 21143 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:41.636454 22622 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.667181 22554 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.668849 21297 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.692535 21046 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.694193 21143 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.696429 21220 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:41.720636 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:41.720733 21292 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:41.721053 21190 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b58884ca99bd494292202a75faf1833c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:41.722206 21143 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:41.723429 22544 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.724331 22622 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.742026 22622 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.758586 21143 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.764307 21047 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.759169 21297 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:06:41.782384 21264 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28d3af139eae4d85981a3afde9289604. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:41.783401 21222 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:41.785413 22437 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.782567 21292 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.788240 21143 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:41.789685 22625 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.792059 22550 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.797463 21222 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.798931 21143 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:41.803334 21220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:41.803857 21220 raft_consensus.cc:606] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:41.807484 21220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605603ac2631443292cd7278cf055b51"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:41.807968 21220 raft_consensus.cc:606] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:41.810650 21297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:41.811288 21297 raft_consensus.cc:606] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:41.812781 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:41.814464 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:41.825320 21047 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.844455 22622 raft_consensus.cc:993] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:41.844926 22622 raft_consensus.cc:1081] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:41.846541 21145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:06:41.847070 21145 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:41.847435 21145 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.853569 21145 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.856024 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:41.856612 21222 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.856951 21222 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:41.857779 21222 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.858814 21222 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.864926 21222 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:41.866127 21114 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:41.867197 22533 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.867674 22533 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:41.868383 22533 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.876583 22622 raft_consensus.cc:993] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:41.877029 21145 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:41.877562 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:41.878090 21812 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.879954 21049 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 2 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.882472 22622 raft_consensus.cc:1081] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:41.884090 21292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605603ac2631443292cd7278cf055b51"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:41.884524 21292 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:41.884821 21292 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.886663 21812 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:41.889508 21292 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.896245 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:41.895531 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:41.896777 21812 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.896965 21222 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.897454 21222 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:41.898190 21222 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.899272 21222 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.902892 21812 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:41.892405 21292 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:41.904704 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:41.905440 22437 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.905850 22437 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:41.905889 21222 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:41.906620 22437 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:41.916949 21049 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.031857 22642 ts_tablet_manager.cc:933] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:42.033272 22642 tablet_copy_client.cc:323] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:42.034956 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet ba1398186a7e4fe393aecbc014b953c9 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:42.035452 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet ba1398186a7e4fe393aecbc014b953c9 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-ba1398186a7e4fe393aecbc014b953c9
I20260709 13:06:42.041373 21236 tablet_copy_source_session.cc:215] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:42.044070 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1398186a7e4fe393aecbc014b953c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:42.062794 22642 tablet_copy_client.cc:806] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.063529 22642 tablet_copy_client.cc:670] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.073665 22642 tablet_copy_client.cc:538] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.085556 22642 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:42.089850 22437 raft_consensus.cc:993] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:42.090482 22437 raft_consensus.cc:1081] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:42.092139 22645 ts_tablet_manager.cc:933] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:42.093479 21145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:42.094026 21145 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.094377 21145 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.103418 21145 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:42.107139 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:42.107895 21292 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.108250 21292 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:42.109275 21292 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:42.110630 21292 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.108502 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:42.112192 21217 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.137701 21217 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:42.139329 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:42.141119 22538 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.141781 22538 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:42.143049 22538 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:42.148142 21145 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:42.137661 21292 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:42.177196 22645 tablet_copy_client.cc:323] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:42.178817 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 28a3e5fa488f4d4f813752adf6415abe from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:42.179441 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 28a3e5fa488f4d4f813752adf6415abe from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-28a3e5fa488f4d4f813752adf6415abe
I20260709 13:06:42.185571 21049 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.187335 21236 tablet_copy_source_session.cc:215] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:42.193830 22645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a3e5fa488f4d4f813752adf6415abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:42.239672 22645 tablet_copy_client.cc:806] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.240224 22645 tablet_copy_client.cc:670] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.243722 22645 tablet_copy_client.cc:538] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.248826 22642 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:42.252815 22642 tablet_bootstrap.cc:492] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:42.253502 22642 ts_tablet_manager.cc:1403] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.007s
I20260709 13:06:42.256456 22642 raft_consensus.cc:359] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:42.257258 22642 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:42.257539 22645 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:42.257915 22642 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:42.268357 22642 ts_tablet_manager.cc:1434] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:06:42.270641 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-ba1398186a7e4fe393aecbc014b953c9 received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:42.271068 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-ba1398186a7e4fe393aecbc014b953c9 on tablet ba1398186a7e4fe393aecbc014b953c9 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:42.285349 22645 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:42.286229 22645 tablet_bootstrap.cc:492] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:42.286878 22645 ts_tablet_manager.cc:1403] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.005s
I20260709 13:06:42.293807 22645 raft_consensus.cc:359] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:42.294643 22645 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:42.295291 22645 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:42.297673 22645 ts_tablet_manager.cc:1434] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:42.299407 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-28a3e5fa488f4d4f813752adf6415abe received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:42.299817 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-28a3e5fa488f4d4f813752adf6415abe on tablet 28a3e5fa488f4d4f813752adf6415abe with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:42.332026 21217 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.333287 22649 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.334883 22645 ts_tablet_manager.cc:933] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:42.337600 22645 tablet_copy_client.cc:323] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:42.339178 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet b58884ca99bd494292202a75faf1833c from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:42.339715 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet b58884ca99bd494292202a75faf1833c from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-b58884ca99bd494292202a75faf1833c
I20260709 13:06:42.350819 21812 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.352057 22639 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.371582 21222 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.373447 22639 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.389569 22642 ts_tablet_manager.cc:933] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:42.445264 21814 raft_consensus.cc:1217] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:42.492380 21814 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.500468 21236 tablet_copy_source_session.cc:215] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:42.523891 22642 tablet_copy_client.cc:323] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:42.526412 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 28d3af139eae4d85981a3afde9289604 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:42.526963 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 28d3af139eae4d85981a3afde9289604 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-28d3af139eae4d85981a3afde9289604
I20260709 13:06:42.530776 22663 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.534011 21220 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:42.535459 22662 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:42.537400 21309 tablet_copy_source_session.cc:215] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:42.541133 21297 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:42.542447 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d3af139eae4d85981a3afde9289604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:42.542418 22662 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:42.572041 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67980.5us
I20260709 13:06:42.585264 22642 tablet_copy_client.cc:806] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.589188 22642 tablet_copy_client.cc:670] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.602685 22645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58884ca99bd494292202a75faf1833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:42.631402 22642 tablet_copy_client.cc:538] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.641063 22642 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
W20260709 13:06:42.647357 21776 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.BeginTabletCopySession -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46265.2us
I20260709 13:06:42.667661 21811 raft_consensus.cc:1217] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:42.652043 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 79375.5us
W20260709 13:06:42.809087 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 94156.1us
W20260709 13:06:42.836400 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 109603us
W20260709 13:06:42.809096 22667 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:06:42.858609 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46014.4us
W20260709 13:06:43.122135 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 312330us
I20260709 13:06:43.086155 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:43.162135 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 96866us
W20260709 13:06:43.165207 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 303607us
I20260709 13:06:43.203191 22645 tablet_copy_client.cc:806] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
W20260709 13:06:43.228355 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 55570.4us
I20260709 13:06:43.228509 22645 tablet_copy_client.cc:670] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:43.289742 22642 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:43.290793 22642 tablet_bootstrap.cc:492] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
W20260709 13:06:43.290974 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58016.3us
W20260709 13:06:43.296923 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 137392us
I20260709 13:06:43.311326 22642 ts_tablet_manager.cc:1403] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.670s	user 0.070s	sys 0.058s
I20260709 13:06:43.322947 22642 raft_consensus.cc:359] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:43.335412 22642 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:43.336182 22642 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:43.344302 22642 ts_tablet_manager.cc:1434] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:06:43.363574 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-28d3af139eae4d85981a3afde9289604 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:43.364039 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-28d3af139eae4d85981a3afde9289604 on tablet 28d3af139eae4d85981a3afde9289604 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:43.370996 22645 tablet_copy_client.cc:538] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:43.381428 22645 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:43.384290 21814 raft_consensus.cc:1217] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:06:43.395771 22622 raft_consensus.cc:1064] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
W20260709 13:06:43.396195 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59150.7us
I20260709 13:06:43.398778 22622 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:43.404122 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59611.9us
W20260709 13:06:43.406396 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 68837.8us
I20260709 13:06:43.429001 22672 raft_consensus.cc:1064] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:43.435878 22672 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:43.472059 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69861us
I20260709 13:06:43.475136 22645 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:43.477082 22645 tablet_bootstrap.cc:492] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:43.477821 22645 ts_tablet_manager.cc:1403] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.017s
I20260709 13:06:43.478559 21298 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.478727 21810 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.480337 22697 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.481153 22700 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.502625 21143 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.481118 22645 raft_consensus.cc:359] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:43.503176 22645 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:43.503913 22645 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:43.505215 22554 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:43.507519 21812 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:43.508522 21297 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:43.509016 22622 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.510008 21144 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:43.511621 22554 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.513252 22554 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.525849 22645 ts_tablet_manager.cc:1434] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:06:43.536417 22554 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.536798 22700 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.539387 21810 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.542590 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:43.547868 21144 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.566740 21810 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.575755 21297 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.572299 21049 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.584645 21145 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.587819 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-b58884ca99bd494292202a75faf1833c received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:43.588300 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-b58884ca99bd494292202a75faf1833c on tablet b58884ca99bd494292202a75faf1833c with peer 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:43.589447 22710 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:43.607719 21046 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.626495 21298 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.704432 21222 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:43.707160 21298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:43.707758 21298 raft_consensus.cc:606] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:43.713017 21814 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.714547 22700 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.714931 21298 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.716747 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574f49e93265460891ff981be2cee774"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:43.717209 22700 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.717262 21145 raft_consensus.cc:606] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:43.719588 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:43.721149 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:43.721416 22622 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.722929 21814 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.732017 21222 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:43.732400 21298 raft_consensus.cc:2955] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.733506 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba1398186a7e4fe393aecbc014b953c9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:43.736809 21810 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:43.738159 22700 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.743115 21046 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 4 to 5, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.747890 21300 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:43.750222 22554 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.754261 22554 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.757663 21814 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.764508 21300 raft_consensus.cc:2955] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:43.770561 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28a3e5fa488f4d4f813752adf6415abe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:43.773172 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet ba1398186a7e4fe393aecbc014b953c9 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:43.774806 22719 tablet_replica.cc:333] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:43.776115 22719 raft_consensus.cc:2243] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.777105 22719 raft_consensus.cc:2272] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.781198 22719 ts_tablet_manager.cc:1916] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:43.780596 21046 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.804049 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 28a3e5fa488f4d4f813752adf6415abe with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:43.814682 22719 ts_tablet_manager.cc:1929] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:43.815193 22719 log.cc:1199] T ba1398186a7e4fe393aecbc014b953c9 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/ba1398186a7e4fe393aecbc014b953c9
I20260709 13:06:43.828269 22719 tablet_replica.cc:333] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:43.828202 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet ba1398186a7e4fe393aecbc014b953c9 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:43.829387 22719 raft_consensus.cc:2243] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.830024 22719 raft_consensus.cc:2272] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.836297 22719 ts_tablet_manager.cc:1916] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:43.851362 22719 ts_tablet_manager.cc:1929] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:43.851737 22719 log.cc:1199] T 28a3e5fa488f4d4f813752adf6415abe P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/28a3e5fa488f4d4f813752adf6415abe
I20260709 13:06:43.853271 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 28a3e5fa488f4d4f813752adf6415abe (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:43.914373 22662 raft_consensus.cc:993] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:43.914969 22662 raft_consensus.cc:1081] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:43.917124 21222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "574f49e93265460891ff981be2cee774"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:43.917665 21222 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:43.918015 21222 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.932981 22681 raft_consensus.cc:1064] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:43.936437 21222 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:43.947268 21222 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:43.939442 22681 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:43.950426 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:43.954188 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:43.954597 21144 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.954766 21300 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.954949 21144 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:43.955786 21144 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:43.956976 21144 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.962849 21300 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:43.968405 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:43.969169 22622 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.969647 22622 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:43.970449 22622 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:43.985495 21144 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:43.991034 21225 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:43.993624 22705 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:43.996268 21145 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:44.000324 22681 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:44.000056 21046 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.013418 21814 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:44.015538 22681 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:44.023828 22437 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.033895 22705 raft_consensus.cc:993] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:44.036291 22639 raft_consensus.cc:1081] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:44.049106 21145 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.048151 21814 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.068140 21810 raft_consensus.cc:1217] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:44.076903 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43703.4us
I20260709 13:06:44.078413 21145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:06:44.078939 21145 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:44.079299 21145 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.074677 21046 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.097185 21222 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.106021 21145 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:44.108024 21145 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:44.108670 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:44.108892 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:44.109257 21225 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.109476 21297 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.111454 21297 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:44.112219 21297 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:44.113440 21297 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.116060 21225 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:44.117182 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:44.118377 22689 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.118839 22689 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:44.119671 22689 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:44.130801 21300 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:44.133392 21297 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:44.137359 21814 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:44.137595 21046 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.138795 22726 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:44.138332 21145 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:44.147786 22727 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:44.150976 22705 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.152513 21810 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.153800 21143 raft_consensus.cc:2955] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.173295 21046 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 6 to 7, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.177568 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28d3af139eae4d85981a3afde9289604 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:44.184329 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 28d3af139eae4d85981a3afde9289604 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:44.187812 22729 tablet_replica.cc:333] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:44.188815 22729 raft_consensus.cc:2243] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:44.189603 22729 raft_consensus.cc:2272] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:44.192852 22729 ts_tablet_manager.cc:1916] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:44.208729 22729 ts_tablet_manager.cc:1929] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:06:44.209179 22729 log.cc:1199] T 28d3af139eae4d85981a3afde9289604 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/28d3af139eae4d85981a3afde9289604
I20260709 13:06:44.210613 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 28d3af139eae4d85981a3afde9289604 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:44.357307 21297 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:44.358665 22554 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:44.372934 21143 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:44.374686 22698 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:44.487614 22622 raft_consensus.cc:1064] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:44.489728 22622 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:44.498922 21297 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:44.499135 21810 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:44.500756 22554 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:44.501622 21143 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:44.503531 22554 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:44.506767 22622 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:44.517621 22622 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.519515 21144 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.523497 21297 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.530915 21810 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.538816 21049 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.574234 21222 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:44.579463 21144 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:44.581661 22698 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.582122 21810 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:44.583227 21300 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:44.584066 22554 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.584717 22689 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.594183 22554 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.596221 21144 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.626456 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b58884ca99bd494292202a75faf1833c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:44.629997 21048 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.633960 21812 raft_consensus.cc:2955] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:44.636315 21222 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:44.641695 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet b58884ca99bd494292202a75faf1833c with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:44.653147 22743 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:44.683382 22742 tablet_replica.cc:333] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:44.688203 22742 raft_consensus.cc:2243] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:44.688983 22742 raft_consensus.cc:2272] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:44.691689 22742 ts_tablet_manager.cc:1916] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:44.703018 22742 ts_tablet_manager.cc:1929] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:44.703711 22742 log.cc:1199] T b58884ca99bd494292202a75faf1833c P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/b58884ca99bd494292202a75faf1833c
I20260709 13:06:44.705250 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet b58884ca99bd494292202a75faf1833c (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:44.722080 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.886520 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.926652 21225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:44.927143 21225 raft_consensus.cc:606] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:44.929877 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:44.930428 21144 raft_consensus.cc:606] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:44.933195 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:44.933693 21144 raft_consensus.cc:606] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:44.935087 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:44.937392 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:45.079413 22689 raft_consensus.cc:993] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:45.079932 22741 raft_consensus.cc:1081] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:06:45.081140 21300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:06:45.081578 21300 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.081856 21300 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.086674 21300 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.088511 21300 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:45.089011 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:45.089598 21143 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.089902 21143 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:45.090322 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:45.090466 21143 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.090745 21222 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.091364 21143 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.094813 21222 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:45.095419 21143 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:45.095832 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:45.096546 22727 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.097121 22727 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:45.097913 22727 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.107991 21048 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.276286 22741 raft_consensus.cc:993] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:45.276733 22689 raft_consensus.cc:1081] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:45.278059 21810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:06:45.278518 21810 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.278851 21810 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.283903 21810 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:45.285737 21810 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:45.286248 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:45.286928 21144 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.287192 21144 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:45.287940 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:45.287914 21144 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:45.288587 21300 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.289074 21144 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.292826 21300 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:45.293392 21144 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:45.293870 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:45.294600 22704 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.295089 22704 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:45.295951 22704 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:45.305948 21048 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.318048 22622 raft_consensus.cc:993] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:45.318478 22554 raft_consensus.cc:1081] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:45.319661 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:06:45.320083 21144 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.320362 21144 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.325176 21144 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.328120 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:45.328332 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:45.328666 21225 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.328963 21300 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.328994 21225 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:45.329137 21144 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:45.330017 21225 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.331120 21225 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.339085 21300 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:45.340757 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:45.341739 22689 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.342221 22689 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:45.343713 22689 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:45.345956 21225 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:45.354982 21048 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 2 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.542757 21225 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:45.543919 22727 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.556769 21144 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:45.559052 22727 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.675779 21298 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:45.677165 22704 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:45.712324 21143 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:45.716136 22688 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.771417 21143 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:45.777474 21300 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:06:45.777547 21115 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19d2a839d8cf43eea500e735e58a9e28. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.778863 21225 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:45.778834 22759 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.780251 22741 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:45.787122 22741 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.793406 21300 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.801268 21297 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:45.802565 21220 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.817802 21220 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:45.818496 21143 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:45.819396 22726 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.820313 22705 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.817523 21047 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 5, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:45.821539 21264 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 425aa4009f134d7c94f0050facfd0811. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.839906 22726 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.841787 21143 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.848836 21220 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.854391 21297 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:45.859706 21049 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.862069 21300 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:45.863791 22759 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:45.864318 21264 consensus_peers.cc:597] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e7b1fec990b4785a3b45b520909244c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.869081 21143 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:45.869072 21220 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:45.870345 22726 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.871054 22727 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.879984 22727 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.887243 21222 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:45.888827 22741 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.901607 21225 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:45.909386 21047 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 4, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.915373 21220 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:06:45.922000 21190 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8a59065e5d64bc09a27e51c9955775d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.923810 21297 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:45.926122 22755 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.938293 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:45.938354 21143 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:45.940074 22622 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.951392 22755 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.954350 21144 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.954926 21143 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.963176 21297 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:45.976293 21048 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.178073 22773 ts_tablet_manager.cc:933] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:46.180004 22773 tablet_copy_client.cc:323] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:46.181962 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet 19d2a839d8cf43eea500e735e58a9e28 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:46.182485 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet 19d2a839d8cf43eea500e735e58a9e28 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-19d2a839d8cf43eea500e735e58a9e28
I20260709 13:06:46.188918 21161 tablet_copy_source_session.cc:215] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:46.191633 22773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d2a839d8cf43eea500e735e58a9e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.202812 22773 tablet_copy_client.cc:806] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:46.203435 22773 tablet_copy_client.cc:670] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:46.207304 22773 tablet_copy_client.cc:538] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:46.214283 22773 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:46.238570 22773 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.239573 22773 tablet_bootstrap.cc:492] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:46.240280 22773 ts_tablet_manager.cc:1403] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.004s
I20260709 13:06:46.243084 22773 raft_consensus.cc:359] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.243891 22773 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:46.244585 22773 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.246868 22773 ts_tablet_manager.cc:1434] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:46.249099 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-19d2a839d8cf43eea500e735e58a9e28 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:46.249507 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-19d2a839d8cf43eea500e735e58a9e28 on tablet 19d2a839d8cf43eea500e735e58a9e28 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:46.281229 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:46.326629 22773 ts_tablet_manager.cc:933] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:46.330750 22773 tablet_copy_client.cc:323] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:46.332441 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 425aa4009f134d7c94f0050facfd0811 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:46.332984 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 425aa4009f134d7c94f0050facfd0811 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-425aa4009f134d7c94f0050facfd0811
I20260709 13:06:46.340332 21309 tablet_copy_source_session.cc:215] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:46.343564 22773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425aa4009f134d7c94f0050facfd0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.349208 21300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605603ac2631443292cd7278cf055b51"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:06:46.349799 21300 raft_consensus.cc:606] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:46.352921 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:46.353416 21144 raft_consensus.cc:606] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:46.355103 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:46.356761 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:46.359122 22773 tablet_copy_client.cc:806] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:46.359767 22773 tablet_copy_client.cc:670] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:46.363888 22773 tablet_copy_client.cc:538] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:46.370162 22773 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:46.391757 22773 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.392716 22773 tablet_bootstrap.cc:492] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:46.393674 22773 ts_tablet_manager.cc:1403] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.024s	user 0.025s	sys 0.000s
I20260709 13:06:46.396407 22773 raft_consensus.cc:359] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.397241 22773 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:46.397773 22773 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.399829 22773 ts_tablet_manager.cc:1434] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:06:46.401688 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-425aa4009f134d7c94f0050facfd0811 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:46.402117 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-425aa4009f134d7c94f0050facfd0811 on tablet 425aa4009f134d7c94f0050facfd0811 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:46.423400 22705 raft_consensus.cc:993] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:46.423985 22727 raft_consensus.cc:1081] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:06:46.425565 21814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605603ac2631443292cd7278cf055b51"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52758
I20260709 13:06:46.426069 21814 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:46.426357 21814 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.430397 21814 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.431782 21814 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:46.432714 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:46.432714 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:46.433411 21220 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.433495 21297 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:46.433858 21297 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:46.434543 21297 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.435678 21297 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.439468 21220 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:46.440970 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:46.441807 22688 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.442153 21297 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:46.442269 22688 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:46.443198 22688 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.457064 21047 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.459383 22773 ts_tablet_manager.cc:933] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:46.461081 22773 tablet_copy_client.cc:323] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:46.462641 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 5e7b1fec990b4785a3b45b520909244c from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:46.463207 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 5e7b1fec990b4785a3b45b520909244c from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-5e7b1fec990b4785a3b45b520909244c
I20260709 13:06:46.473227 21309 tablet_copy_source_session.cc:215] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:46.476065 22773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7b1fec990b4785a3b45b520909244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.488000 22773 tablet_copy_client.cc:806] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:46.488505 22773 tablet_copy_client.cc:670] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:46.492328 22773 tablet_copy_client.cc:538] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:46.499934 22773 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:46.521432 22773 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.521776 22781 ts_tablet_manager.cc:933] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:46.522413 22773 tablet_bootstrap.cc:492] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:46.523346 22773 ts_tablet_manager.cc:1403] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:06:46.527053 22773 raft_consensus.cc:359] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.528170 22773 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:46.528192 22781 tablet_copy_client.cc:323] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:46.528904 22773 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.529937 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet e8a59065e5d64bc09a27e51c9955775d from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:46.530468 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet e8a59065e5d64bc09a27e51c9955775d from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-e8a59065e5d64bc09a27e51c9955775d
I20260709 13:06:46.542016 21236 tablet_copy_source_session.cc:215] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:46.543951 22773 ts_tablet_manager.cc:1434] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:06:46.545861 22781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a59065e5d64bc09a27e51c9955775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.547528 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-5e7b1fec990b4785a3b45b520909244c received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:46.547972 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-5e7b1fec990b4785a3b45b520909244c on tablet 5e7b1fec990b4785a3b45b520909244c with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:46.564889 22781 tablet_copy_client.cc:806] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:46.565526 22781 tablet_copy_client.cc:670] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:46.567075 22741 raft_consensus.cc:993] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:46.567602 22741 raft_consensus.cc:1081] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:06:46.570060 22781 tablet_copy_client.cc:538] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:46.575557 21220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
I20260709 13:06:46.576118 21220 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:46.576447 21220 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.580375 22781 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:46.583012 21220 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.585196 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:46.585753 21144 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:46.585901 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:46.586061 21144 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:46.586901 21144 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.587981 21144 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.586498 21814 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.597432 21814 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:46.585330 21220 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:46.598815 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:46.599596 22755 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.600067 22755 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:46.600988 21144 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:46.600852 22755 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:46.614077 21047 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.615523 22781 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.616616 22781 tablet_bootstrap.cc:492] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:46.617316 22781 ts_tablet_manager.cc:1403] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.011s
I20260709 13:06:46.620133 22781 raft_consensus.cc:359] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.620925 22781 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:46.621745 22781 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:46.624614 22781 ts_tablet_manager.cc:1434] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:46.626434 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-e8a59065e5d64bc09a27e51c9955775d received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:46.626801 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-e8a59065e5d64bc09a27e51c9955775d on tablet e8a59065e5d64bc09a27e51c9955775d with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:46.716063 21810 raft_consensus.cc:1217] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:06:46.762125 21810 raft_consensus.cc:1217] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:46.936324 21810 raft_consensus.cc:1217] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:06:46.961035 21810 raft_consensus.cc:1217] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:47.014864 21297 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.016232 22756 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.033968 21220 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.053880 22789 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.230479 21812 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.230669 21144 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.232285 22787 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.232823 22755 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.253422 22727 raft_consensus.cc:1064] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:47.256052 22727 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.260754 22689 raft_consensus.cc:1064] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:47.263659 22689 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.278211 21810 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:47.281226 22786 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:47.302037 21225 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.280841 21220 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:47.303500 22785 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.304286 22786 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.308733 21810 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.310648 21297 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.312037 22785 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.321666 22785 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.330137 21144 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:47.334359 22727 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:47.359037 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:47.405618 22727 raft_consensus.cc:1064] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:47.408610 22727 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.432613 22755 raft_consensus.cc:1064] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:47.432431 22705 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.435622 22755 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.438640 21812 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.441224 22786 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.445088 21222 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.451308 22786 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:47.462598 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 109447us
I20260709 13:06:47.477319 21145 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.475180 21144 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.491546 22741 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.494997 22786 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:47.528230 21810 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:47.530370 21218 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.531539 21810 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.537456 22622 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:47.538935 22808 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.540791 21300 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:47.547878 21047 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.547925 21222 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.559438 22622 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:47.568511 21142 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:47.572131 22755 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:47.596487 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 108469us
I20260709 13:06:47.601774 21291 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:06:47.626780 22801 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:06:47.630992 21220 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:06:47.640103 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58466.8us
I20260709 13:06:47.644269 22622 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.648005 21297 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.667037 21143 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.667287 21810 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.656888 21812 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.677062 21145 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.692342 21297 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.702167 21814 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:47.707785 22786 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.710572 21814 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.718811 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 5 to 6, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.724397 21144 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:47.726164 22817 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.728181 21048 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 4 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.730033 21048 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } attrs { replace: true } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.737708 22808 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.741534 21814 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.742903 21144 raft_consensus.cc:2955] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.748968 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 425aa4009f134d7c94f0050facfd0811 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.765542 21144 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.773487 21814 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:47.776213 22741 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:47.778491 21222 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:47.781203 22741 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:47.784739 22806 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.785907 21297 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.792268 21814 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.780099 21049 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index 4 to 5, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.793591 21222 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:47.798489 21218 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.803781 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 425aa4009f134d7c94f0050facfd0811 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55540
I20260709 13:06:47.805335 22817 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.808080 22822 tablet_replica.cc:333] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:06:47.810949 22822 raft_consensus.cc:2243] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:47.812131 22822 raft_consensus.cc:2272] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.813927 21814 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.818167 21812 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:47.819585 22786 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.826167 21810 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.827821 21145 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:47.828461 22622 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.829429 22822 ts_tablet_manager.cc:1916] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:47.836458 22787 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.848450 21047 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 5 to 6, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.850731 21222 raft_consensus.cc:2955] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.840348 21812 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.856726 22817 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.861016 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e7b1fec990b4785a3b45b520909244c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.869705 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19d2a839d8cf43eea500e735e58a9e28 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.880475 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8a59065e5d64bc09a27e51c9955775d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.887472 22755 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.886439 22822 ts_tablet_manager.cc:1929] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:47.888031 21220 raft_consensus.cc:2955] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.888993 22822 log.cc:1199] T 425aa4009f134d7c94f0050facfd0811 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/425aa4009f134d7c94f0050facfd0811
I20260709 13:06:47.890798 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 425aa4009f134d7c94f0050facfd0811 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:47.878412 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 6 to 7, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.892585 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e7b1fec990b4785a3b45b520909244c with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:35736
I20260709 13:06:47.909710 21145 raft_consensus.cc:2955] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.911247 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d2a839d8cf43eea500e735e58a9e28 with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:47.916591 22825 tablet_replica.cc:333] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:47.917590 22825 raft_consensus.cc:2243] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:47.918254 22825 raft_consensus.cc:2272] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.921737 22825 ts_tablet_manager.cc:1916] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:47.920339 21046 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 3 to 4, VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) evicted. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:47.934796 21290 tablet_service.cc:1558] Processing DeleteTablet for tablet e8a59065e5d64bc09a27e51c9955775d with delete_type TABLET_DATA_TOMBSTONED (TS 7c5246dc52bb49f38aef22aba1467452 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46392
I20260709 13:06:47.938066 22825 ts_tablet_manager.cc:1929] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:06:47.938745 22825 log.cc:1199] T 19d2a839d8cf43eea500e735e58a9e28 P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/19d2a839d8cf43eea500e735e58a9e28
I20260709 13:06:47.940776 22825 tablet_replica.cc:333] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:06:47.940953 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet 19d2a839d8cf43eea500e735e58a9e28 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:47.946595 22824 tablet_replica.cc:333] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:06:47.948117 22824 raft_consensus.cc:2243] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:47.948802 22824 raft_consensus.cc:2272] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.952848 22824 ts_tablet_manager.cc:1916] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:47.955500 22825 raft_consensus.cc:2243] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:47.956183 22825 raft_consensus.cc:2272] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.959708 22825 ts_tablet_manager.cc:1916] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:47.968919 22824 ts_tablet_manager.cc:1929] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:06:47.969400 22824 log.cc:1199] T 5e7b1fec990b4785a3b45b520909244c P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/5e7b1fec990b4785a3b45b520909244c
I20260709 13:06:47.971230 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 5e7b1fec990b4785a3b45b520909244c (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:47.976078 22825 ts_tablet_manager.cc:1929] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:47.976527 22825 log.cc:1199] T e8a59065e5d64bc09a27e51c9955775d P 7c5246dc52bb49f38aef22aba1467452: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/wals/e8a59065e5d64bc09a27e51c9955775d
I20260709 13:06:47.978111 21035 catalog_manager.cc:5028] TS 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): tablet e8a59065e5d64bc09a27e51c9955775d (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:06:47.986694 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.020555 21222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:06:48.020978 21222 raft_consensus.cc:606] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:48.022023 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:06:48.023097 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:48.377766 22787 raft_consensus.cc:993] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:48.378274 22823 raft_consensus.cc:1081] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:06:48.380800 21145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:06:48.381395 21145 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:48.381783 21145 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.386317 21145 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:48.388101 21145 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:48.388899 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:48.389120 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:48.389487 21222 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.389739 21300 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.389864 21222 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:48.390978 21222 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:48.392310 21222 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.397246 21300 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:48.398331 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:48.399159 22741 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.400300 21222 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:48.400373 22741 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:48.401443 22741 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:48.413267 21046 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 2 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.884672 21222 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:48.891484 22741 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:06:48.965040 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48707.6us
I20260709 13:06:49.018587 21298 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.025195 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:49.025271 22806 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:49.213459 21145 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.219518 21222 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:49.219604 21300 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:49.222246 22806 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:49.223464 21115 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df140636c4344f32a0253fef2a907c50. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.224269 22806 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.232466 22834 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.235507 21222 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.236466 21300 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.255829 21046 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.257911 21300 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:06:49.267019 21264 consensus_peers.cc:597] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 881a7cf58d404812aa274b116b666741. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.268427 21222 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:49.269389 21143 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:49.270350 22832 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.272505 22832 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.281886 22838 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.288254 21220 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.288501 21143 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.306545 21048 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.308280 21222 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.317519 21300 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:49.317572 21190 consensus_peers.cc:597] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68ebd645703043ddb9e32ba2d84bbc1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.319191 21143 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:49.319042 22836 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.320950 22823 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.354809 22836 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.360977 21298 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.382701 21046 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 1 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.385558 21300 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.401468 21220 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:49.402063 21143 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.403014 22786 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:49.406802 21264 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Couldn't send request to peer 5e66e7254b764832b244bb5b07b4a208. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b9b6c321dab4a71866dd41996aca451. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.414149 21145 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:49.417752 22832 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.421761 22838 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.423810 21145 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.425834 21222 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:06:49.444932 21046 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index -1 to 3, NON_VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) added. New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.628726 22859 ts_tablet_manager.cc:933] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145)
I20260709 13:06:49.631425 22859 tablet_copy_client.cc:323] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.1:46145
I20260709 13:06:49.633365 21161 tablet_copy_service.cc:140] P 3585d99c303e453c8c3762b294caba4e: Received BeginTabletCopySession request for tablet df140636c4344f32a0253fef2a907c50 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:39282)
I20260709 13:06:49.633992 21161 tablet_copy_service.cc:161] P 3585d99c303e453c8c3762b294caba4e: Beginning new tablet copy session on tablet df140636c4344f32a0253fef2a907c50 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:39282: session id = 5e66e7254b764832b244bb5b07b4a208-df140636c4344f32a0253fef2a907c50
I20260709 13:06:49.641782 21161 tablet_copy_source_session.cc:215] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:49.651142 22859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140636c4344f32a0253fef2a907c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.667496 22859 tablet_copy_client.cc:806] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:49.668080 22859 tablet_copy_client.cc:670] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:49.671329 22859 tablet_copy_client.cc:538] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:49.677726 22859 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:49.696987 22859 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:49.698048 22859 tablet_bootstrap.cc:492] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:49.698789 22859 ts_tablet_manager.cc:1403] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.013s
I20260709 13:06:49.701987 22859 raft_consensus.cc:359] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.702872 22859 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:49.703614 22859 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.706624 22859 ts_tablet_manager.cc:1434] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:49.709103 21161 tablet_copy_service.cc:342] P 3585d99c303e453c8c3762b294caba4e: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-df140636c4344f32a0253fef2a907c50 received from {username='slave'} at 127.0.0.1:39282
I20260709 13:06:49.709544 21161 tablet_copy_service.cc:434] P 3585d99c303e453c8c3762b294caba4e: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-df140636c4344f32a0253fef2a907c50 on tablet df140636c4344f32a0253fef2a907c50 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:49.745749 22859 ts_tablet_manager.cc:933] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:49.747658 22859 tablet_copy_client.cc:323] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:49.749245 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 881a7cf58d404812aa274b116b666741 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:49.749661 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 881a7cf58d404812aa274b116b666741 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-881a7cf58d404812aa274b116b666741
I20260709 13:06:49.755151 21309 tablet_copy_source_session.cc:215] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:49.758080 22859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881a7cf58d404812aa274b116b666741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.771473 22859 tablet_copy_client.cc:806] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:49.772100 22859 tablet_copy_client.cc:670] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:49.775789 22859 tablet_copy_client.cc:538] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:49.784307 22859 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:49.811225 22859 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:49.812181 22859 tablet_bootstrap.cc:492] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:49.812821 22859 ts_tablet_manager.cc:1403] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.018s
I20260709 13:06:49.815641 22859 raft_consensus.cc:359] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.816450 22859 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:49.817065 22859 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.819672 22859 ts_tablet_manager.cc:1434] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:06:49.821580 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-881a7cf58d404812aa274b116b666741 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:49.822063 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-881a7cf58d404812aa274b116b666741 on tablet 881a7cf58d404812aa274b116b666741 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:49.827144 22859 ts_tablet_manager.cc:933] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:49.837946 22859 tablet_copy_client.cc:323] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.2:43757
I20260709 13:06:49.841118 21236 tablet_copy_service.cc:140] P f81bf1abd0b34f518d1f2b79cc4dba77: Received BeginTabletCopySession request for tablet 68ebd645703043ddb9e32ba2d84bbc1e from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:33382)
I20260709 13:06:49.841588 21236 tablet_copy_service.cc:161] P f81bf1abd0b34f518d1f2b79cc4dba77: Beginning new tablet copy session on tablet 68ebd645703043ddb9e32ba2d84bbc1e from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:33382: session id = 5e66e7254b764832b244bb5b07b4a208-68ebd645703043ddb9e32ba2d84bbc1e
I20260709 13:06:49.848455 21236 tablet_copy_source_session.cc:215] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:49.851069 22859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ebd645703043ddb9e32ba2d84bbc1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.862957 22864 ts_tablet_manager.cc:933] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Initiating tablet copy from peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:49.867000 22859 tablet_copy_client.cc:806] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:49.867576 22859 tablet_copy_client.cc:670] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:49.871201 22859 tablet_copy_client.cc:538] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:49.873135 22864 tablet_copy_client.cc:323] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Beginning tablet copy session from remote peer at address 127.19.145.3:44115
I20260709 13:06:49.874495 21309 tablet_copy_service.cc:140] P 7c5246dc52bb49f38aef22aba1467452: Received BeginTabletCopySession request for tablet 6b9b6c321dab4a71866dd41996aca451 from peer 5e66e7254b764832b244bb5b07b4a208 ({username='slave'} at 127.0.0.1:57018)
I20260709 13:06:49.874950 21309 tablet_copy_service.cc:161] P 7c5246dc52bb49f38aef22aba1467452: Beginning new tablet copy session on tablet 6b9b6c321dab4a71866dd41996aca451 from peer 5e66e7254b764832b244bb5b07b4a208 at {username='slave'} at 127.0.0.1:57018: session id = 5e66e7254b764832b244bb5b07b4a208-6b9b6c321dab4a71866dd41996aca451
I20260709 13:06:49.878971 22859 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:49.881860 21309 tablet_copy_source_session.cc:215] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:49.891295 22864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b6c321dab4a71866dd41996aca451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.912158 22859 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:49.913043 22859 tablet_bootstrap.cc:492] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:49.913657 22859 ts_tablet_manager.cc:1403] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.035s	user 0.034s	sys 0.001s
I20260709 13:06:49.916234 22859 raft_consensus.cc:359] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.916975 22859 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:49.917532 22859 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.922350 22859 ts_tablet_manager.cc:1434] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:49.925556 21236 tablet_copy_service.cc:342] P f81bf1abd0b34f518d1f2b79cc4dba77: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-68ebd645703043ddb9e32ba2d84bbc1e received from {username='slave'} at 127.0.0.1:33382
I20260709 13:06:49.925971 21236 tablet_copy_service.cc:434] P f81bf1abd0b34f518d1f2b79cc4dba77: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-68ebd645703043ddb9e32ba2d84bbc1e on tablet 68ebd645703043ddb9e32ba2d84bbc1e with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:49.943513 22864 tablet_copy_client.cc:806] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:49.944131 22864 tablet_copy_client.cc:670] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:49.948737 22864 tablet_copy_client.cc:538] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:49.956588 22864 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap starting.
I20260709 13:06:49.976264 22864 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:49.977072 22864 tablet_bootstrap.cc:492] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Bootstrap complete.
I20260709 13:06:49.977591 22864 ts_tablet_manager.cc:1403] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:06:49.979952 22864 raft_consensus.cc:359] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.980551 22864 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Initialized, Role: LEARNER
I20260709 13:06:49.981137 22864 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:49.983734 22864 ts_tablet_manager.cc:1434] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:06:49.985970 21309 tablet_copy_service.cc:342] P 7c5246dc52bb49f38aef22aba1467452: Request end of tablet copy session 5e66e7254b764832b244bb5b07b4a208-6b9b6c321dab4a71866dd41996aca451 received from {username='slave'} at 127.0.0.1:57018
I20260709 13:06:49.986469 21309 tablet_copy_service.cc:434] P 7c5246dc52bb49f38aef22aba1467452: ending tablet copy session 5e66e7254b764832b244bb5b07b4a208-6b9b6c321dab4a71866dd41996aca451 on tablet 6b9b6c321dab4a71866dd41996aca451 with peer 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:50.087284 21814 raft_consensus.cc:1217] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:50.136610 21814 raft_consensus.cc:1217] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:50.235757 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:51.349889 22871 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.350754 22871 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.354236 22871 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:51.446626 22870 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.452612 22884 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.453279 22869 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.456494 22878 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.457620 22879 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.458937 22874 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.461840 22877 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:51.466741 22886 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.467308 22880 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.471280 22891 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.471817 22895 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.484464 22894 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.504760 22879 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.506327 22886 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.477596 22888 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.507133 22885 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:51.535477 22872 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.503180 22878 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.543218 22891 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.547763 22882 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.547830 22894 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.505347 22874 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.520211 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:51.542492 22895 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.548887 22892 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.525791 22880 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.511804 22871 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.551321 22885 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.552960 22879 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.566146 21145 raft_consensus.cc:606] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:51.571064 22902 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.580078 22887 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.497689 22870 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.586426 22892 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.593984 22892 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:51.594666 22886 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.588156 22871 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.501747 22884 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.503522 22869 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:51.637636 22910 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:51.508025 22877 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.641038 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:06:51.644207 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:51.636060 22886 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.600445 22902 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.600610 22872 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.609845 22887 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:51.654711 22887 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:51.607692 22882 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.576308 22888 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.659221 22882 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.666255 22884 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.667120 22871 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.668196 22891 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:51.645766 22910 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.670857 22870 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.671429 22873 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.671751 22910 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.675652 22911 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.676158 22911 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.672432 22872 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.673056 22882 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.672034 22873 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.683775 22878 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.672338 22907 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.659794 22886 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.681102 22882 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:51.685786 22902 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.987326 22883 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:51.943166 22881 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.942111 22887 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.010686 22910 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.945590 22908 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.927328 22897 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.928004 22879 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.988215 22907 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:51.943523 22893 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.928217 22892 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.977521 22901 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.993052 22886 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:51.942948 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.270s	user 0.041s	sys 0.042s
I20260709 13:06:51.927284 22889 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.997454 22911 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.727114 22880 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.722059 22906 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.002269 22882 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.005077 22917 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.720515 22896 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:51.692603 22895 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.008821 22874 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:51.741106 22877 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.744175 22888 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:51.790117 22873 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.691555 22885 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:51.691654 22903 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:51.691819 22905 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.011276 22900 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:51.952404 22872 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.011818 22887 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.013291 22909 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:06:52.026877 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.354s	user 0.043s	sys 0.043s
I20260709 13:06:52.027561 22904 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.028295 22914 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.020473 22902 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.033241 22920 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.033185 22889 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.021451 22879 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.011586 22883 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.012249 22910 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.067741 22925 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.067732 22918 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.086448 22922 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.087218 22913 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.013533 22908 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.053117 22898 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.030002 22892 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.085821 22877 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.088249 22882 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.074329 22915 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.053155 22919 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.060689 22881 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.101430 22880 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.090961 22872 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.035146 22901 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.121547 22908 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.034121 22893 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:52.128350 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 98315.6us
I20260709 13:06:52.088198 22906 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.101161 22902 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.032621 22897 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.096715 22909 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.114188 22923 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.116094 22877 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.118650 22882 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.094771 22896 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.125185 22894 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.127926 22869 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.128059 22915 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.124922 22898 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:52.149858 21776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.022s	sys 0.018s
W20260709 13:06:52.150251 21776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.022s	sys 0.018s
W20260709 13:06:52.150527 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 678061us
I20260709 13:06:52.151170 22898 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.101107 22914 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.114473 22918 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.088593 22917 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.090636 22903 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.090760 22905 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.115986 22922 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.114887 22913 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.116456 22925 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.134505 22880 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.104625 22920 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.108052 22900 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.154788 22869 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.154124 22886 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.111138 22904 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.156847 22895 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.166640 22879 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.160185 22883 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.161384 22889 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.130787 22919 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.156870 22923 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.375144 22915 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.158561 22929 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.166774 22928 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.184325 22910 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.278657 22908 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.362504 22882 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.277463 22926 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.180058 22869 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.303088 22925 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.596926 22926 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.297152 22892 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.595683 22908 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.631669 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.429682 22902 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.580760 22880 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.597673 22911 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.596922 22901 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.363653 22893 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.277187 22913 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.264528 22907 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.541339 22932 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.277187 22909 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.228760 22927 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.542573 22897 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.646690 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.262586 22895 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.228250 22930 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.521960 22915 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.541669 22912 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:06:52.649654 21321 debug-util.cc:398] Leaking SignalData structure 0x7b080017cee0 after lost signal to thread 20039
I20260709 13:06:52.650753 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.545017 22885 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.581305 22877 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.522306 22881 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.306484 22872 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.661571 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:52.651328 22873 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.179757 22887 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.627249 22910 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.646880 22933 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.185545 22886 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.669785 22919 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.602653 22923 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.670413 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.696010 21143 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:52.670684 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.369156 22920 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.578298 22896 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.681514 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.657668 22902 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.683404 22885 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.636452 22917 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.705761 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.676530 22907 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.710263 22907 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.667086 22904 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.685537 22912 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.692272 22873 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.650626 22928 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.651814 22911 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.669341 22900 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.708667 22931 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.709115 22936 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.709208 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.709738 22885 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.683735 22882 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.711599 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.636773 22929 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.686374 22881 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.683586 22893 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.718920 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.719614 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.684696 22913 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.695039 22922 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.693922 22915 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:52.721982 21321 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa740 after lost signal to thread 21083
I20260709 13:06:52.740919 22926 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.755712 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:52.773681 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 622579us
I20260709 13:06:52.774693 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.734229 21223 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:52.756577 22895 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.693822 22910 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.761124 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.775343 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.757290 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.761168 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.731462 21295 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:52.693085 22933 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.770789 22921 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.771587 22935 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.772105 22891 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.705929 22905 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.773134 22869 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.761384 22893 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.762837 22881 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.781566 21814 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:52.713169 22902 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.801092 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.758184 22936 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.787758 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.789319 22871 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.789777 22884 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.791400 22892 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.699853 22932 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.689783 22930 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.801729 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:52.802393 22938 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.799186 22891 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.759728 22882 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:52.803648 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:52.812088 21321 debug-util.cc:398] Leaking SignalData structure 0x7b080014f5c0 after lost signal to thread 21175
I20260709 13:06:52.790402 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.803333 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.804749 22922 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.805495 22907 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.805415 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.805984 22933 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.760793 22931 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.806128 22935 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.803572 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.808760 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.808931 22915 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.790458 22918 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.843742 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.779848 22913 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.712268 22927 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.815135 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.815485 22895 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.815903 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.850584 21810 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:52.817234 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.818650 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.851392 21814 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:52.791607 22906 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.828578 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.829866 22936 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.806016 22893 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.808794 22910 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.815927 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.858012 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.816609 21809 raft_consensus.cc:1217] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:52.835054 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.835085 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.833684 21811 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:52.818779 22902 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.804122 22890 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:52.840446 21813 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:52.804049 22921 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.843323 22875 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:52.850521 22928 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.847886 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.825348 22870 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.833061 22886 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.848157 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:52.836561 22879 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:52.818993 22884 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.817975 22871 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.855017 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.825122 22892 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.874082 22879 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.878861 22892 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.878928 21812 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:52.844808 22873 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.841777 22938 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.850208 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:52.856606 21321 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7a20 after lost signal to thread 21250
I20260709 13:06:52.866168 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.867101 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.809798 22911 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.856739 22874 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:52.865240 22890 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.883667 22881 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.905339 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.905615 22871 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.906352 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.906664 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.906755 22914 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.907330 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.907487 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.908407 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.855734 22895 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:52.871678 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.863895 22913 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.870131 22932 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.857971 22931 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.872573 22870 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.939584 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.939885 22890 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.940229 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:52.836179 21296 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:52.879102 22879 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.830260 22891 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:52.864092 22882 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.870184 22875 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.879544 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.882936 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.844652 22922 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.908391 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.883889 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.885978 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.912338 22884 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.876070 22930 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.915084 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.915513 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.919566 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.873201 21805 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:52.939360 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.943396 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.946907 22938 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.874629 22927 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.947911 21295 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
W20260709 13:06:52.955202 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800384e20 after lost signal to thread 21324
I20260709 13:06:52.949308 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:52.955574 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800384e00 after lost signal to thread 21325
I20260709 13:06:52.955854 22935 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.919595 22903 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.956538 22895 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:52.956674 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800346dc0 after lost signal to thread 21838
I20260709 13:06:52.945750 22870 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.949294 22922 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.949632 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.951169 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.944198 21151 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:52.947024 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.923643 22874 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:52.958456 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.960309 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:52.963539 22908 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.963891 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.942628 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.964563 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:52.968160 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.968904 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.969321 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.969924 21812 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:52.970023 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.970638 21809 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:52.960703 22921 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.973493 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.974771 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.966491 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.966543 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.975740 22875 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:52.963550 21296 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:06:52.965752 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.965446 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.974959 21814 raft_consensus.cc:1217] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:52.962095 22912 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:52.967816 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:52.977732 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:52.981000 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:52.984025 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:52.985067 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 119301us
I20260709 13:06:53.000064 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.000545 22903 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.000985 22903 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.001360 22903 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.002003 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.003365 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.003932 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.004467 21144 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:53.004525 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.005066 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.005239 22882 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.005589 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.006099 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.007016 22913 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.007428 22913 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:53.007777 22913 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.008204 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.009922 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.009958 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.010236 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.011229 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.012677 22935 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.012969 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.013072 22935 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:53.015594 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.014240 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.019161 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.019984 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.023511 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.023787 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.024556 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.024833 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.015457 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.029731 21151 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:53.028995 21143 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:53.030689 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.005640 22882 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.032166 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.033581 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.031322 21292 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:06:53.026721 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.035468 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.036789 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.038527 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.019507 22935 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.021484 22931 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.047659 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.071724 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.377583 21813 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:53.040993 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.095463 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.019147 21805 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:53.379690 21220 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:53.154954 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.036353 22882 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.333874 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.399492 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.405548 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.108819 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.120036 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.035117 22929 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:53.035971 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.121464 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.121415 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.412952 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:53.246860 21778 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.642s (SENT)
I20260709 13:06:53.155121 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.411584 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.417412 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.418220 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.418406 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.374102 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.419206 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.419306 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.040637 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:53.420892 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 299473us
I20260709 13:06:53.422555 21224 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:53.204636 22921 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:53.108242 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.225461 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.395577 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.446415 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.048045 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.428177 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.119594 22912 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.159334 22937 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.074002 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.429873 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.430051 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.073729 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.433279 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:53.433830 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.445382 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.447880 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.448719 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.452701 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.427582 22929 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.457073 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.412321 22931 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.417968 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.460713 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.460985 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.462081 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.432672 21299 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:53.475121 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.467763 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:53.477185 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52664.3us
I20260709 13:06:53.477891 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.478780 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.459715 22929 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:53.458464 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.459918 22932 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.479923 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.467999 22875 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.480738 21144 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:53.475994 22874 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:53.446302 22921 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.468919 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.473770 22872 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.453650 22912 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.480554 22908 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.494685 22872 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:53.499531 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.499967 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.484691 22895 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.508227 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.486701 22929 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.488682 22932 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:53.530444 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.522301 21220 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:53.524557 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.526155 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.530108 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.492545 22911 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.474244 22937 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.623827 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.525733 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.623909 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.514721 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.621233 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.527773 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.491003 22875 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:53.628654 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.628793 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.628878 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.630323 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.631520 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.510475 22872 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.508037 22908 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.633220 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:53.526125 22913 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:06:53.520948 22921 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:53.639511 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.614089 22895 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:53.515070 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.635674 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.516059 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.516834 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:53.637215 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.637398 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.616227 22932 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.519598 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.529755 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.639540 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:53.534888 22903 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.005s
I20260709 13:06:53.522785 22912 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:53.640151 21150 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:53.642865 22895 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.622848 22911 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:53.535380 21809 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:53.633771 22875 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.644381 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.646443 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:53.649659 22935 consensus_meta.cc:287] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.006s
I20260709 13:06:53.638644 22908 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.656172 22911 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.643903 22913 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:53.689715 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.693034 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.695785 22931 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:53.702652 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 455936us
I20260709 13:06:53.656668 22903 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.515515 22882 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:53.708755 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 275523us
W20260709 13:06:53.703542 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 252296us
W20260709 13:06:53.699429 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 213925us
I20260709 13:06:53.711807 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.712570 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.713630 22934 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.714085 22934 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.714512 22934 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.719013 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.722254 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.723436 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.724512 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.726377 22882 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:53.728168 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.731206 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:53.707896 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 274820us
W20260709 13:06:53.731633 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 241475us
I20260709 13:06:53.733951 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.737061 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.724555 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.744467 22934 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:53.678725 22935 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:53.749325 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:53.758834 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:53.766613 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:53.763994 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:53.807178 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 76044.2us
W20260709 13:06:53.827769 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79418.6us
I20260709 13:06:53.828312 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:53.856153 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 122320us
I20260709 13:06:53.858246 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.815573 22921 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.877014 22921 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:53.847697 22882 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.849458 22956 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:53.899312 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 135481us
W20260709 13:06:53.909688 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47753.8us
I20260709 13:06:53.887205 22921 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.897058 22937 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:53.925848 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 73729.5us
W20260709 13:06:53.926661 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79550.3us
I20260709 13:06:53.900804 22904 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.934554 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:53.899140 22956 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:53.898949 22934 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:53.939185 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 242930us
I20260709 13:06:53.947106 21191 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:53.948670 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:06:53.949049 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 137610us
I20260709 13:06:53.954703 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:53.955315 22959 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.956661 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:53.957168 22959 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.957526 22912 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.948673 22884 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.957950 22912 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:53.958122 22884 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:53.958453 22912 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.958606 22884 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.956851 22951 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.960619 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:53.940258 22956 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:53.964978 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 206261us
I20260709 13:06:53.960194 22913 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:53.983880 22935 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:54.015584 22921 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.016919 22968 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.976688 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:54.017746 22921 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:54.025190 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:53.964947 22951 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:54.034103 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:54.037410 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 76843.9us
I20260709 13:06:54.040191 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.042469 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:54.043190 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.033212 22951 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.040133 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.045608 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.044852 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.034191 22955 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:54.045181 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:54.049762 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:54.068110 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:54.073961 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 225408us
W20260709 13:06:54.091845 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 275127us
I20260709 13:06:54.093186 22952 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.052752 22955 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:06:54.093957 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63988.2us
W20260709 13:06:54.113354 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 152813us
I20260709 13:06:54.121981 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.114419 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:54.113839 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 305756us
I20260709 13:06:54.124486 21114 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.112118 22955 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.154326 22934 raft_consensus.cc:1064] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:54.161046 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:54.168663 22895 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.149425 22953 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.191363 22944 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:54.193275 22944 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:06:54.193336 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 118728us
I20260709 13:06:54.194319 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:54.197980 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73592.1us
I20260709 13:06:54.193688 22944 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.198897 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.200773 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:54.201989 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 267614us
I20260709 13:06:54.202215 22980 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.202994 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:54.220714 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 106379us
W20260709 13:06:54.220710 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 286218us
I20260709 13:06:54.221485 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.221479 21297 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.219601 21264 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:54.223070 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.220206 22873 raft_consensus.cc:1064] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
W20260709 13:06:54.228155 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 158002us
I20260709 13:06:54.229976 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:54.203688 22869 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.236348 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.237730 21189 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.231179 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.237804 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.239058 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:54.238292 22978 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:54.244315 21189 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.239359 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.240304 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.245950 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.243702 21776 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.241406 22973 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:54.241735 22869 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:54.222760 22905 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.249547 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.238461 22970 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.247205 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.250699 21114 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:54.306344 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 55700.4us
I20260709 13:06:54.245507 22950 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.226228 22971 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.230551 22882 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.307102 22971 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:54.307796 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.308104 22979 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.252769 22869 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.309594 22937 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.221634 22956 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:54.316147 22908 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.001s
I20260709 13:06:54.316555 22908 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.316898 22956 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.317670 21300 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.318514 22908 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.312147 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.241961 22923 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:54.256023 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.247202 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.227243 22969 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:54.310853 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63706.7us
W20260709 13:06:54.321434 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74288.3us
I20260709 13:06:54.248525 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.242929 22947 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.313135 22950 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.314440 22903 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.322839 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:54.323454 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74992.3us
I20260709 13:06:54.325985 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.305339 21808 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.328965 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.249012 22978 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:54.249778 22895 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.307711 22971 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:54.383127 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 71046.3us
I20260709 13:06:54.247639 22949 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:54.328820 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 72914.7us
I20260709 13:06:54.303695 22935 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.307839 22932 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.019s
I20260709 13:06:54.251514 22927 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.247988 22874 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.322189 22870 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.395671 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:54.250011 22981 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.396996 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.360550 21299 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.395328 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.330400 22980 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.383237 22917 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.403331 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 74430.9us
I20260709 13:06:54.431001 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.394251 22978 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.321846 22923 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:54.329494 22947 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:54.433012 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.406328 21114 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.441473 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.443200 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.444219 22967 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.445248 22967 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.446130 22967 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.447881 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.449012 22927 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.450759 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.457561 22927 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.459201 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.399027 21147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:06:54.430373 22980 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:54.460976 22980 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.460501 21147 raft_consensus.cc:606] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.384272 22946 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.462631 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56395.3us
I20260709 13:06:54.466382 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.423817 22904 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.467702 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.414920 22895 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:54.439729 22954 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.429942 22903 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:54.472853 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.461208 22870 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:54.398700 22932 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.462060 22947 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.461907 22923 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.460994 22874 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.477600 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.424311 22983 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.464355 22937 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.470882 22917 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.470480 22902 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.474702 22903 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:54.491024 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.472249 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.480705 22927 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:54.490021 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 202372us
I20260709 13:06:54.483192 22968 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.512064 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:06:54.512588 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 189816us
I20260709 13:06:54.496263 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.508942 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.483028 22981 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.513384 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:54.478924 22895 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:54.520885 22951 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.522040 22895 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:54.493732 22903 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:54.519480 22875 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.847s	user 0.007s	sys 0.010s
I20260709 13:06:54.495612 22953 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.515450 22960 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.533331 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.534198 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.524407 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.534910 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:54.535982 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.513121 22882 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.537184 22875 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.541235 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.542210 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.552671 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.554388 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.523098 22951 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.523355 22874 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.540612 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.536158 22895 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.557005 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.537418 22905 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:54.563174 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:54.549384 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:54.542860 22882 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:54.550505 22948 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:06:54.571130 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 191917us
I20260709 13:06:54.568465 21114 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.579694 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.562017 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:54.551203 22975 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.601568 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.602787 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.562348 22970 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.566105 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:54.567857 22961 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:54.608135 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.608826 21263 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.606130 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.611977 21813 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.613749 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45366.5us
I20260709 13:06:54.568998 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:54.573374 22958 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.599552 22882 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.627913 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:54.628273 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:54.703608 21143 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.613135 22990 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.608204 22984 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:54.703894 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 76098us
I20260709 13:06:54.709179 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.611069 22957 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.726001 21813 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:54.612602 22961 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:54.746546 21221 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.720810 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:54.605074 22985 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.624053 22908 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.576234 22905 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.745142 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:54.620572 22958 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:54.707962 22956 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.618137 22988 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.758853 22961 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.764755 22955 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.006s
I20260709 13:06:54.759218 22960 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:54.778614 22872 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.138s	user 0.010s	sys 0.001s
I20260709 13:06:54.771862 22958 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.709843 22952 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:54.762769 22932 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.618988 22948 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.779965 22905 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.799817 22955 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:54.800935 22911 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.103s	user 0.009s	sys 0.001s
I20260709 13:06:54.803984 22872 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:54.866573 21143 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:54.898380 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:54.899104 21221 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.899287 21151 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.897900 22911 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.932348 22911 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:54.932719 22944 consensus_meta.cc:287] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.710s	user 0.003s	sys 0.007s
I20260709 13:06:54.933179 22944 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.934289 22882 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.935526 22872 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:54.936857 22955 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:54.941119 22903 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:54.943591 21148 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.945123 22944 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:54.945689 22903 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:54.962623 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 253505us
I20260709 13:06:54.978219 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:54.979691 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 437576us
I20260709 13:06:54.984640 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.982177 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.992532 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:06:54.964493 22912 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.006s	user 0.013s	sys 0.007s
I20260709 13:06:54.993042 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.994791 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:54.995030 22960 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.995216 22970 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.000138 22870 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.989964 22944 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:55.008623 22929 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.382s	user 0.008s	sys 0.010s
I20260709 13:06:55.009407 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:06:55.011437 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:55.012570 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 275251us
I20260709 13:06:54.992674 22874 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.014576 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.015710 21224 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.998164 22932 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.081357 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.083559 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.006891 22958 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.100724 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.103976 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.106182 21292 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:55.129142 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 134418us
I20260709 13:06:55.009044 22929 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.129953 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.087949 22870 raft_consensus.cc:2764] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:54.996395 22912 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.135579 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.135777 22998 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.136658 22944 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.138183 22882 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.143627 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.144047 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:55.144668 22884 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.186s	user 0.017s	sys 0.009s
I20260709 13:06:55.078495 22932 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.145032 22884 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.147847 21221 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:55.148970 22884 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:55.149417 22993 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.149449 22994 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.149776 22944 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.158150 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:55.145524 22978 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.005s
W20260709 13:06:55.161993 22923 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.005s
I20260709 13:06:55.168947 21226 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.217561 22923 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.175565 22995 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.220570 22923 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.200008 22969 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.201319 22979 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.221228 22969 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:55.221418 22979 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:55.222203 22969 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.222324 22979 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.202587 22912 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.150717 22966 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.185216 22944 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:55.204653 22978 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.205956 22929 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.223634 22979 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.208724 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:55.210702 22970 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.210816 22875 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.211594 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.269225 21293 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.211788 22932 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.182000 22934 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.216167 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.216540 22983 raft_consensus.cc:1064] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:55.172951 22965 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:55.191388 22958 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.279076 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.229230 21142 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.207383 22961 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.280400 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:55.281137 22961 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.235428 22944 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.270404 22970 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.214880 22948 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:55.273698 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.273893 22978 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.273929 22932 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.275483 21219 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
W20260709 13:06:55.186336 22971 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.000s
I20260709 13:06:55.277848 21150 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:55.221204 22980 consensus_meta.cc:287] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.001s
I20260709 13:06:55.308341 21148 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.308284 22970 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:55.303747 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 220287us
I20260709 13:06:55.311058 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.293447 22992 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:55.278676 21151 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:55.227385 22869 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.002s
W20260709 13:06:55.284060 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 138669us
I20260709 13:06:55.285677 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.223770 22969 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.229501 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:55.290583 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.317505 21814 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.296361 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1973) took 1056 ms. Trace:
I20260709 13:06:55.297340 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.297870 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.318802 21812 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.299389 21810 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.299963 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.305079 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:06:55.187346 22947 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 13:06:55.319845 21813 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.321938 23002 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.315379 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.328547 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.328570 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.315821 22869 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.304378 22971 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.329569 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.333452 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.334043 21147 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.331063 22968 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.335848 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.336854 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:55.337802 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:55.318526 21291 rpcz_store.cc:276] 0709 13:06:54.240278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.240389 (+   111us) service_pool.cc:224] Handling call
0709 13:06:54.252460 (+ 12071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.167502 (+915042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.167534 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.167579 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.167609 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.296137 (+128528us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b540001b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:55.296178 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.296280 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103862016}
I20260709 13:06:55.339716 21150 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.341075 21813 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:55.342373 21812 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:55.339603 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.343436 22946 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.343847 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:55.344094 22946 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.344594 22946 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:55.345237 21147 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:55.345485 22946 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.346676 22993 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.347872 22872 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.348289 22937 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:55.348510 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.348829 22937 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.349249 22993 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.350989 22937 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.329661 23002 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.376053 21142 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.377084 22869 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:55.352149 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.378511 22929 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.378912 22929 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.379451 22961 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.348265 22872 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:55.379908 22929 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.380620 22975 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.380785 22872 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.381054 22975 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.381238 22929 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.381906 22975 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.384107 22996 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.384512 22996 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:06:55.384948 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 61425.3us
I20260709 13:06:55.385308 22996 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.386381 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.386559 22996 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.352911 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:55.387214 22952 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.353017 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.339398 22948 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:55.388545 22948 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.388728 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.388911 22948 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:55.389119 23002 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.354933 22993 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:55.389863 23002 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.389783 22948 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.390563 22993 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.390955 22993 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:06:55.391714 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 63231.9us
I20260709 13:06:55.392077 21144 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.391882 22993 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.393159 22993 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.393472 22971 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.355932 21300 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.357034 21299 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.363709 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.389881 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.353240 22983 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.396173 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.363010 21814 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:55.377175 22987 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:55.401484 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.423609 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.329936 21807 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.431027 21142 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.312463 22980 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.391065 22948 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.438531 21220 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.423593 21226 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.433714 21776 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.434876 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.325126 22947 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:55.437660 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.440930 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.401854 22950 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:55.444653 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 81613.8us
I20260709 13:06:55.446156 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:55.444271 21264 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:55.425730 22989 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.448454 21298 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:55.450942 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:06:55.451398 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.448715 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.432713 22923 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:55.424177 22978 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:06:55.454219 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51276.1us
I20260709 13:06:55.434535 23002 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.456049 21142 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.418217 22958 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:55.443579 22973 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.457135 21294 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.453647 21296 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.369166 22873 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.481142 21811 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.421552 22944 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.510797 22934 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.514259 22934 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.445914 22968 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.515156 22934 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.484426 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:55.515604 22944 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.483349 22912 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:55.482347 22904 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:55.452384 22959 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:55.493719 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:55.521638 22949 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.522020 22949 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.522231 21148 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.522862 22949 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:55.498986 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52442.3us
W20260709 13:06:55.499225 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 55022.5us
I20260709 13:06:55.523764 22904 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.524104 22949 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.524145 22904 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:55.501714 22975 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.502144 22911 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:55.502789 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 99238.3us
I20260709 13:06:55.504287 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.504347 22869 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:55.505714 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.506984 22960 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.526624 22995 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:55.543169 22971 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.543495 21148 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:55.528157 22959 raft_consensus.cc:1064] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:06:55.544721 22937 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.545159 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.546136 22971 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:55.546516 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.544742 22960 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:55.548326 22960 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.549036 22960 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.550383 22960 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.552983 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.508410 22978 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.509159 22993 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.515336 22968 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.475739 22923 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.517530 21292 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.519548 22947 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:55.525307 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:55.573413 22937 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.530174 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.547765 22959 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.571696 22954 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:55.571736 22970 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:55.571981 22872 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.554476 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.574064 22978 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.532323 22980 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.573019 22934 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.578521 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.579095 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.530817 22911 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.529722 22977 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.609859 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:55.530090 22912 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.536942 22908 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:55.612880 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 87660.4us
I20260709 13:06:55.638499 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:55.525612 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44330.2us
I20260709 13:06:55.586269 21224 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.613072 22997 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:06:55.613349 22958 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.615222 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.615849 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.617599 21222 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.529167 22969 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:06:55.621645 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 91562.1us
I20260709 13:06:55.530776 22973 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:06:55.664780 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.614228 22937 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:55.635475 22911 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.631793 21221 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:55.636132 22979 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.624796 22954 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.622772 21807 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:55.630792 21148 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.655175 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:55.659307 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:55.695156 21813 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:55.659348 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.554857 22904 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.662516 22951 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:55.663229 21811 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:55.702945 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.622045 22947 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:55.528609 22944 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:06:55.670253 21814 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.637270 22977 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.676314 21220 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.676541 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.654310 22957 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.663918 22993 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:55.640564 22908 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.684545 22964 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:55.687961 22994 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.664053 22912 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.724450 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.696288 21810 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.699225 21142 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.706202 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.677946 22979 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:55.713109 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:55.667689 22963 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:55.729557 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.685608 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:55.717135 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:55.717593 21292 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:55.722234 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.731673 21814 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.711449 22929 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:55.710589 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.737623 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.734825 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.712975 21806 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.722271 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.725144 22937 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.737187 22872 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.711220 22996 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:55.759218 22996 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.759644 22996 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.760426 22996 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.760931 22911 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.724215 22944 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.761900 22944 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:55.762691 22944 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.763435 22973 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.763806 22973 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:55.764525 22954 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:55.743013 22908 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.726915 21218 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.768567 22937 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.770040 21225 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.733800 21293 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:55.773567 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.764663 22973 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:55.788374 21292 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.751132 21226 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:55.775790 21814 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:06:55.786005 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 74303.3us
I20260709 13:06:55.973251 21142 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.727455 22951 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.680305 22978 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:55.888850 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 114335us
I20260709 13:06:55.743741 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:55.757377 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:55.913722 21225 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:55.798779 22923 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:55.769611 22950 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.747682 22980 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:06:55.749584 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:06:55.890627 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 112419us
W20260709 13:06:55.999339 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.999686 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.763827 22944 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.786650 22983 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:55.742671 22962 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.757120 22912 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.005378 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:55.746730 22964 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.793370 22929 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:55.739770 21809 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
W20260709 13:06:55.940603 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 155991us
W20260709 13:06:55.769686 22946 consensus_queue.cc:1175] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:55.889091 21812 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:55.828420 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.977263 21810 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:55.977708 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:55.981599 21217 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:55.982421 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:55.988521 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:55.992126 22908 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.012650 21225 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.999835 21144 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:56.001309 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 139055us
W20260709 13:06:56.015192 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.738023 22904 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.016964 21811 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.007509 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:56.001188 21808 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.993479 22950 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:56.038846 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:06:56.039757 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.039847 21814 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:56.042979 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:56.045296 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:56.022791 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:56.000974 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:56.019193 21225 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:56.050272 21810 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.050541 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:56.051532 21810 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:56.046553 21264 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:56.025636 21296 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:56.047152 22935 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.047179 22961 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:56.048830 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:56.017957 22962 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.009181 22964 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:56.047029 22994 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.054855 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:56.020117 22978 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.019207 21218 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.063822 21150 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:56.043664 22976 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.045085 22995 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.019681 22958 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:56.060871 22960 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:56.086509 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 67598.4us
I20260709 13:06:56.089483 21293 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.038534 22963 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:56.095566 22963 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:06:56.095778 23010 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:06:56.096086 22963 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.075052 23012 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.063612 23011 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:56.098174 22963 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:56.092255 22950 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:56.101204 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.101704 22980 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.102051 22980 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:56.102505 22968 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.070503 22903 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.070972 22935 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:56.075928 22976 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:56.102908 21148 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
W20260709 13:06:56.110535 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 55820.7us
I20260709 13:06:56.113404 21145 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.087146 23000 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.112250 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 88837.8us
I20260709 13:06:56.025573 22951 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.114930 21292 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:56.129670 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 83593.1us
I20260709 13:06:56.104077 22993 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:56.070736 22961 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:56.108807 22963 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:56.114770 22976 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.113991 21809 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:56.112881 22960 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:56.112990 22983 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:06:56.133610 22934 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
W20260709 13:06:56.134653 22949 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
I20260709 13:06:56.124037 22995 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:56.110728 23012 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:56.113700 22958 consensus_queue.cc:1243] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:06:56.137264 22975 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:06:56.146016 23023 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:56.151783 22960 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.152328 22973 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:56.151827 23013 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:56.168316 21148 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:56.159756 21219 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.167872 21049 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.172096 23012 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.136958 22993 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.123973 22929 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.174027 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:56.146529 23016 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:06:56.178381 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 129655us
W20260709 13:06:56.180330 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.142040 22963 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.131727 22980 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.177889 23012 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.192664 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:56.194146 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:56.163872 23000 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:56.131947 22962 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.132701 22964 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.170446 22947 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:56.202696 22975 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.204715 23001 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.222505 22983 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.231794 22986 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:56.205030 22931 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.161697 22995 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:56.241201 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 174428us
I20260709 13:06:56.162981 23020 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:06:56.242162 22975 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:56.241039 22980 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.178262 22935 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.225522 22947 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:56.264744 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 155570us
I20260709 13:06:56.265036 23019 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:56.266064 23020 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:56.269042 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:56.265862 23019 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.270777 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:56.223650 23016 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:56.277961 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.278551 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.278712 21115 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:56.284930 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:56.247658 22994 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:56.283187 21292 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:56.289204 23026 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.289849 23026 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:56.290328 23026 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.263070 22969 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.288396 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:56.274626 22931 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.231882 23012 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.292244 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.275295 22963 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:56.294677 23001 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.320367 23015 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:06:56.326411 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 197433us
I20260709 13:06:56.297309 22971 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.297055 22969 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.335135 21150 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:56.333639 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:56.345276 21809 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:56.305452 22970 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:56.338496 22971 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:56.304860 22908 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:56.332828 22931 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:56.363996 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:56.337139 22977 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.366379 22977 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.352099 22961 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:56.356370 22971 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.387290 21809 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:56.348097 22946 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:56.333173 22975 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.393200 22996 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.398970 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.401577 21223 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.001s
I20260709 13:06:56.402050 21223 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:56.355866 22970 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.404714 22970 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:56.365342 22929 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.406534 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:56.393152 22969 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.415977 23024 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.433074 21220 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:06:56.359856 22979 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.483392 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.484182 21297 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:56.420495 22931 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:56.480418 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.493630 22947 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:56.478298 23024 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:56.489136 22969 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.473073 22970 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:06:56.493852 21809 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:06:56.491007 23016 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:56.490592 23018 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:56.518734 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.523463 22976 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.509305 23024 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.508677 22993 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:56.508525 23031 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:06:56.536480 22937 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.002s
I20260709 13:06:56.522614 23019 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:56.526234 23018 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.557796 22874 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.558275 22874 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.559177 22874 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.560470 22874 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.545508 22989 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.564145 21263 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:06:56.565718 23025 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:06:56.585938 22934 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.586725 22934 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:56.564073 22989 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:56.586220 23018 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.593493 22987 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.602862 22944 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.598s	user 0.003s	sys 0.009s
I20260709 13:06:56.605752 22934 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.607908 22989 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.610322 23018 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.610172 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:56.612226 23012 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.613047 22987 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:56.615061 21814 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:56.617635 22978 consensus_meta.cc:287] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
W20260709 13:06:56.621062 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.637458 21225 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.642014 21226 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.606894 22976 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:56.645395 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.648239 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:56.649294 21142 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:56.649041 21220 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:56.642096 22989 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:56.652714 22904 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.628s	user 0.002s	sys 0.010s
I20260709 13:06:56.654255 22904 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.660504 22987 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:56.663563 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.661656 22995 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:56.674050 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:56.675693 21814 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:56.669904 22987 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 13:06:56.682361 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.683810 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 350299us
W20260709 13:06:56.685675 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 397363us
I20260709 13:06:56.686942 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.692165 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:56.692871 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:06:56.696470 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.698719 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.702626 21810 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:56.704983 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:56.706323 21814 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.707365 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:56.668447 22971 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.709542 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.710086 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:56.710750 21293 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:56.708420 22994 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.710644 21297 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:06:56.716581 21220 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.717346 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:56.722052 21225 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:56.708973 23018 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.716600 22994 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:56.725327 23011 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.674058 23026 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.757303 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.761113 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.785967 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.786626 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.791743 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:56.792523 21298 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.745293 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:56.857959 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:56.787088 21146 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.984232 21144 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:56.733529 21221 raft_consensus.cc:2410] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:56.743872 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 648) took 1042 ms. Trace:
I20260709 13:06:56.986522 21291 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:06:56.989317 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 170490us
W20260709 13:06:56.989439 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 169532us
I20260709 13:06:56.985585 21813 rpcz_store.cc:276] 0709 13:06:55.701481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.783128 (+ 81647us) service_pool.cc:224] Handling call
0709 13:06:56.012248 (+229120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.012412 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.012440 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.012479 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.012505 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.012574 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.743665 (+731091us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54004ee150. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:56.743805 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526311296}
I20260709 13:06:56.992440 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:06:57.009298 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.747432 21294 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.743377 22994 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.013058 21150 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.795349 22950 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.019888 21149 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.756349 21805 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:06:57.012269 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.989357 23020 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:57.010234 22882 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.008378 22944 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:57.014361 22986 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:57.014238 22964 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:57.037703 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:57.033543 21813 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:56.858655 22969 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:56.743988 23011 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:57.039770 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48275.9us
I20260709 13:06:57.057341 21115 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:06:57.064841 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.779996 21142 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.877195 21143 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:06:56.770587 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.765903 22869 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.069643 22869 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.795727 22971 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:56.850509 21049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.011s	sys 0.009s
I20260709 13:06:57.068643 21295 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:57.046305 21813 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:57.085881 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.733266 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:06:56.735625 22911 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.786274 21148 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:57.107662 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 601) took 1107 ms. Trace:
I20260709 13:06:57.108073 21812 rpcz_store.cc:276] 0709 13:06:56.000313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.051337 (+ 51024us) service_pool.cc:224] Handling call
0709 13:06:57.106962 (+1055625us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:06:57.107156 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.107349 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.107373 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.107412 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:57.107438 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.107490 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.107584 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13609728}
I20260709 13:06:57.112706 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1198) took 1112 ms. Trace:
W20260709 13:06:57.095896 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 362678us
I20260709 13:06:57.113133 21224 rpcz_store.cc:276] 0709 13:06:56.000559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.000694 (+   135us) service_pool.cc:224] Handling call
0709 13:06:57.112026 (+1111332us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:06:57.112203 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.112370 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.112404 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.112445 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.112474 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.112530 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.112627 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3480960}
I20260709 13:06:57.115959 22975 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:57.097039 21813 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:57.105584 22959 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:57.117125 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:57.125705 21292 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:57.063643 23001 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.127063 21812 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:57.127786 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.742969 23018 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:57.126088 21292 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:06:57.040247 22986 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.037428 23020 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.129381 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:57.080991 22873 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:57.149575 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.117879 22912 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:57.155349 23014 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.126528 22959 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.147085 22960 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.034338 23000 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:06:57.166167 22979 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.190897 22962 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.213050 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:57.159013 22967 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.040524 22944 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:57.041858 22882 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:06:57.209415 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 80339.7us
I20260709 13:06:56.836762 22948 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.308s
I20260709 13:06:57.146831 22975 consensus_queue.cc:1243] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:57.170234 23001 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:57.300429 21812 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:06:57.078751 22969 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:57.198107 23024 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.004s
I20260709 13:06:57.096779 23026 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.167827 23011 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:57.303666 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.305536 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53526.6us
I20260709 13:06:57.224300 23002 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.236114 22875 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.237432 22960 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.236402 22873 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:57.251099 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1233) took 1002 ms. Trace:
W20260709 13:06:57.314688 21049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.011s	sys 0.009s
I20260709 13:06:57.236635 22959 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:57.068631 22983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.007s
I20260709 13:06:57.249945 22989 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.392771 22875 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:56.738515 22978 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:57.345836 23002 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:06:57.413275 22983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.010s	sys 0.011s
W20260709 13:06:57.433050 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.396895 23011 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.288153 22934 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:06:57.399632 22980 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.315477 22967 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:57.413089 23012 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.402993 22960 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.284603 23014 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:57.440486 21808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.158s	sys 0.318s
I20260709 13:06:57.437884 22875 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.436029 23002 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.339569 23024 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.445806 21807 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:57.466877 21145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.064s	sys 0.072s
I20260709 13:06:57.429698 22989 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.467160 22980 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:57.607375 21145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.065s	sys 0.072s
I20260709 13:06:57.600471 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 304) took 1450 ms. Trace:
I20260709 13:06:57.444850 22869 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:57.603005 23041 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.481s	user 0.001s	sys 0.002s
I20260709 13:06:57.438380 23001 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.655004 23020 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:57.663168 21805 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:57.601411 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1193) took 2001 ms. Trace:
W20260709 13:06:57.600203 21808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.159s	sys 0.319s
I20260709 13:06:57.671550 21219 rpcz_store.cc:276] 0709 13:06:55.599692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.614733 (+ 15041us) service_pool.cc:224] Handling call
0709 13:06:55.615012 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.180966 (+565954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.598932 (+1417966us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540038e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:57.601347 (+  2415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216103296}
I20260709 13:06:57.604027 22882 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:57.688285 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 555) took 1147 ms. Trace:
W20260709 13:06:57.694819 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.029s	sys 0.072s
W20260709 13:06:57.695657 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.029s	sys 0.072s
W20260709 13:06:57.695993 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 705658us
I20260709 13:06:57.463375 23011 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.471995 23012 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.601553 23030 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:57.650168 21300 rpcz_store.cc:276] 0709 13:06:56.150372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.155509 (+  5137us) service_pool.cc:224] Handling call
0709 13:06:56.164443 (+  8934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.255324 (+ 90881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.255361 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.255413 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.255466 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.599658 (+1344192us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:57.599848 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.600266 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208342912}
I20260709 13:06:57.613001 23017 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.467s
W20260709 13:06:57.716382 22950 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.005s
W20260709 13:06:57.728011 23043 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.047s	user 0.006s	sys 0.004s
I20260709 13:06:57.730515 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1238) took 1098 ms. Trace:
I20260709 13:06:57.604142 22873 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.592765 23018 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.712512 22969 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:57.407816 21147 rpcz_store.cc:276] 0709 13:06:56.240561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.242420 (+  1859us) service_pool.cc:224] Handling call
0709 13:06:56.260692 (+ 18272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.274659 (+ 13967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.274698 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.295499 (+ 20801us) log.cc:844] Serialized 556 byte log entry
0709 13:06:56.770482 (+474983us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:56.776041 (+  5559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.780464 (+  4423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.201456 (+420992us) raft_consensus.cc:1685] finished
0709 13:06:57.213921 (+ 12465us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.243190 (+ 29269us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":462863,"threads_started":1,"wal-append.queue_time_us":500336}
I20260709 13:06:57.714738 22944 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:57.755234 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.720584 21809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.048s	sys 0.112s
I20260709 13:06:57.743933 21145 rpcz_store.cc:276] 0709 13:06:56.632125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.632280 (+   155us) service_pool.cc:224] Handling call
0709 13:06:56.632622 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.673026 (+ 40404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.673078 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.689979 (+ 16901us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.661173 (+971194us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.661233 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.661329 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.730284 (+ 68955us) raft_consensus.cc:1685] finished
0709 13:06:57.730305 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.730434 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36291,"raft.queue_time_us":40350,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7045,"thread_start_us":969741,"threads_started":1,"wal-append.queue_time_us":1037805}
I20260709 13:06:57.761278 22869 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:06:57.796443 21217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.053s	sys 0.041s
W20260709 13:06:57.804140 21217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.053s	sys 0.041s
I20260709 13:06:57.810463 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 604) took 1311 ms. Trace:
I20260709 13:06:57.783268 23035 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:57.788232 22912 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.811005 21811 rpcz_store.cc:276] 0709 13:06:56.499582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.499762 (+   180us) service_pool.cc:224] Handling call
0709 13:06:56.501466 (+  1704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.501871 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.501909 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.508877 (+  6968us) log.cc:844] Serialized 556 byte log entry
0709 13:06:56.680093 (+171216us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:56.680140 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.680220 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.724974 (+1044754us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:06:57.795621 (+ 70647us) raft_consensus.cc:1685] finished
0709 13:06:57.795649 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.810370 (+ 14721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20665088,"thread_start_us":165483,"threads_started":1,"wal-append.queue_time_us":169093}
W20260709 13:06:57.764112 21809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.048s	sys 0.113s
I20260709 13:06:57.724520 23030 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.830108 21145 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:57.820580 22948 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.828346 22904 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.844540 21298 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:57.845153 22944 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:57.845808 22944 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:57.848232 22944 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:57.848837 22944 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.849365 22944 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:57.851414 22987 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.852047 22987 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:57.852640 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.854117 22987 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.831036 22988 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.837589 23044 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:06:57.889350 21117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.044s	sys 0.025s
I20260709 13:06:57.694860 21806 rpcz_store.cc:276] 0709 13:06:56.540970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.541849 (+   879us) service_pool.cc:224] Handling call
0709 13:06:56.546335 (+  4486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.546682 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.546712 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.547280 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.984303 (+437023us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.988999 (+  4696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.011217 (+ 22218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.687960 (+676743us) raft_consensus.cc:1685] finished
0709 13:06:57.688001 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.688206 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":766,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":15232,"thread_start_us":269878,"threads_started":1,"wal-append.queue_time_us":925691}
I20260709 13:06:57.891745 23011 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.892328 22988 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.893452 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 556) took 1299 ms. Trace:
I20260709 13:06:57.894429 22988 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.833247 23024 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:57.895360 23024 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:57.842420 23014 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:57.895931 23024 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.898372 23024 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:57.900687 23040 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.220s	user 0.055s	sys 0.072s
W20260709 13:06:57.902258 23050 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:57.903381 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 558) took 1214 ms. Trace:
I20260709 13:06:57.889705 22904 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.821890 22869 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.838219 23052 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.919592 23052 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:57.920869 22869 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.921452 22869 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.921698 23052 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:57.909860 21117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.044s	sys 0.025s
I20260709 13:06:57.898964 23024 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.921911 22869 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.903786 21808 rpcz_store.cc:276] 0709 13:06:56.688989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.689377 (+   388us) service_pool.cc:224] Handling call
0709 13:06:56.711754 (+ 22377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.712132 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.712160 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.713299 (+  1139us) log.cc:844] Serialized 556 byte log entry
0709 13:06:57.707947 (+994648us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.713816 (+  5869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.720479 (+  6663us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.903124 (+182645us) raft_consensus.cc:1685] finished
0709 13:06:57.903150 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.903322 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":980311,"threads_started":1,"wal-append.queue_time_us":1051423}
I20260709 13:06:57.912853 22904 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:57.898396 22964 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.846s	user 0.007s	sys 0.001s
I20260709 13:06:57.924299 22951 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.924719 21296 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:57.922837 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:57.925294 22951 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:57.925585 22994 consensus_meta.cc:287] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.891s	user 0.003s	sys 0.006s
I20260709 13:06:57.925700 22951 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:06:57.926056 22994 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.926671 22951 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.922657 23024 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.928045 22951 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:57.926994 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:06:57.931034 22959 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.002s
I20260709 13:06:57.821460 23035 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.944154 23014 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:57.824230 22912 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.841171 22874 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.945075 22980 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.935359 22989 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:57.943351 22960 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:57.937506 23030 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.938016 23012 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:57.946529 22911 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:57.985384 22988 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.887733 22948 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.986037 22923 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.988770 21151 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:57.989513 22935 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.091566 22923 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.996836 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.082732 21292 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.092514 21299 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:58.092317 22935 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:57.997815 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.093611 22923 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.093729 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.007136 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.017210 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1645) took 1282 ms. Trace:
I20260709 13:06:58.076488 22944 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:58.032567 21264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.020s	sys 0.060s
W20260709 13:06:58.101933 21264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.021s	sys 0.060s
W20260709 13:06:58.102330 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 887258us
W20260709 13:06:58.033730 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53066.2us
W20260709 13:06:58.105381 21265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.019s	sys 0.123s
W20260709 13:06:58.096114 22962 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.000s
I20260709 13:06:58.074102 22989 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:57.985951 23024 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:58.087111 21293 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:58.087247 23030 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.090242 22960 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:58.090581 23035 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:57.990326 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.021845 22967 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.120066 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:58.120848 21812 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:58.121084 21192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.002s	sys 0.034s
W20260709 13:06:58.121546 21192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.002s	sys 0.034s
W20260709 13:06:58.107376 21265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.019s	sys 0.123s
I20260709 13:06:57.888567 22950 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.109762 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.113497 21810 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:58.074365 22874 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.115484 21811 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:58.126812 21813 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:58.115628 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.127698 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.084388 22988 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.128579 21813 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:58.128978 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:06:58.116503 21777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.035s	sys 0.068s
I20260709 13:06:58.102862 21294 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:06:58.130246 21777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.035s	sys 0.069s
I20260709 13:06:58.127874 21300 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:58.114524 22903 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.115382 22944 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.137334 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.025s	sys 0.012s
W20260709 13:06:58.142390 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.025s	sys 0.012s
W20260709 13:06:58.120935 21223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.008s	sys 0.032s
I20260709 13:06:58.136492 22967 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.139642 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:58.120846 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.041s
I20260709 13:06:58.144358 21142 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:58.046020 22959 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.128147 23020 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.135581 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.134549 22923 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.134969 22946 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.122622 23030 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.141700 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:58.171706 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.172598 21221 raft_consensus.cc:2410] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:58.138859 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.136950 23052 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.191001 22948 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.191466 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.192207 22935 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.192819 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.149278 23032 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.141924 23022 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.156613 22964 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.139804 22949 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.144877 21223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.008s	sys 0.032s
I20260709 13:06:58.165874 21812 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.138074 22960 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.893862 21809 rpcz_store.cc:276] 0709 13:06:56.594255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.595318 (+  1063us) service_pool.cc:224] Handling call
0709 13:06:56.608675 (+ 13357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.637632 (+ 28957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.637662 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.638787 (+  1125us) log.cc:844] Serialized 556 byte log entry
0709 13:06:57.831076 (+1192289us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.834664 (+  3588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.840018 (+  5354us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.893223 (+ 53205us) raft_consensus.cc:1685] finished
0709 13:06:57.893241 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.893392 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1189104,"threads_started":1,"wal-append.queue_time_us":1199042}
I20260709 13:06:58.168394 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:58.145231 21808 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.171033 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.174250 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:58.229106 21143 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:58.176395 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.177277 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.229604 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.190685 22874 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:06:58.148813 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.015s	sys 0.041s
I20260709 13:06:58.153849 23024 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.194195 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.198249 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:58.198132 21190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.005s	sys 0.035s
I20260709 13:06:58.216105 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.157123 22962 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.244541 23037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.034s	sys 0.019s
W20260709 13:06:58.260263 23037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.034s	sys 0.019s
I20260709 13:06:58.260119 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.259987 22962 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.260861 21226 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:58.261886 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.262452 22962 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.157785 23011 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.215833 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:58.096640 21296 rpcz_store.cc:276] 0709 13:06:56.734846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.734982 (+   136us) service_pool.cc:224] Handling call
0709 13:06:56.735306 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.925239 (+1189933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.016876 (+ 91637us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540037ffd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:58.017129 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734424960}
I20260709 13:06:58.143815 22903 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.137924 22950 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.277671 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.278468 21142 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:58.279218 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.279599 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.279739 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:58.280086 22950 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.222622 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:58.280331 21294 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
W20260709 13:06:58.274227 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 661) took 1565 ms (client timeout 1972 ms). Trace:
W20260709 13:06:58.280946 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58420.4us
W20260709 13:06:58.281069 21810 rpcz_store.cc:269] 0709 13:06:56.702425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.704765 (+  2340us) service_pool.cc:224] Handling call
0709 13:06:58.267455 (+1562690us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540035aa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:58.267585 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237921152}
I20260709 13:06:58.282128 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:58.282647 21810 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:58.282778 22903 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.228305 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.283445 22903 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.283572 21221 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:58.283931 22903 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.284346 22903 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.284564 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.285351 22962 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.280333 21297 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:58.197664 21224 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:58.151067 22967 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.239389 22987 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.240948 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.242713 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:58.217521 23052 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.243691 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.244294 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.215006 23017 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.146832 22944 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.226420 23032 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.228791 22949 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.252301 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
W20260709 13:06:58.252471 21190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.008s	sys 0.038s
W20260709 13:06:58.353708 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 1.00895e+06us
I20260709 13:06:58.215844 23064 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.253024 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.277490 23012 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.171608 22946 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.285418 22904 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:58.288003 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 72259us
I20260709 13:06:58.230265 21222 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:58.284519 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:06:58.382174 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 129804us
I20260709 13:06:58.253137 23021 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.221887 23022 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.328306 21812 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.225013 22980 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:58.226871 22934 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:58.286047 22962 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.266171 22912 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.253759 23062 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.167124 23020 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.226447 22964 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.345762 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:58.274664 23023 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.235152 22960 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.276310 22986 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.350937 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.270287 22951 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.380704 21220 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:58.382892 21191 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:06:58.578356 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 195540us
I20260709 13:06:58.289083 23060 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:58.329313 22988 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.263931 23024 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.169282 22923 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.323210 22927 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:58.296916 23011 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.346040 22948 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:06:58.382639 21811 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:58.569869 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.387693 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.658496 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:58.391688 22882 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.659754 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.460961 23061 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.659927 22882 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:58.486486 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 132093us
I20260709 13:06:58.489862 23018 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.572980 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.573442 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 227794us
I20260709 13:06:58.531312 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:58.519681 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:06:58.352463 23002 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.739s	user 0.003s	sys 0.009s
I20260709 13:06:58.577287 21142 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:58.524996 21143 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:58.585216 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:58.537724 22979 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.280s	user 0.013s	sys 0.000s
I20260709 13:06:58.659767 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.692337 21812 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:58.657709 21222 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.479560 21300 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:58.573237 22959 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:58.695066 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 312962us
I20260709 13:06:58.352185 23017 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.459308 22904 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:58.516085 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:58.621405 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:06:58.392676 22874 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.347100 23035 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:58.345208 21809 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:58.428351 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 438120us
I20260709 13:06:58.355087 22989 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.584107 23014 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.722098 21814 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:06:58.431205 23055 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
I20260709 13:06:58.639490 22912 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:58.617897 22986 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.661684 22932 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.357611 22987 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.617146 23066 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.381364 23012 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.390004 23064 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.665863 22951 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.586440 23023 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.844414 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:58.660462 23061 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.583230 23021 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.720799 22911 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:06:58.855185 21222 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:06:58.735069 23030 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:58.753716 23068 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:58.732756 23063 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:06:58.754302 23065 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
W20260709 13:06:58.753113 23070 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:58.752252 21806 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.741890 22979 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:58.841482 23022 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.841347 22960 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:58.752389 22946 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.843814 22969 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.892333 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 193092us
I20260709 13:06:58.752980 22949 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:06:58.930190 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 268558us
I20260709 13:06:58.950369 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:06:58.830891 22950 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:06:58.719871 22903 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.597594 23062 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.697576 23018 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.934458 21813 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:58.721201 23076 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.843933 23014 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.851374 22912 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.852972 22932 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.754710 22904 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.850739 23066 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.844094 23057 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.697532 23002 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:58.953497 21808 consensus_meta.cc:287] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.001s
I20260709 13:06:58.794813 22874 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.948374 22875 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:58.871232 23071 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:06:58.961697 22962 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.963732 22869 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.965003 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.093345 21805 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:06:58.857300 21147 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:59.084213 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2068) took 2282 ms. Trace:
I20260709 13:06:58.965003 22967 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.013972 22932 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.938192 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:58.964634 23072 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:06:58.752156 22968 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.231s
I20260709 13:06:58.939965 21226 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:06:58.935931 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 83210.2us
I20260709 13:06:59.087232 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2064) took 2472 ms. Trace:
I20260709 13:06:58.849413 22986 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.968051 21225 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:58.949061 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:58.986908 23032 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.018296 22994 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.856079 22989 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.973104 23064 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:06:58.971488 21814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 660) took 2269 ms (client timeout 2190 ms). Trace:
I20260709 13:06:58.962828 22934 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:59.095240 22912 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.939057 22944 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:58.942816 22979 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.094450 21217 rpcz_store.cc:276] 0709 13:06:56.801511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.802691 (+  1180us) service_pool.cc:224] Handling call
0709 13:06:56.832791 (+ 30100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.833168 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.833204 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.984642 (+151438us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.804602 (+819960us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.804655 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.804749 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.083376 (+1278627us) raft_consensus.cc:1685] finished
0709 13:06:59.083467 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.083926 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8189,"raft.queue_time_us":24746,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":27140,"thread_start_us":784943,"threads_started":1,"wal-append.queue_time_us":1106976}
W20260709 13:06:58.869963 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 127607us
I20260709 13:06:58.983676 22969 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.100765 23032 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:58.969944 22952 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.111531 22952 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:59.111313 23032 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.112254 22952 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.114542 23032 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.015975 22923 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:58.951674 22980 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.085194 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.116372 22932 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.116572 22980 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:58.950238 23080 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:06:59.117499 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:58.893501 23079 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:59.120043 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.120280 23079 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.935243 23063 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.122771 22935 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.123277 22935 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:58.965969 23059 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:06:59.123778 22935 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.085377 21220 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:58.740456 21148 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.008352 23066 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.933200 23052 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.126225 22869 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.126827 22869 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.127357 22869 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.128432 23052 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.128919 23052 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.129336 23052 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.796931 23035 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.985760 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:06:59.007035 23073 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:06:59.131968 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 146141us
I20260709 13:06:59.132045 23032 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.989794 23076 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.132815 23032 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.117446 22932 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:59.133386 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 184318us
I20260709 13:06:59.133867 23074 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.106144 22986 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.134442 23074 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.619392 23060 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.133379 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:58.989686 23014 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.136495 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:06:59.110390 22979 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.139036 22979 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.140879 22979 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.141499 22979 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.143352 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:59.144127 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1507) took 1034 ms. Trace:
I20260709 13:06:59.105000 22989 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.144750 22986 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:59.134903 23074 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.145253 22948 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:59.145605 22986 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:06:59.022502 23011 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.146661 23001 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.016831 23088 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.147142 23001 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:06:59.139456 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:59.148233 23088 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.032411 23024 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.089802 21221 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:59.033820 23017 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.012009 23057 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:59.104667 21814 rpcz_store.cc:269] 0709 13:06:56.702207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.707095 (+  4888us) service_pool.cc:224] Handling call
0709 13:06:58.971247 (+2264152us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54006626d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:58.971397 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4632175488}
I20260709 13:06:59.015933 22987 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.051201 23061 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.014763 22874 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.052563 23062 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.181612 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.178943 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.053431 23058 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.193867 21298 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:59.194394 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:59.170786 23012 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.194202 23058 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:58.753841 22882 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.028448 22875 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.148994 23001 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.133428 23076 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.144685 21151 rpcz_store.cc:276] 0709 13:06:58.109600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.109732 (+   132us) service_pool.cc:224] Handling call
0709 13:06:58.123884 (+ 14152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.124108 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.124136 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.134937 (+ 10801us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.545800 (+410863us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.545868 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.545975 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.143424 (+597449us) raft_consensus.cc:1685] finished
0709 13:06:59.143472 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.143792 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":389384,"threads_started":1,"wal-append.queue_time_us":696733}
I20260709 13:06:59.189496 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.021961 23018 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.176592 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.167894 21808 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:59.175463 23088 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.225813 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.098239 21223 rpcz_store.cc:276] 0709 13:06:56.615028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.617314 (+  2286us) service_pool.cc:224] Handling call
0709 13:06:56.617921 (+   607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.642631 (+ 24710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.643650 (+  1019us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.660151 (+ 16501us) log.cc:844] Serialized 556 byte log entry
0709 13:06:57.073995 (+413844us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6ac700ac 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b
0709 13:06:58.234013 (+1160018us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:58.249857 (+ 15844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.264093 (+ 14236us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.086334 (+822241us) raft_consensus.cc:1685] finished
0709 13:06:59.086377 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.086957 (+   580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707136,"thread_start_us":1562393,"threads_started":1,"wal-append.queue_time_us":1590482}
I20260709 13:06:59.167774 21292 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.215986 23062 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:59.217775 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.229327 23074 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.230011 21298 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
W20260709 13:06:59.281813 21219 consensus_meta.cc:287] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.055s	user 0.014s	sys 0.004s
I20260709 13:06:59.169737 23002 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.147173 22986 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.288921 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.289877 21810 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:59.290856 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.277837 23079 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.291878 21810 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:59.220992 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.181406 23057 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.133436 23032 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.254470 23074 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.254011 22952 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.171507 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:59.294865 21814 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:59.298784 23014 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:59.299953 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.303205 21807 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:06:59.303527 23061 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.252938 23063 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.225962 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 563) took 1121 ms. Trace:
I20260709 13:06:59.320964 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.321391 21296 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:59.321900 21150 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:59.169909 22903 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.311378 23061 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.322469 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 388) took 1126 ms. Trace:
I20260709 13:06:59.323069 22964 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.324551 23061 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.312446 23057 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.312796 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.325410 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 615) took 1205 ms. Trace:
I20260709 13:06:59.314030 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.325776 21813 rpcz_store.cc:276] 0709 13:06:58.119686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.136813 (+ 17127us) service_pool.cc:224] Handling call
0709 13:06:58.176255 (+ 39442us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:06:59.325099 (+1148844us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54003c3554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.325227 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627511296}
I20260709 13:06:59.326541 21298 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:59.327567 23057 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.329030 21295 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:59.329725 23057 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.330529 22951 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.315241 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.331036 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.331218 21291 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:59.331442 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2083) took 1105 ms. Trace:
I20260709 13:06:59.331863 21298 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:06:59.331883 21226 rpcz_store.cc:276] 0709 13:06:58.226180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.261591 (+ 35411us) service_pool.cc:224] Handling call
0709 13:06:59.331062 (+1069471us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54000cfdd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.331209 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557363456}
I20260709 13:06:59.333988 22969 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.336061 21298 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:59.250377 22932 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.214937 23058 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.215101 23012 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.320004 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.320133 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.322897 21150 rpcz_store.cc:276] 0709 13:06:58.195813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.196015 (+   202us) service_pool.cc:224] Handling call
0709 13:06:59.277816 (+1081801us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:06:59.322397 (+ 44581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376768}
I20260709 13:06:59.327062 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.172225 23023 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.256273 23088 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.342646 23088 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.282474 21219 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:59.336006 22952 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.305670 23074 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.335039 22979 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.397372 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2088) took 1013 ms. Trace:
I20260709 13:06:59.348163 23088 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.408510 23014 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.407914 21293 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:59.372385 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.371703 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.371884 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:59.412043 21222 rpcz_store.cc:276] 0709 13:06:58.383447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.100727 (+717280us) service_pool.cc:224] Handling call
0709 13:06:59.101305 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.229679 (+128374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.229717 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.229792 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:59.229828 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.396857 (+167029us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540038c554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:59.396937 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.397143 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294399360}
I20260709 13:06:59.410805 21292 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:06:59.414842 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 244630us
W20260709 13:06:59.349725 23067 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:06:59.436188 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.437834 21300 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
W20260709 13:06:59.374552 23069 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.633s	user 0.001s	sys 0.002s
I20260709 13:06:59.439304 22882 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.439524 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.440423 21294 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
W20260709 13:06:59.441445 22957 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:06:59.440137 22882 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.442065 22964 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:06:59.442480 21148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1508) took 1332 ms (client timeout 1540 ms). Trace:
I20260709 13:06:59.442866 22964 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.443940 22882 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.444860 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.445608 22964 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.417400 23001 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.447359 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2084) took 1202 ms. Trace:
I20260709 13:06:59.447599 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2075) took 1314 ms. Trace:
I20260709 13:06:59.448169 21219 rpcz_store.cc:276] 0709 13:06:58.133107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.136654 (+  3547us) service_pool.cc:224] Handling call
0709 13:06:59.438286 (+1301632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.399421 22980 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.449218 23035 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.438233 23023 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.451467 23023 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.453843 23023 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.455664 21812 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:06:59.456090 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1639) took 3101 ms. Trace:
I20260709 13:06:59.456529 21292 rpcz_store.cc:276] 0709 13:06:56.335054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.335205 (+   151us) service_pool.cc:224] Handling call
0709 13:06:56.335495 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.125608 (+790113us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54002fd8a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:06:58.076078 (+950470us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54002fd8a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf806f 00007f2b6dd70f60 00007f2b6dd727de 00007f2b6dd7cb49 00007f2b6dd7d416 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62
0709 13:06:59.090694 (+1014616us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b58003371d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcd60aa 00007f2b6dd58447 00007f2b6dd70fe7 00007f2b6dd727de 00007f2b6dd7cb49 00007f2b6dd7d416 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4
0709 13:06:59.432446 (+341752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.436123 (+  3677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253614592}
I20260709 13:06:59.459203 22976 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.459965 22976 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.460783 22979 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.394323 22935 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:06:59.462136 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.462698 22976 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.463333 22935 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.463547 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 613) took 1354 ms. Trace:
I20260709 13:06:59.464040 21805 rpcz_store.cc:276] 0709 13:06:58.109242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.112389 (+  3147us) service_pool.cc:224] Handling call
0709 13:06:59.463310 (+1350921us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54004fa1d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.463483 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129301248}
I20260709 13:06:59.464476 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:59.465356 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:06:59.466207 21805 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.466140 21263 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:59.466445 23021 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.466624 22949 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:59.472255 23002 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.467492 23096 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.471902 22978 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:59.467167 23021 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.474637 23002 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.475342 23021 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.467087 23079 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:59.478412 23079 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.479161 23079 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.481606 23035 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.482795 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.482250 23035 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.483469 21811 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:06:59.481624 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 371266us
I20260709 13:06:59.484360 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.484997 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:59.486491 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:06:59.487433 22923 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:59.487601 22904 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.488137 22904 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.488528 22904 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.479239 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.477484 21813 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:06:59.447785 21221 rpcz_store.cc:276] 0709 13:06:58.245035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.284312 (+ 39277us) service_pool.cc:224] Handling call
0709 13:06:59.447146 (+1162834us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54000fc654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.447302 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849107840}
I20260709 13:06:59.321228 21808 rpcz_store.cc:276] 0709 13:06:58.105025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.115878 (+ 10853us) service_pool.cc:224] Handling call
0709 13:06:58.140445 (+ 24567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.225567 (+1085122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.225882 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.408989 23066 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.467089 22949 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.509706 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 565) took 1395 ms. Trace:
I20260709 13:06:59.510150 22949 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.512862 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.474663 23096 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.477771 23002 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.478137 23021 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.516839 23032 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.525754 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.494642 21806 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:06:59.433692 23012 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.467669 22980 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.547941 22988 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:06:59.511698 23058 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:06:59.443054 21148 rpcz_store.cc:269] 0709 13:06:58.109998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.115273 (+  5275us) service_pool.cc:224] Handling call
0709 13:06:59.442094 (+1326821us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540017b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.442281 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218148096}
I20260709 13:06:59.553550 21114 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:59.550155 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:59.558104 21811 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.562007 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.567621 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.568933 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:59.569816 21292 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:59.569907 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.570575 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.570708 21299 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:06:59.571897 23035 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.571635 23058 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.572829 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.573563 21298 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:06:59.574286 23032 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.574353 23058 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.574589 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.576647 22875 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.567649 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.545272 22923 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.571796 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:59.608311 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 97099.8us
I20260709 13:06:59.614104 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.616729 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.617478 21299 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:06:59.619624 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.620365 21296 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.620410 22980 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.551776 23057 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.626170 22957 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.627046 22957 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:06:59.629189 22869 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.019s
I20260709 13:06:59.629630 22869 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.524485 21808 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:59.621443 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.629765 22957 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.760222 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.766346 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.726704 23077 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:06:59.711987 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 113689us
I20260709 13:06:59.510167 21807 rpcz_store.cc:276] 0709 13:06:58.114240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.114366 (+   126us) service_pool.cc:224] Handling call
0709 13:06:58.964819 (+850453us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:06:59.491186 (+526367us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400660dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:06:59.509632 (+ 18446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486093056}
I20260709 13:06:59.619006 21805 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:06:59.770870 21220 raft_consensus.cc:2368] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:06:59.630793 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:06:59.732673 23079 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.761093 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.608487 23060 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.738646 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1510) took 1520 ms. Trace:
I20260709 13:06:59.711158 23023 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.781172 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.687036 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:59.766389 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.635646 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.770737 21291 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
W20260709 13:06:59.714983 21809 consensus_meta.cc:287] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.566s	user 0.003s	sys 0.009s
W20260709 13:06:59.717803 23052 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.005s
W20260709 13:06:59.787907 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 269158us
I20260709 13:06:59.632799 22882 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.706670 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.639376 22980 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.632477 23071 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.712128 23066 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.766058 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.787907 21295 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:06:59.609454 22949 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:06:59.633956 23058 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:06:59.801100 21226 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:06:59.806655 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:06:59.809491 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.783763 21149 rpcz_store.cc:276] 0709 13:06:58.218106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.218216 (+   110us) service_pool.cc:224] Handling call
0709 13:06:58.239681 (+ 21465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.662594 (+422913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.662633 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.892022 (+229389us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.439953 (+547931us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:59.440025 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.623874 (+183849us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540017dc54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:06:59.623940 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.692390 (+ 68450us) raft_consensus.cc:1685] finished
0709 13:06:59.692418 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.738373 (+ 45955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8614,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":28353,"spinlock_wait_cycles":971726720,"thread_start_us":437095,"threads_started":1,"wal-append.queue_time_us":571207}
I20260709 13:06:59.797686 21809 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:59.785841 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.709668 23076 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.810041 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.816161 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.778760 23074 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.613468 22988 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:06:59.819831 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 209019us
I20260709 13:06:59.819229 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.821626 21222 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:59.819440 23053 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:06:59.823432 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.826970 21225 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:59.823969 21223 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:06:59.819397 23081 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:59.823480 22978 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.805259 22948 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.632202 22923 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.808112 23071 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.814914 22903 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.823812 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.770892 23077 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.835251 23053 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.835601 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.828032 21297 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.846292 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.827816 21805 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:59.845093 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.834450 21298 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.808537 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.838647 22944 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.841543 22976 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.802963 23052 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.846917 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.784228 23057 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.836728 22978 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.838584 22935 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:59.800591 23023 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.851608 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.864090 21151 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:06:59.851550 21150 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:59.843071 22903 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.850018 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.868322 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.843250 23071 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.860272 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.860008 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:06:59.860526 23106 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:06:59.837929 23058 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.863608 21220 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:06:59.860523 23053 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.865798 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.862133 22978 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.867281 22935 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:59.853590 22944 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.859056 22976 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:06:59.871085 23023 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.858889 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:06:59.875114 21806 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:06:59.920604 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.921257 21806 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.882474 21805 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:06:59.870791 22903 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.904762 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.883689 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.926803 21224 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:06:59.871557 21191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.540s (SENT) [suppressed 2 similar messages]
I20260709 13:06:59.904158 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.893817 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.919492 23053 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.904264 21222 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:59.930598 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.931032 22882 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.931893 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.932114 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.932482 21220 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:59.933353 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.933552 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.934525 21217 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:06:59.935659 21149 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:59.862746 22948 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:06:59.936498 21264 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:06:59.943282 21221 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:59.943635 21264 leader_election.cc:403] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.939566 23060 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:59.888734 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.925271 21809 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:59.904078 22976 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.892210 22944 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.942139 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.951956 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.850924 23096 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.903903 23058 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.963661 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.964262 21222 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:59.964689 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.965276 21220 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:06:59.938735 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.938968 22869 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.967468 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.937642 23053 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.966559 21814 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:06:59.972216 21264 leader_election.cc:400] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:06:59.958906 21296 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:06:59.966689 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.758360 23054 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:06:59.971567 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.978224 21218 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:59.978534 22923 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:06:59.978896 21147 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:06:59.975771 22949 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:06:59.978188 22988 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:06:59.983778 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:06:59.984454 21224 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:06:59.984517 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:59.973289 23099 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:06:59.986624 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:59.987339 21222 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.991266 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.993256 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:06:59.986263 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:06:59.993985 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 156696us
I20260709 13:06:59.994025 21814 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:06:59.996403 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:06:59.996970 21221 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.944684 22904 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.000898 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:06:59.976084 23053 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:00.002774 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 175735us
I20260709 13:06:59.998250 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.009908 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:06:59.992435 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:00.012147 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 174027us
I20260709 13:07:00.021440 21217 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
W20260709 13:07:00.026072 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 157012us
I20260709 13:07:00.029063 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.008572 23076 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.009853 23023 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.033341 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:06:59.998273 23071 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.024858 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.038712 21295 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:00.025758 23052 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.043720 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.031881 22869 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.033887 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:00.047848 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:00.029099 23077 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.048394 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.033314 23081 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.048964 21149 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
W20260709 13:07:00.058621 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 255933us
I20260709 13:07:00.063180 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.068251 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:00.046031 23074 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.043414 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:00.069428 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 108681us
I20260709 13:07:00.048358 23020 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.054172 22934 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.073174 21150 raft_consensus.cc:2368] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:00.061976 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.057650 22869 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.069895 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:00.080720 21223 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:00.087651 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.083045 21221 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:00.061146 23081 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.062335 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.085222 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.081732 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.084167 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.071359 21806 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.060640 23076 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:00.117211 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.108186 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.119050 21145 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:00.071296 21147 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:07:00.141669 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.092533 21217 raft_consensus.cc:2368] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:00.157137 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.091722 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:00.110210 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.291088 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.292515 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.159207 21811 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:00.076972 22948 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.088593 22869 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.111004 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:00.106747 23108 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:00.084580 23002 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.141958 22882 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.117954 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:00.315977 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 254936us
I20260709 13:07:00.069193 23111 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.231s
W20260709 13:07:00.316403 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 226043us
I20260709 13:07:00.089845 21293 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.089190 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:00.318066 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.327752 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.327894 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.144351 23057 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.089488 23081 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.329722 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 216387us
I20260709 13:07:00.291533 21809 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:00.320971 21149 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:00.321026 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.128588 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.320259 21814 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:00.336244 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.337633 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.338333 21814 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:00.159457 23113 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.281s
I20260709 13:07:00.325887 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.346647 21150 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:00.325376 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 239183us
I20260709 13:07:00.329257 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:00.326555 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 234872us
I20260709 13:07:00.290882 22949 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.116418 23071 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.332319 21813 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:00.158692 22978 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.142475 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.344977 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.136195 22944 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.320169 23002 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.322294 23012 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:00.322985 23058 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.325186 22948 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.344445 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.388734 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.375638 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.369064 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:00.377682 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 43718.1us
I20260709 13:07:00.325014 22882 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:00.370124 22964 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.381827 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.398835 21292 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.395684 21217 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:00.377329 21805 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:00.400602 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.341325 21223 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:00.350446 22932 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:00.327553 23076 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.408102 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.389856 23002 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.399506 23001 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.952s	user 0.004s	sys 0.016s
I20260709 13:07:00.388772 23058 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.384239 23023 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:00.417904 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.394279 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.417294 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:00.401479 22882 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.403524 22964 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:00.396595 23021 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:00.397500 22949 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.475744 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:00.482306 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 54918.6us
I20260709 13:07:00.466166 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.482666 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:00.479457 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 76723us
I20260709 13:07:00.489389 21146 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:00.407727 22932 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:00.485060 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 67849.3us
I20260709 13:07:00.493337 23076 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:00.494603 23103 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.623s	user 0.002s	sys 0.001s
I20260709 13:07:00.495337 23053 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.507417 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.508074 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.509402 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.512494 23074 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:00.513013 23074 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.448251 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:00.497910 22976 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.004s
I20260709 13:07:00.488431 22964 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.485488 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 576) took 1311 ms. Trace:
I20260709 13:07:00.491384 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.415657 23012 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.464604 22904 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.448833 23058 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.497076 22903 consensus_meta.cc:287] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 13:07:00.515393 21292 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:00.498440 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.490777 23096 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:00.480150 21296 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:07:00.477881 23023 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.522413 22949 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.521049 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.526968 21292 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.506788 22934 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:00.532168 23079 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.533349 21147 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:00.533742 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.533341 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.504297 23020 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:00.548568 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48015.7us
W20260709 13:07:00.540386 21222 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.001s
I20260709 13:07:00.549644 21222 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:00.549940 21151 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:00.540306 21225 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:00.518124 21810 rpcz_store.cc:276] 0709 13:06:59.173422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.526783 (+353361us) service_pool.cc:224] Handling call
0709 13:06:59.550746 (+ 23963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.568120 (+ 17374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.568157 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.568664 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.774732 (+206068us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.774768 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.774828 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.485019 (+710191us) raft_consensus.cc:1685] finished
0709 13:07:00.485039 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.485157 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":317,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":115,"thread_start_us":205665,"threads_started":1,"wal-append.queue_time_us":378567}
I20260709 13:07:00.543845 22944 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.544186 21298 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:00.555123 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.544544 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:07:00.557482 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 156838us
I20260709 13:07:00.545186 21292 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:00.545625 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.559816 21291 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.561197 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.562017 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.539536 22976 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:00.568451 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 83437.4us
I20260709 13:07:00.569818 22976 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.570142 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.570887 23096 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.572211 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:00.572944 23021 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.573285 23021 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:00.571244 23096 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:00.573630 23021 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.573937 23096 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.552215 23020 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:00.575601 23020 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.577682 22869 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.579972 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.581573 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:00.581609 23021 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.519587 23012 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.585429 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.590062 21299 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:00.591414 23002 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.593930 23002 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:00.594684 23002 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.599937 21298 raft_consensus.cc:2368] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:00.601564 21299 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:07:00.604369 23119 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:00.605566 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 627) took 1281 ms. Trace:
I20260709 13:07:00.603103 22869 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.595197 23002 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:00.607537 23021 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:00.608044 21808 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.760s	user 0.006s	sys 0.004s
I20260709 13:07:00.562144 21292 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:00.551231 22980 raft_consensus.cc:2764] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:00.613533 21291 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:00.616981 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56175us
I20260709 13:07:00.617713 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:00.622818 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 135036us
I20260709 13:07:00.609817 23012 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.624974 22932 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.625581 22932 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:00.625927 22932 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:00.626266 22932 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.626758 21049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46294 (request call id 377) took 4881 ms. Trace:
I20260709 13:07:00.623581 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.596328 22904 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.626125 22978 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.549149 22903 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.634277 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.637483 21148 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:00.638283 22903 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.638931 22869 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.639335 22869 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:00.640303 22869 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.642766 23054 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.000s
I20260709 13:07:00.644583 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.650004 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.650872 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.668203 21226 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.670286 23081 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:00.672223 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.672562 23081 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.673406 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.673873 23053 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.674396 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.652539 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.675450 23123 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.675640 21219 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:00.675988 23123 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:00.676964 21219 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:00.676923 23123 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.678174 21222 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.679692 23058 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.631990 22904 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.682343 22904 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.653056 23125 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.653265 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.655826 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:00.656078 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.656740 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.657423 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:00.657665 22932 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:00.667989 22976 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.659113 22964 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.676996 23020 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.687777 21814 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:00.689456 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.690580 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:00.755048 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 64539.1us
I20260709 13:07:00.692989 21293 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:00.609416 23002 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:00.693533 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75899.1us
I20260709 13:07:00.767902 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:00.691144 22935 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:00.696677 21294 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:00.698216 23012 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.699569 23052 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.796100 23052 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:00.796675 23053 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.681843 23058 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.705752 22923 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:00.693073 23111 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:07:00.706900 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.605937 21807 rpcz_store.cc:276] 0709 13:06:59.324558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.800055 (+475497us) service_pool.cc:224] Handling call
0709 13:06:59.843844 (+ 43789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.923344 (+ 79500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.923405 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.988129 (+ 64724us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.342351 (+354222us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:00.351034 (+  8683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.374292 (+ 23258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.605317 (+231025us) raft_consensus.cc:1685] finished
0709 13:07:00.605378 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.605509 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9316,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":33313,"thread_start_us":306820,"threads_started":1,"wal-append.queue_time_us":474730}
I20260709 13:07:00.707949 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:00.709285 22882 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.710886 21221 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.715818 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.709565 21224 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:00.718106 21806 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:00.718266 21151 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:00.718677 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.718885 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.721443 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.722177 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.685125 21048 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.725032 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:00.726032 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 70324.5us
I20260709 13:07:00.755928 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.693276 21226 raft_consensus.cc:2410] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:07:00.764334 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 190798us
I20260709 13:07:00.804258 21150 raft_consensus.cc:606] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:00.765035 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 141529us
I20260709 13:07:00.766587 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 575) took 1593 ms. Trace:
I20260709 13:07:00.710574 23125 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.813666 22882 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:00.774152 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 217428us
I20260709 13:07:00.754094 22980 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.815506 22980 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:00.815912 22980 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.815982 21048 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.818181 21048 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.820590 22964 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.821935 22869 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.702312 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:00.826712 21048 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:00.829322 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 73505.6us
I20260709 13:07:00.823606 21144 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:00.823661 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:00.831804 21221 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:00.832186 22935 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:00.800189 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 94585us
I20260709 13:07:00.802171 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:00.770406 23081 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.833369 23081 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.833923 23081 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.836508 23020 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.838083 23012 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.832757 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:00.833328 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:00.767621 22976 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:00.840201 22976 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:00.807042 22932 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:00.849198 21048 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.851059 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.824015 21147 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:00.855357 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.847052 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.779919 22978 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:00.860322 21145 raft_consensus.cc:2368] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
I20260709 13:07:00.858318 21048 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.863209 21778 leader_election.cc:400] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:00.863574 21778 leader_election.cc:403] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.863531 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.843683 22980 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.868276 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.865322 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.869195 21292 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.824855 23125 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.847496 23053 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:00.832782 22935 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:00.876608 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.867810 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:00.876829 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43600.1us
I20260709 13:07:00.856508 23020 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.872437 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:00.843101 22904 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.630820 21049 rpcz_store.cc:276] 0709 13:06:55.743576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.743884 (+   308us) service_pool.cc:224] Handling call
0709 13:07:00.625078 (+4881194us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.813648 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:57.025525 (+211877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:57.025579 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:06:57.025606 (+    27us) tablet.cc:662] Decoding operations
0709 13:06:57.026009 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:57.026083 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:57.026124 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:57.026365 (+   241us) tablet.cc:701] Row locks acquired
0709 13:06:57.026391 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:57.026574 (+   183us) write_op.cc:270] Start()
0709 13:06:57.026716 (+   142us) write_op.cc:276] Timestamp: P: 1783602417026514 usec, L: 0
0709 13:06:57.026746 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:06:57.213194 (+186448us) log.cc:844] Serialized 538 byte log entry
0709 13:06:58.353594 (+1140400us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54003e3ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd75e28 00007f2b717b0581 00007f2b717afd58 00007f2b717b49f1 00007f2b717b49a9 00007f2b717b4939 00007f2b717b4901 00007f2b717b3b2d 000000000038f354 000000000038f199
0709 13:06:59.397921 (+1044327us) op_driver.cc:464] REPLICATION: finished
0709 13:06:59.686622 (+288701us) write_op.cc:301] APPLY: starting
0709 13:06:59.686797 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:59.686977 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:59.687029 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:59.687768 (+   739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:59.688108 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:59.688185 (+    77us) write_op.cc:312] APPLY: finished
0709 13:06:59.735875 (+ 47690us) log.cc:844] Serialized 23 byte log entry
0709 13:06:59.740050 (+  4175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.741263 (+  1213us) write_op.cc:454] Released schema lock
0709 13:06:59.742209 (+   946us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:59.825571 (+ 83362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.827300 (+  1729us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":288192,"apply.run_cpu_time_us":4280,"apply.run_wall_time_us":126037,"num_ops":1,"prepare.queue_time_us":605686,"prepare.run_cpu_time_us":60049,"prepare.run_wall_time_us":1544115,"raft.queue_time_us":214889,"raft.run_cpu_time_us":13791,"raft.run_wall_time_us":91726,"replication_time_us":2370896,"spinlock_wait_cycles":29960960,"thread_start_us":2460938,"threads_started":4,"wal-append.queue_time_us":1276674,"wal-append.run_cpu_time_us":24060,"wal-append.run_wall_time_us":2237871}]]}
I20260709 13:07:00.810380 23113 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:00.824012 23096 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.893143 21292 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:00.868877 22948 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.874197 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.844584 22923 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:00.873749 23058 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.872313 22932 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.900502 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:00.923547 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46919us
I20260709 13:07:00.905423 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:00.908981 23052 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.909193 22935 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:00.910158 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.895988 21299 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.911465 23002 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:00.929105 21298 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:00.812419 21808 rpcz_store.cc:276] 0709 13:06:59.173105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.523669 (+350564us) service_pool.cc:224] Handling call
0709 13:06:59.523995 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.524370 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:00.608481 (+1084111us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.766183 (+157702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.766241 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.766299 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.766382 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.766526 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":981,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":156026,"threads_started":1,"wal-append.queue_time_us":153460}
I20260709 13:07:00.958194 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:00.958604 21813 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:00.920397 22932 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:00.919799 23128 raft_consensus.cc:2764] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:00.978170 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.950239 23020 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.904804 23074 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:00.949136 23002 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:00.914252 22948 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:00.982352 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 119388us
I20260709 13:07:00.952419 22869 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:00.971719 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:00.988720 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:00.976069 22932 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.979789 23012 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:00.986941 23135 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:00.996552 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:00.989423 23002 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.984846 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.001353 21810 raft_consensus.cc:2410] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:00.997743 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 98421.7us
I20260709 13:07:00.987419 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:01.014074 23145 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:01.016464 22948 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:01.019518 23081 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.021857 21807 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:01.022505 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:01.022786 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:00.997507 23053 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.026125 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.026628 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:01.026863 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:01.002220 21144 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.108489 21146 raft_consensus.cc:2410] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:07:00.991492 23131 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.130084 23131 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.083108 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:01.130694 23131 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.131800 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.133018 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.133579 21811 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:01.134326 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.134936 21811 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:01.085283 21263 leader_election.cc:400] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
I20260709 13:07:01.083873 22978 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.102053 21150 raft_consensus.cc:2368] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
I20260709 13:07:01.102396 21143 raft_consensus.cc:2368] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:01.109411 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:01.116070 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.116479 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:01.116647 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 68289.2us
I20260709 13:07:01.119014 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.120405 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.123593 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.149884 21144 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:01.124879 23052 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.048311 21299 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:01.136775 23081 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:01.137223 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:01.057126 23145 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:01.137967 21296 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:01.139586 21263 leader_election.cc:403] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.998677 23012 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:01.159173 21143 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:01.160420 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.130892 21226 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:01.148211 21114 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.176549 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.178443 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:01.178821 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.180956 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 577) took 1236 ms. Trace:
I20260709 13:07:01.181315 21814 rpcz_store.cc:276] 0709 13:06:59.944515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.683857 (+739342us) service_pool.cc:224] Handling call
0709 13:07:00.684403 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.687633 (+  3230us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:00.799890 (+112257us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.157076 (+357186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.157152 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.180738 (+ 23586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.180808 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.180908 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7542,"thread_start_us":293435,"threads_started":1}
I20260709 13:07:01.182673 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:01.080051 21806 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:01.188221 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 324757us
I20260709 13:07:01.189239 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.190021 21150 raft_consensus.cc:2368] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
W20260709 13:07:01.190555 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 105446us
I20260709 13:07:01.192106 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.179158 23012 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:01.215340 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 55051us
I20260709 13:07:01.162701 23145 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.190294 23071 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:01.185750 22903 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.204703 21805 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:01.196897 22978 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
I20260709 13:07:01.236837 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.202307 23096 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:01.210882 23130 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:01.222187 21225 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:01.227425 21219 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:01.195621 22948 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.233752 21811 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:01.226680 23020 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:01.231825 23002 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.215310 22976 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:07:01.256078 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.256157 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:01.217674 22988 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:01.255939 23020 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.241133 22980 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:01.248612 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 217264us
I20260709 13:07:01.272492 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:01.248756 22923 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:01.255970 23144 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:07:01.281821 23130 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.286295 23096 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:01.288795 22988 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.298221 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:01.261613 23074 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:01.266902 23081 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:01.322904 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 181545us
I20260709 13:07:01.257017 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:01.356201 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54190us
I20260709 13:07:01.289786 23122 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:01.356825 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 140144us
I20260709 13:07:01.361933 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:01.362574 21296 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:01.360616 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:01.366200 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:01.313393 22988 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:01.416728 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 196337us
I20260709 13:07:01.372114 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:01.431980 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:01.432469 21297 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.433712 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 67572.8us
I20260709 13:07:01.432773 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:01.300993 23131 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:01.437325 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 200587us
I20260709 13:07:01.434381 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:01.370337 23150 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:07:01.440416 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 220414us
I20260709 13:07:01.361974 23122 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:01.445940 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:01.447921 21147 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.452651 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:01.449345 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 176944us
I20260709 13:07:01.455376 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:01.458846 21224 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:01.437988 23081 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.467775 22988 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.497419 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:01.500278 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47619.6us
I20260709 13:07:01.449064 23153 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:07:01.323697 23130 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.518957 21190 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:01.520604 23130 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:01.458424 23125 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.576s	user 0.003s	sys 0.007s
I20260709 13:07:01.521358 23125 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.521903 22976 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:01.488384 21297 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:01.522625 22976 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.523600 21807 raft_consensus.cc:2368] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:01.457501 23021 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.525005 22976 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:01.508178 23164 raft_consensus.cc:2764] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:01.526073 23164 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.526399 23125 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:01.526517 23164 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.527071 23164 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.371040 23155 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:07:01.509035 22904 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:01.512516 23148 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:01.516533 21142 raft_consensus.cc:2410] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:01.496124 23081 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.525074 23021 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.529445 23081 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.529709 23021 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:01.507592 23160 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.509922 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:01.530618 23160 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.531028 21293 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:01.449028 23143 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:07:01.532570 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 99860us
I20260709 13:07:01.503942 23161 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:01.556838 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 101577us
I20260709 13:07:01.531054 23160 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.548142 23159 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.567013 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:01.567924 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:01.568068 21297 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.568583 21296 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:01.570412 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:01.564956 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 130650us
I20260709 13:07:01.571223 21299 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.556628 22988 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.556998 23163 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.564265 23002 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:01.586623 21297 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
W20260709 13:07:01.579680 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 60848us
I20260709 13:07:01.578387 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:01.562784 23155 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:01.563359 23125 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.599681 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:01.584154 23161 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:07:01.580166 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:01.595672 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:01.610951 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:01.619236 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:01.622430 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:01.623287 21226 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:01.624135 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:01.627136 21296 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:01.553259 23122 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.580466 23172 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:01.627310 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:01.574436 23159 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:01.660602 21813 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:01.970106 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 696) took 1008 ms. Trace:
I20260709 13:07:01.970543 21813 rpcz_store.cc:276] 0709 13:07:00.961650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.983589 (+ 21939us) service_pool.cc:224] Handling call
0709 13:07:01.619080 (+635491us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:01.970029 (+350949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10327424}
I20260709 13:07:01.634894 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:01.972244 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 345007us
I20260709 13:07:01.758021 21299 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
W20260709 13:07:01.706755 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43623us
W20260709 13:07:01.794202 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 331886us
W20260709 13:07:01.645758 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.977779 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.969018 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 358163us
W20260709 13:07:01.969202 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 390862us
I20260709 13:07:01.968848 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:01.980616 21292 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:01.982936 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:01.987417 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:01.988384 21812 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.682998 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:02.013321 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 417737us
W20260709 13:07:01.818930 23058 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.897s	user 0.008s	sys 0.000s
I20260709 13:07:01.731993 21293 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:01.617568 23130 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:01.684687 23165 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:07:01.756989 23012 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 13:07:02.020076 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:01.757386 23158 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.707719 23128 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.629410 23173 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.015360 22882 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:02.031298 21217 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:02.031579 23176 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.031738 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:01.617846 23163 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:01.749390 23131 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.065958 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.067623 21295 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:02.065405 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52664.9us
I20260709 13:07:01.814332 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.032660 21292 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.986204 23023 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.997872 23053 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.687404 23125 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:01.719310 23021 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.323s
I20260709 13:07:02.025166 23155 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.032635 23058 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:02.080708 21263 leader_election.cc:400] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
I20260709 13:07:02.030035 23122 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.054502 23161 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.049379 23158 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.050997 23128 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:02.082365 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 100723us
I20260709 13:07:02.084944 23187 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:02.087291 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 404315us
I20260709 13:07:02.076081 23023 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:02.080575 23053 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.049033 23012 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.049803 23130 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.065582 22882 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.096036 21222 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:07:02.099550 23128 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.107391 21294 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:02.087354 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 105317us
I20260709 13:07:02.106642 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:02.096416 23131 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.075007 22964 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:02.097659 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.071156 23176 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:02.117810 23188 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.118254 23188 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:02.118378 22964 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.118800 21263 leader_election.cc:400] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:02.119127 21263 leader_election.cc:403] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.118583 23176 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.113930 21222 pending_rounds.cc:85] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 2
I20260709 13:07:02.103415 23161 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:02.124516 22882 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.125116 22882 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.119166 23188 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.091693 23173 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:07:02.114348 23164 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:07:02.111533 23053 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.122004 21222 pending_rounds.cc:107] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:07:02.127825 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.125928 22964 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
W20260709 13:07:02.127579 23145 consensus_meta.cc:287] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.000s
I20260709 13:07:02.119902 23187 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:02.126036 22932 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.114s	user 0.012s	sys 0.000s
I20260709 13:07:02.092809 23155 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.158422 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.149760 21222 raft_consensus.cc:2917] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:07:02.131450 22882 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:02.167074 21222 raft_consensus.cc:2889] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.173456 22932 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.180055 22882 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.181953 22932 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.202005 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:02.204545 23179 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.211591 23181 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.212039 23181 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:02.212369 23181 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.213325 23161 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:02.214063 21808 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.001s
I20260709 13:07:02.214491 21808 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:02.204641 23002 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.215173 23002 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.151780 23163 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.221401 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.205034 23187 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.205866 23188 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:02.251062 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49157.9us
I20260709 13:07:02.131485 23164 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:02.253635 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48269.8us
W20260709 13:07:02.215031 21808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 694) took 1254 ms (client timeout 1655 ms). Trace:
I20260709 13:07:02.258368 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.259075 21810 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:02.266885 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 147079us
I20260709 13:07:02.283174 21812 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:02.291291 23202 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.292230 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.292181 23202 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.293401 23197 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:02.298941 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 133692us
I20260709 13:07:02.299736 21189 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:02.323056 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 205286us
I20260709 13:07:02.295157 23202 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:02.296720 23160 consensus_meta.cc:287] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
I20260709 13:07:02.224416 23159 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:02.156118 23125 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:02.330463 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 202691us
I20260709 13:07:02.170351 23145 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.330916 21263 leader_election.cc:400] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:02.277259 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.336573 21190 leader_election.cc:400] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:02.337018 21190 leader_election.cc:403] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.328719 23176 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.344609 21225 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:02.276568 21808 rpcz_store.cc:269] 0709 13:07:00.960925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.985405 (+ 24480us) service_pool.cc:224] Handling call
0709 13:07:01.573894 (+588489us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:02.214971 (+641077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644736}
I20260709 13:07:02.335704 22932 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.151365 23158 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.161091 23023 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.347682 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.349187 21145 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:02.362247 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.350150 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.348675 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.350751 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.369532 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.370748 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.343683 23191 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.372224 23188 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.351116 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.351368 23012 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:02.353257 23053 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:02.374944 23081 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.000s
I20260709 13:07:02.375394 23081 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.375772 23053 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:02.354926 22988 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.776s	user 0.005s	sys 0.005s
I20260709 13:07:02.343690 23176 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.376374 21143 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.376726 23176 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.355655 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.377399 21151 raft_consensus.cc:2368] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:02.345155 23187 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.379127 23145 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.360900 22932 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.380532 22932 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.356650 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.295102 23197 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:02.384941 23197 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.385340 23197 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:02.385829 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.386303 23197 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.387629 23197 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.366488 23023 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.388159 23181 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.389087 23130 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.389406 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.389937 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.390497 23181 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:02.391201 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.366803 23155 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.357156 23190 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.333458 23160 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.368011 23164 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.391299 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.410784 21217 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.367188 23158 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.414978 23175 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.415424 23175 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.416254 23175 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.417481 23175 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.417609 21144 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:02.419641 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.423074 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:02.424218 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 91560.3us
I20260709 13:07:02.403095 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:02.409015 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.426038 21146 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:02.426478 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 172058us
I20260709 13:07:02.411377 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:02.428335 22948 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.428527 23160 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.428481 23153 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.429694 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.429634 23153 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.409757 23155 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.433899 23182 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:02.434345 23182 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.434756 23182 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:02.435362 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.436811 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:02.377406 23081 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:02.439939 21142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1260) took 1640 ms (client timeout 1727 ms). Trace:
I20260709 13:07:02.440385 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:02.440570 21142 rpcz_store.cc:269] 0709 13:07:00.799472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.801983 (+  2511us) service_pool.cc:224] Handling call
0709 13:07:02.439642 (+1637659us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540031ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:02.439857 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568710400}
I20260709 13:07:02.441387 23155 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.441799 23155 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.442131 23155 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.430817 23176 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:02.443622 21224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2116) took 1417 ms (client timeout 1824 ms). Trace:
W20260709 13:07:02.444172 21224 rpcz_store.cc:269] 0709 13:07:01.026235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.026390 (+   155us) service_pool.cc:224] Handling call
0709 13:07:02.443357 (+1416967us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54001270d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:02.443537 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806810368}
I20260709 13:07:02.445096 23176 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:02.445797 21147 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:02.446664 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.443660 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.456805 21217 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:02.457074 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46716.6us
W20260709 13:07:02.466985 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.479631 21776 leader_election.cc:400] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:02.480644 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:02.491338 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 143679us
I20260709 13:07:02.497974 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.499933 21291 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:02.487629 22976 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:02.511214 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.482177 23176 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.478446 23160 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.481820 23164 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.482406 23096 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.528041 21146 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:02.493047 23012 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.556128 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:02.524487 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 201951us
I20260709 13:07:02.528203 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.558594 21222 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.527393 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2066) took 1212 ms. Trace:
I20260709 13:07:02.527043 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.551568 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.553130 21142 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.559237 21291 rpcz_store.cc:276] 0709 13:07:01.290630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.290766 (+   136us) service_pool.cc:224] Handling call
0709 13:07:02.436640 (+1145874us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:02.503229 (+ 66589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27877120}
I20260709 13:07:02.560163 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:02.525952 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46146.5us
I20260709 13:07:02.484108 23181 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:07:02.553332 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.506042 22976 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:02.561090 23012 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.561731 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:02.561658 22976 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.562752 22976 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.563995 21220 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:02.564343 21220 pending_rounds.cc:85] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 5
I20260709 13:07:02.564556 21220 pending_rounds.cc:107] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:02.564939 21220 raft_consensus.cc:2889] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.556861 23145 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.561760 23096 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.565667 23145 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.564431 23146 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:02.567070 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.565862 23190 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:02.571029 21224 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.569603 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.572593 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.575441 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.576206 21148 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:02.577847 23192 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:07:02.549032 23149 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.561676 23012 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.579437 23149 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.580045 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.579509 23146 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.580467 23149 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.581151 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.581234 23146 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.582823 21224 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:02.584283 21143 raft_consensus.cc:2410] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:02.560786 21217 raft_consensus.cc:2368] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:02.567708 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.586421 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.586959 21217 raft_consensus.cc:2368] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:02.570888 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.590190 23164 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.590731 23164 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.590833 21147 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:02.567287 23160 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.592365 23145 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.592150 23164 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.593132 23160 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.594444 23128 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.596635 23128 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.597615 21225 raft_consensus.cc:2410] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:02.597807 22932 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.504570 22964 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:07:02.600865 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.608170 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.609596 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.609874 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.610311 21144 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:02.610512 21143 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:02.602701 21221 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:02.603833 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.554327 23131 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:07:02.525404 23071 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:07:02.607110 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.612237 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.615392 21189 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:02.612844 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.618240 21189 leader_election.cc:403] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.618681 21146 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:02.613143 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.620558 21144 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:02.621618 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.618391 21221 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:02.604219 21219 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.637567 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.630350 21222 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:02.631196 23131 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.648500 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.652860 21222 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:02.613842 23155 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.649216 21148 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.633543 22948 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:07:02.668560 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 343959us
W20260709 13:07:02.648658 21776 connection.cc:256] RPC call timeout handler was delayed by -1.6328112330000977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:07:02.670616 21776 connection.cc:256] RPC call timeout handler was delayed by -1.5950112330000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:07:02.670989 21776 connection.cc:256] RPC call timeout handler was delayed by -1.576111233000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:07:02.670811 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:02.671463 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4989079040000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:07:02.671876 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4762112330000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:07:02.672155 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4197079040000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:07:02.672577 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4051112330000706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:07:02.672973 21776 connection.cc:256] RPC call timeout handler was delayed by -1.3538112329999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 13:07:02.673363 21776 connection.cc:256] RPC call timeout handler was delayed by -1.253011233000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:07:02.673724 21776 connection.cc:256] RPC call timeout handler was delayed by -1.2413112330000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:07:02.674129 21776 connection.cc:256] RPC call timeout handler was delayed by -1.1693112330000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 13:07:02.647903 23197 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:02.674503 21776 connection.cc:256] RPC call timeout handler was delayed by -1.1045112330000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:07:02.645793 23131 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:02.677954 21776 connection.cc:256] RPC call timeout handler was delayed by -1.0478112330000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:07:02.678397 21776 connection.cc:256] RPC call timeout handler was delayed by -1.0408079040000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:07:02.680578 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:02.682562 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:02.683187 21813 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:07:02.686753 23096 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.689883 23012 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.675535 23192 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.691684 23192 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.692654 23012 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.693477 23131 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.694027 23192 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.694659 23131 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.695513 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:02.698211 23211 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:02.698055 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:02.698846 22932 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.677320 23197 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:02.699436 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.699980 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.700309 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.700711 21812 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.701032 21222 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:02.701829 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.702136 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2127) took 1079 ms. Trace:
I20260709 13:07:02.702255 23197 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.669134 23164 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.710176 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.714672 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.715090 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:02.716307 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:02.714689 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:02.722702 23071 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.723206 23071 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:02.724107 23071 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.725131 21150 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.725255 23155 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:02.680680 23204 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.728440 23204 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:02.729615 23204 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.736011 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.760061 22932 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:02.760601 22932 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:02.760702 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.761018 22932 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.763219 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:02.766891 21299 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:02.768759 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.769655 21292 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:02.771661 21297 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:02.776638 21812 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:02.779417 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:02.779531 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 129472us
I20260709 13:07:02.780387 21142 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:02.776165 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.782290 21144 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.789572 21295 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:02.791354 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.781668 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.793637 21813 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.794783 21142 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:02.793715 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:02.796761 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.797618 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.802619 21811 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:02.804309 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.804631 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.807406 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:02.805888 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.812000 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.786571 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:02.818626 23146 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.818686 21299 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:02.819403 23146 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:02.796388 23197 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.825503 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.828502 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:02.830662 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.830741 21811 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.803791 22976 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:07:02.833112 23200 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
I20260709 13:07:02.821451 22903 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.825928 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.835646 21296 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:02.826632 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:02.836696 21292 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.837260 23182 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.774596 23164 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.831697 21808 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:02.840366 23218 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.840620 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.841005 23218 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:02.841823 21808 raft_consensus.cc:2368] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:02.841900 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.843606 23111 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:02.845984 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.848309 21291 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:02.842166 23187 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:02.824918 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:02.855397 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.865561 21814 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:02.809990 23023 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.793650 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:02.873696 21295 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:02.868201 21292 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:02.843631 21806 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:02.869767 23188 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.888648 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.869892 22903 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:02.909338 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.889394 23164 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.877170 23060 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.940111 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:02.943427 21812 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:02.869333 23187 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:02.954483 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.959192 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 700) took 1970 ms (client timeout 1884 ms). Trace:
W20260709 13:07:02.959797 21810 rpcz_store.cc:269] 0709 13:07:00.989375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.098704 (+109329us) service_pool.cc:224] Handling call
0709 13:07:02.958978 (+1860274us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54004a3654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:02.959106 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197556096}
I20260709 13:07:02.961068 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:02.962904 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.964036 21810 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:02.707597 21218 rpcz_store.cc:276] 0709 13:07:01.623041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.625928 (+  2887us) service_pool.cc:224] Handling call
0709 13:07:01.683738 (+ 57810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.060397 (+376659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.062676 (+  2279us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.104479 (+ 41803us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.462359 (+357880us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180035f920. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:02.548688 (+ 86329us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.554061 (+  5373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.566743 (+ 12682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.701813 (+135070us) raft_consensus.cc:1685] finished
0709 13:07:02.701840 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.702058 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55353,"raft.queue_time_us":53831,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8508,"spinlock_wait_cycles":4960512,"thread_start_us":43485,"threads_started":1,"wal-append.queue_time_us":394463}
I20260709 13:07:02.884088 21144 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:02.907182 21116 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:02.980049 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72976.2us
I20260709 13:07:02.820724 23146 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.913478 21808 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:02.915397 21807 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:02.990125 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:02.915802 23012 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:02.991503 23012 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.991871 23012 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:02.916186 22903 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.841959 23218 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:02.917829 23020 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:03.000484 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.001715 21219 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:03.002482 23128 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:03.002763 23002 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:02.918131 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.004585 21814 raft_consensus.cc:2368] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4.
I20260709 13:07:02.918465 23179 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:02.919047 23181 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:02.919564 22932 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:02.925088 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1676) took 1215 ms. Trace:
I20260709 13:07:03.007889 21300 rpcz_store.cc:276] 0709 13:07:01.709931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.820200 (+110269us) service_pool.cc:224] Handling call
0709 13:07:01.820595 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.978286 (+157691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.978342 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.374489 (+396147us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180047ba20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a
0709 13:07:02.464032 (+ 89543us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b2c0006e2e8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:02.506064 (+ 42032us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.783339 (+277275us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.783374 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.783433 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.924847 (+141414us) raft_consensus.cc:1685] finished
0709 13:07:02.924870 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.925005 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1795,"raft.queue_time_us":157164,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":30346,"spinlock_wait_cycles":36271744,"thread_start_us":203046,"threads_started":1,"wal-append.queue_time_us":254084}
I20260709 13:07:02.943058 23060 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.018386 23167 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.018662 23060 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:03.019014 23167 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:03.020120 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.982455 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:03.036728 21811 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:02.985415 23153 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:02.985589 23123 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.986007 22976 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.984282 21813 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:03.062719 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.011608 23187 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:03.000475 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.524348 21220 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.526995 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:03.367910 23071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.060s	sys 0.148s
I20260709 13:07:03.325230 23182 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:03.362357 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 445000us
I20260709 13:07:03.517822 21048 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 372) took 3556 ms. Trace:
I20260709 13:07:03.528565 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:03.528824 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.025s
W20260709 13:07:03.527805 23071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.060s	sys 0.151s
W20260709 13:07:03.559782 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.011s	sys 0.025s
W20260709 13:07:03.504544 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:03.171012 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 365146us
W20260709 13:07:03.560489 21035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 56207.7us
I20260709 13:07:03.561612 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:03.310374 22882 raft_consensus.cc:993] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:07:03.092214 22988 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:03.529678 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.563519 21812 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:07:03.512369 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:03.230262 23125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.012s	sys 0.038s
I20260709 13:07:03.532274 21292 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:03.078603 23175 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.532917 21806 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.316995 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:03.527673 21813 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:03.566728 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:02.695645 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:03.534538 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.534889 23060 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:03.133631 23123 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.537235 21189 leader_election.cc:400] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:03.586717 21189 leader_election.cc:403] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.520262 23023 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.535657 23195 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.538044 23197 consensus_meta.cc:287] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.006s
W20260709 13:07:03.384169 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.543491 21808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.012s	sys 0.025s
W20260709 13:07:03.596964 21808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.025s
W20260709 13:07:03.545280 22964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.009s	sys 0.005s
I20260709 13:07:03.554226 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.578258 23111 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.565639 22988 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:03.544099 23218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:07:03.556710 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.304437 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:03.557776 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.558818 21299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.022s	sys 0.022s
W20260709 13:07:03.602005 21299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.023s	sys 0.022s
I20260709 13:07:03.522274 23149 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:03.602063 23218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.008s	sys 0.001s
I20260709 13:07:03.320448 21049 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 3 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 4 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.601280 21814 raft_consensus.cc:2376] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3. Re-sending same reply.
I20260709 13:07:03.577450 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.578933 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.606173 21813 raft_consensus.cc:2376] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4. Re-sending same reply.
W20260709 13:07:03.585419 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.554040 23182 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.607143 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.592072 23229 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:03.565828 23125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.015s	sys 0.059s
W20260709 13:07:03.593492 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 56463.7us
I20260709 13:07:03.594817 23172 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:03.591902 23224 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.608913 21812 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:03.602269 23128 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.629585 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:03.629524 23128 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.630508 21221 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:03.631495 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:03.632020 21221 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:03.605325 21049 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:03.633383 21049 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:03.633939 22976 raft_consensus.cc:1081] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Signalling peer f81bf1abd0b34f518d1f2b79cc4dba77 to start an election
I20260709 13:07:03.634105 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.634795 21049 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:03.636673 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.636132 21049 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.636510 23012 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.637467 23012 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.637633 21049 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 5 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.611424 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:03.625833 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.615842 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:03.641258 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.616093 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:03.642005 21222 raft_consensus.cc:2368] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:03.641834 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.616837 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:03.642436 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.593636 23175 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:03.590433 23123 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.528594 21048 rpcz_store.cc:276] 0709 13:06:59.940045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.979901 (+ 39856us) service_pool.cc:224] Handling call
0709 13:07:03.496283 (+3516382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:01.496802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:01.715543 (+218741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:01.715607 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:07:01.715635 (+    28us) tablet.cc:662] Decoding operations
0709 13:07:01.827094 (+111459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:01.827224 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:01.827286 (+    62us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:01.828073 (+   787us) tablet.cc:701] Row locks acquired
0709 13:07:01.828149 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:07:01.828330 (+   181us) write_op.cc:270] Start()
0709 13:07:01.828487 (+   157us) write_op.cc:276] Timestamp: P: 1783602421828266 usec, L: 0
0709 13:07:01.828509 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:01.829331 (+   822us) log.cc:844] Serialized 2558 byte log entry
0709 13:07:02.219407 (+390076us) op_driver.cc:464] REPLICATION: finished
0709 13:07:02.262677 (+ 43270us) write_op.cc:301] APPLY: starting
0709 13:07:02.262797 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:02.263035 (+   238us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:02.263214 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:02.264446 (+  1232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:02.264741 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:02.264818 (+    77us) write_op.cc:312] APPLY: finished
0709 13:07:02.265152 (+   334us) log.cc:844] Serialized 53 byte log entry
0709 13:07:02.266156 (+  1004us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.266297 (+   141us) write_op.cc:454] Released schema lock
0709 13:07:02.266353 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:02.268547 (+  2194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.268595 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8381,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":42993,"apply.run_cpu_time_us":3299,"apply.run_wall_time_us":5818,"num_ops":6,"prepare.queue_time_us":405162,"prepare.run_cpu_time_us":14648,"prepare.run_wall_time_us":633864,"raft.queue_time_us":74367,"raft.run_cpu_time_us":11753,"raft.run_wall_time_us":100336,"replication_time_us":375984,"thread_start_us":565115,"threads_started":4,"wal-append.queue_time_us":254094,"wal-append.run_cpu_time_us":11854,"wal-append.run_wall_time_us":1189823}]]}
I20260709 13:07:03.619293 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:03.599668 22980 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:03.609200 22964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.009s	sys 0.006s
I20260709 13:07:03.628925 21225 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:03.609855 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.642868 21224 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:03.643471 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.654536 21813 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:03.655306 21811 raft_consensus.cc:2368] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4.
I20260709 13:07:03.655674 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.656205 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.601671 23153 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:03.630884 21298 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.610255 21805 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.649083 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:03.635107 22976 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.595031 23195 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.590804 23060 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.594269 23023 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.660717 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:03.685870 21811 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:03.663072 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:03.647378 21294 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:03.675014 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:03.646829 23206 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.645131 23170 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:03.693953 21263 leader_election.cc:400] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:03.622862 23182 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.696950 21811 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:03.699052 21263 leader_election.cc:400] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:03.608611 23111 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.702800 21263 leader_election.cc:403] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.672729 23224 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.699800 21218 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
W20260709 13:07:03.703018 23226 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:03.711750 21814 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:03.717813 21812 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:03.685973 22976 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:03.702455 23188 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:03.721844 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.672864 22980 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.719226 22964 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
I20260709 13:07:03.729224 21814 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 1 LEARNER]: Advancing to term 3
I20260709 13:07:03.692622 23153 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.730672 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.667141 22988 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.702736 23170 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.725075 23188 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.742944 21149 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:03.743673 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:03.746345 21150 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.749915 22976 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.753762 23060 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:03.753895 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.754993 23220 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:07:03.758630 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 234873us
I20260709 13:07:03.763859 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:03.766563 21263 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3.
W20260709 13:07:03.766852 21264 connection.cc:256] RPC call timeout handler was delayed by -1.1014623469999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:07:03.759333 23111 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:03.767642 21264 connection.cc:256] RPC call timeout handler was delayed by -1.0228963550000572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:07:03.772130 23172 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.772689 23172 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.773231 22988 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.773888 23128 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:03.774850 23172 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:03.777459 23167 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.778630 23167 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.779234 21217 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:03.721220 23175 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.780552 22980 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:03.780789 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:03.781586 22980 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:03.746716 23188 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.784989 22932 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:03.785578 22932 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.786620 23229 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.788035 23023 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:03.789763 23232 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:03.721673 23206 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:03.782035 22980 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.792397 21813 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:07:03.792742 21813 pending_rounds.cc:85] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
I20260709 13:07:03.792902 21814 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:03.793625 22980 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:03.794066 23153 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:03.794116 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 710) took 1056 ms. Trace:
I20260709 13:07:03.792960 21813 pending_rounds.cc:107] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:07:03.796463 21813 raft_consensus.cc:2889] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.780797 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1251) took 1192 ms. Trace:
I20260709 13:07:03.797454 21217 rpcz_store.cc:276] 0709 13:07:02.588292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.621015 (+ 32723us) service_pool.cc:224] Handling call
0709 13:07:03.780613 (+1159598us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540038d454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:03.780742 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659936128}
I20260709 13:07:03.800143 21142 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:03.801298 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.808964 21150 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:03.815868 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 498953us
I20260709 13:07:03.817312 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:03.819736 23206 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.820153 23206 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:03.821019 23206 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.822491 23206 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.824430 23175 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:03.825203 23175 consensus_queue.cc:1243] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:03.825785 23149 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:03.826140 23149 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:03.827029 23149 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:03.829324 21190 leader_election.cc:400] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:03.829663 21190 leader_election.cc:403] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.830294 23172 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:03.837805 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:03.839859 22964 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.840395 22964 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:03.840904 22964 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:03.843927 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 93708.5us
W20260709 13:07:03.844493 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44782.8us
W20260709 13:07:03.846980 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 334733us
W20260709 13:07:03.847177 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 98284.6us
W20260709 13:07:03.796437 23221 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:07:03.854671 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.859045 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.882922 21149 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:03.848251 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:03.879570 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:03.861536 21812 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:03.892445 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 287742us
I20260709 13:07:03.894428 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.897873 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.898541 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:03.900025 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 98845.2us
I20260709 13:07:03.871441 23229 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.896205 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48011.4us
I20260709 13:07:03.906803 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.908830 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.847368 22980 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:07:03.915366 21115 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.646s (SENT)
I20260709 13:07:03.909822 21291 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:03.916960 23230 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:03.897837 22923 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.924315 21292 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:03.919423 23229 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:03.901993 21219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2121) took 2271 ms (client timeout 2708 ms). Trace:
I20260709 13:07:03.928979 23230 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:03.941665 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 124428us
I20260709 13:07:03.909159 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.948792 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.897927 23128 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:03.933452 23172 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.908485 23187 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:07:03.964004 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 58199.7us
I20260709 13:07:03.969838 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:03.970465 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:03.971217 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:03.946599 21219 rpcz_store.cc:269] 0709 13:07:01.621611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.625716 (+  4105us) service_pool.cc:224] Handling call
0709 13:07:02.251141 (+625425us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:03.859191 (+1608050us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400127fd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:03.892944 (+ 33753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642618624}
I20260709 13:07:03.971738 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:03.971976 21293 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:03.972898 21776 leader_election.cc:400] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:03.973048 23229 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:03.937141 22932 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.977548 21142 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:03.979029 21226 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:03.979712 23254 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.979854 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.980141 23125 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:03.980016 23188 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:03.980945 21219 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:03.999289 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 155372us
I20260709 13:07:03.981637 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:03.983338 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.984330 23234 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:03.991199 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:03.918411 23240 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:07:03.949869 22923 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:03.981029 23012 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.001226 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:03.966074 21223 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.000509 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:03.972901 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:03.994581 21226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:55550
W20260709 13:07:04.047318 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.059660 21226 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.964571 23230 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.002579 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.044384 22903 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.054662 23012 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:04.046403 21805 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:04.055542 23239 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:04.077543 21805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 712) took 1336 ms (client timeout 1629 ms). Trace:
I20260709 13:07:04.077689 23181 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.078451 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.055717 22923 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:04.042032 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 50949.6us
W20260709 13:07:04.045066 23236 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:07:04.060071 21226 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.005699 23228 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:07:04.060235 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.018450 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.049082 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2089) took 1195 ms. Trace:
I20260709 13:07:03.794654 21809 rpcz_store.cc:276] 0709 13:07:02.737550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.779394 (+ 41844us) service_pool.cc:224] Handling call
0709 13:07:02.815184 (+ 35790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.834416 (+ 19232us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:03.252200 (+417784us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.793633 (+541433us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18003c90a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:07:03.793776 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.793821 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.793887 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.793952 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.794062 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4139,"prepare.queue_time_us":728364,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"spinlock_wait_cycles":34144640,"thread_start_us":581661,"threads_started":2,"wal-append.queue_time_us":443840}
I20260709 13:07:04.063479 21297 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:04.067739 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67349.8us
I20260709 13:07:04.067844 22980 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.074409 21298 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:04.089099 21190 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4.
I20260709 13:07:03.974932 23195 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:03.965886 23251 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:07:04.076980 23012 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.078701 21814 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:03.998181 23254 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.083899 23239 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:04.045609 23248 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:04.102867 23188 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.075714 22964 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.082067 22903 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:04.105393 22964 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.107200 21217 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:04.057176 21144 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:04.083026 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:04.043649 23249 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:03.987041 23182 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.087566 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.086622 21296 rpcz_store.cc:276] 0709 13:07:02.853918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.854136 (+   218us) service_pool.cc:224] Handling call
0709 13:07:02.854569 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.208820 (+354251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.208869 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.238859 (+ 29990us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.685886 (+447027us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:03.685925 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.685987 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.048849 (+362862us) raft_consensus.cc:1685] finished
0709 13:07:04.048870 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.049023 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78382,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5785,"thread_start_us":687124,"threads_started":2,"wal-append.queue_time_us":381816}
I20260709 13:07:04.090502 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.040807 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:04.112210 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.112284 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.049998 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 647) took 1184 ms. Trace:
I20260709 13:07:04.113260 21292 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:04.113216 21808 rpcz_store.cc:276] 0709 13:07:02.865595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.879439 (+ 13844us) service_pool.cc:224] Handling call
0709 13:07:02.908880 (+ 29441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.913350 (+  4470us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:03.002136 (+ 88786us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.789221 (+787085us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:04.015141 (+225920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.049632 (+ 34491us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.049704 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.049785 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.049936 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207272,"raft.queue_time_us":338448,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10258,"spinlock_wait_cycles":5786880,"thread_start_us":747834,"threads_started":2,"wal-append.queue_time_us":693021}
I20260709 13:07:04.114862 21296 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.094795 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:03.976255 23172 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.000535 22932 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:04.118233 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.100531 21226 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:04.044227 23238 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:07:04.078038 21805 rpcz_store.cc:269] 0709 13:07:02.740621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.779342 (+ 38721us) service_pool.cc:224] Handling call
0709 13:07:03.304253 (+524911us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:04.077474 (+773221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5227392}
I20260709 13:07:04.116442 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:04.111001 23204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.008s	sys 0.013s
I20260709 13:07:04.147872 21298 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:04.086202 23197 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:07:04.105923 23123 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.117966 22964 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.110827 23170 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.158587 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2091) took 1303 ms. Trace:
W20260709 13:07:04.151186 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.160193 21300 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:07:04.136395 23242 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:04.152443 23204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.008s	sys 0.013s
W20260709 13:07:04.176564 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.192703 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.231750 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.122900 22882 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:04.171643 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:04.233002 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 61487.7us
W20260709 13:07:04.233842 23224 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.000s
I20260709 13:07:04.234244 23224 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.234850 23264 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:04.224066 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 59287us
I20260709 13:07:04.167375 23206 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.235735 23206 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:04.167900 23170 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:04.237665 23206 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.237795 23172 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.158991 21299 rpcz_store.cc:276] 0709 13:07:02.854776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.867938 (+ 13162us) service_pool.cc:224] Handling call
0709 13:07:02.869109 (+  1171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.900179 (+ 31070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.900222 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.900808 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.602513 (+701705us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.602564 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.602653 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.158374 (+555721us) raft_consensus.cc:1685] finished
0709 13:07:04.158391 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.158534 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69996,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":46148,"thread_start_us":684892,"threads_started":1,"wal-append.queue_time_us":799418}
I20260709 13:07:04.239573 21292 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.227521 23149 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:04.227643 21806 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.002s
I20260709 13:07:04.234123 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.163100 23187 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.286518 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 202380us
W20260709 13:07:04.248371 21115 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.531s (SENT)
I20260709 13:07:04.253993 21226 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.254645 23240 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.287699 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:04.255560 23123 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.258427 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 651) took 1319 ms. Trace:
I20260709 13:07:04.260018 23254 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.259727 22932 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:04.289204 23260 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:04.262619 23230 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.149164 23155 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:04.285094 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51051.8us
I20260709 13:07:04.294073 23012 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.294807 23230 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:04.264803 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 291130us
W20260709 13:07:04.295929 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.296190 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.296576 23012 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.296811 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.297230 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:04.298120 23167 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:04.298485 23167 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:04.298640 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 165168us
I20260709 13:07:04.299037 23167 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.299067 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.300077 23255 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.297281 23012 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.301362 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.301348 23012 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:04.302146 23255 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.302194 23012 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.303948 23255 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:04.304863 23012 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.305069 23255 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:04.305485 23255 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:04.306315 23255 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.307509 23255 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.307731 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:04.309706 23155 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.310112 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.311463 23230 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.312083 23230 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:04.312755 23230 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:04.315688 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.316010 21810 rpcz_store.cc:276] 0709 13:07:02.939197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.964798 (+ 25601us) service_pool.cc:224] Handling call
0709 13:07:02.965070 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.523628 (+558558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.523655 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.524107 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.711167 (+187060us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.711729 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.711795 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.258152 (+546357us) raft_consensus.cc:1685] finished
0709 13:07:04.258180 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.258356 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11157,"raft.queue_time_us":11287,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":186632,"threads_started":1,"wal-append.queue_time_us":222315}
I20260709 13:07:04.325489 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.330482 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:04.340975 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:04.342852 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.348984 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.350009 21295 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.351529 23012 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.266108 23266 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:04.354254 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.286526 23172 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.286448 23146 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:04.361999 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 56796.8us
I20260709 13:07:04.328611 23182 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.319916 23187 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.371587 23187 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.357481 23239 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.310113 23155 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.286753 21806 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:04.375800 23023 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.376319 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 650) took 1457 ms. Trace:
I20260709 13:07:04.376585 23023 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:04.376861 21806 rpcz_store.cc:276] 0709 13:07:02.930836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.957044 (+ 26208us) service_pool.cc:224] Handling call
0709 13:07:04.376240 (+1419196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.330736 23224 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.381333 23224 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.384490 23224 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.339816 23060 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.386217 23060 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.387463 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 673) took 1071 ms. Trace:
I20260709 13:07:04.387979 21814 rpcz_store.cc:276] 0709 13:07:03.315763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.793659 (+477896us) service_pool.cc:224] Handling call
0709 13:07:04.078535 (+284876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.094459 (+ 15924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.387180 (+292721us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54001b5650. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:04.387386 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654479104}
I20260709 13:07:04.388804 23060 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.355928 23125 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:04.391167 23125 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.367621 23256 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:04.363996 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45014.1us
I20260709 13:07:04.368085 23146 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.298506 23273 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.353471 23251 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.329706 23240 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:04.339653 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.353780 23197 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:04.384680 21294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 349) took 1651 ms (client timeout 1562 ms). Trace:
W20260709 13:07:04.407423 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85823.6us
I20260709 13:07:04.407852 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:04.353446 22980 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.353430 23242 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.427170 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.428107 23023 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:04.445034 21264 leader_election.cc:336] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.727s (SENT)
I20260709 13:07:04.445477 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:04.445652 23125 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.398978 22988 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:04.431468 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.395561 23266 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.393270 23181 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.431080 21295 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:04.375819 23230 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.447860 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.448300 23146 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.448446 21295 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:04.448748 23230 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.435832 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.450269 23188 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.436333 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:04.451553 21814 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:04.434676 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 186344us
I20260709 13:07:04.437045 23012 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.450428 23167 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.585498 23167 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.586295 23012 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.590055 23012 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.453008 21116 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:04.460378 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:04.462517 23240 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.463074 23266 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:04.441807 23224 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.465461 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.451458 22980 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:04.452942 21218 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
W20260709 13:07:04.437022 21294 rpcz_store.cc:269] 0709 13:07:02.732925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.762457 (+ 29532us) service_pool.cc:224] Handling call
0709 13:07:04.384395 (+1621938us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:04.384586 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679444736}
I20260709 13:07:04.487511 21814 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.463884 23149 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.492869 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:04.493886 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.494980 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:04.495007 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:04.471655 23262 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:04.440975 23197 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.509290 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.491055 21806 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:07:04.518414 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.444270 23242 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.530463 21224 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.531484 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.534773 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:04.535702 22903 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:04.535974 21222 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.734012 21219 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:07:04.536725 23272 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:07:04.537344 23267 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:04.537389 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:04.735136 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 241365us
I20260709 13:07:04.736761 21221 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.737996 21221 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:04.544986 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:04.557459 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:04.552847 23002 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:04.560725 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.569211 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.564126 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:04.573469 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.748965 21296 raft_consensus.cc:2376] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2. Re-sending same reply.
I20260709 13:07:04.573474 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.575688 21147 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:04.597334 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 144389us
I20260709 13:07:04.597484 21810 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:07:04.578991 21115 leader_election.cc:336] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.536s (SENT)
I20260709 13:07:04.750061 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:04.686831 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.750331 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 171376us
W20260709 13:07:04.707294 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.723287 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.596875 23269 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.728220 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 193564us
I20260709 13:07:04.721329 23060 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.735028 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:04.744093 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:04.721758 23188 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.561475 23125 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:04.752130 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.752660 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.715242 23224 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.722975 23257 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.781239 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:04.721652 23262 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:04.723677 23146 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.800465 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:04.784936 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:04.787868 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:04.793363 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.783914 22903 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.786981 23060 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:04.752513 23153 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.812995 21810 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:04.803583 21814 raft_consensus.cc:2410] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:04.806506 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:04.814554 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:04.806577 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:04.805965 21115 leader_election.cc:336] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.586s (SENT)
I20260709 13:07:04.820199 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.826804 21292 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
I20260709 13:07:04.826651 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:04.806128 23266 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.807585 23280 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:04.828351 23266 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.806506 23123 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.828912 23266 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.829018 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:04.804818 22903 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.836637 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:04.834678 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:04.722899 23149 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:04.802410 23224 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.802259 22932 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.848915 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:04.852015 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.802484 23264 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.800168 21809 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:04.833467 23153 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.802582 23172 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:04.851958 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.819679 23060 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:04.853502 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:04.841122 22903 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.835749 23123 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.778787 23002 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.847364 21223 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:04.842427 23146 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.868301 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:04.800838 23188 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:04.871701 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.811244 23125 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.822005 23269 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.866868 23153 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.897369 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:04.902350 21292 raft_consensus.cc:2376] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3. Re-sending same reply.
W20260709 13:07:04.904300 21264 leader_election.cc:336] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.897s (SENT)
I20260709 13:07:04.904892 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:04.880264 23123 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.940065 21300 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:04.939960 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52413.3us
I20260709 13:07:04.943023 21143 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:04.946080 21810 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.942138 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:04.873008 22980 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.884091 23250 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.990904 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:04.949525 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45281.1us
W20260709 13:07:04.992476 21264 leader_election.cc:336] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.968s (SENT)
I20260709 13:07:04.993999 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:04.872835 23172 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.898047 23146 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:04.999837 21810 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:04.914374 23071 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:05.006278 21146 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:04.946314 21805 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.949827 23273 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.943082 23060 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.865275 23264 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:04.948114 23258 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.012931 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:04.991607 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:04.944226 23023 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:04.990541 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:05.018311 23290 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:05.027179 23242 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.048309 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.049212 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1690) took 1138 ms. Trace:
I20260709 13:07:05.048806 23146 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.049548 21291 rpcz_store.cc:276] 0709 13:07:03.911381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.927361 (+ 15980us) service_pool.cc:224] Handling call
0709 13:07:05.048166 (+1120805us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:05.049151 (+   985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6088064}
I20260709 13:07:05.050632 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.051168 21291 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:05.053448 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 63136.5us
I20260709 13:07:05.056327 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.057118 21291 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:07:05.061281 23292 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:07:05.054090 21293 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.062863 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2098) took 1129 ms. Trace:
I20260709 13:07:05.095832 21291 rpcz_store.cc:276] 0709 13:07:03.933533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.062107 (+1128574us) service_pool.cc:224] Handling call
0709 13:07:05.062394 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.062555 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.062585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.062624 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.062654 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.062705 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.062813 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.102700 23002 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.103276 23172 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.103499 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:05.104295 23229 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:05.104460 23289 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:05.104725 23229 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:05.105598 23229 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.106602 23229 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.109338 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:05.109963 21146 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:05.039978 22932 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:05.111342 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:05.095222 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2097) took 1163 ms. Trace:
I20260709 13:07:05.112129 21806 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:05.112326 21296 rpcz_store.cc:276] 0709 13:07:03.931752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.059888 (+1128136us) service_pool.cc:224] Handling call
0709 13:07:05.094559 (+ 34671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.094800 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.094857 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.094911 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.094954 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.095022 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.095154 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.112972 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.113936 21296 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.114782 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 361) took 1214 ms. Trace:
I20260709 13:07:05.040736 23258 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.131421 23188 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.045037 23023 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.132150 23262 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.133242 23262 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.133745 23023 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:05.055943 23242 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:05.089594 21809 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:05.135673 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2100) took 1191 ms. Trace:
I20260709 13:07:05.115159 21295 rpcz_store.cc:276] 0709 13:07:03.900433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.449080 (+548647us) service_pool.cc:224] Handling call
0709 13:07:04.449360 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.459721 (+ 10361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.459754 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.460381 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.747630 (+287249us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.747682 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.747764 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.114580 (+366816us) raft_consensus.cc:1685] finished
0709 13:07:05.114600 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.114719 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10000,"raft.queue_time_us":10151,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5451,"thread_start_us":256987,"threads_started":1,"wal-append.queue_time_us":406274}
I20260709 13:07:05.148959 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.134624 23153 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.137375 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:05.105626 23295 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:05.165051 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.139603 22932 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:07:05.160584 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62955.1us
I20260709 13:07:05.141228 21296 rpcz_store.cc:276] 0709 13:07:03.944139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.113513 (+1169374us) service_pool.cc:224] Handling call
0709 13:07:05.113776 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.135432 (+ 21656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.135617 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.166389 21295 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
W20260709 13:07:05.171411 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 365446us
I20260709 13:07:05.171965 21295 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:05.172204 21115 leader_election.cc:336] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.592s (SENT)
I20260709 13:07:05.172686 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1694) took 1093 ms. Trace:
I20260709 13:07:05.172721 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:05.173301 21295 rpcz_store.cc:276] 0709 13:07:04.079112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.171467 (+1092355us) service_pool.cc:224] Handling call
0709 13:07:05.171724 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.172408 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.172632 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.188762 21296 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:05.189411 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2101) took 1228 ms. Trace:
I20260709 13:07:05.189747 21296 rpcz_store.cc:276] 0709 13:07:03.961230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.188145 (+1226915us) service_pool.cc:224] Handling call
0709 13:07:05.188416 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.189179 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.189360 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:05.191100 21115 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.708s (SENT) [suppressed 62 similar messages]
I20260709 13:07:05.135691 23149 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.065409 23297 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:07:05.164628 23264 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.218114 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.224148 21299 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:05.224802 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1698) took 1056 ms. Trace:
I20260709 13:07:05.225317 21299 rpcz_store.cc:276] 0709 13:07:04.168234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.238916 (+ 70682us) service_pool.cc:224] Handling call
0709 13:07:05.217980 (+979064us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:05.224732 (+  6752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141556480}
I20260709 13:07:05.219553 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2151) took 1201 ms. Trace:
I20260709 13:07:05.226596 21217 rpcz_store.cc:276] 0709 13:07:04.017851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.018062 (+   211us) service_pool.cc:224] Handling call
0709 13:07:05.219325 (+1201263us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b5400127ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:05.219483 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47088384}
I20260709 13:07:05.193809 23256 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.195533 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:05.242835 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.221005 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.230311 23175 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:05.215196 22988 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:05.267856 22903 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.183384 23242 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.231719 23300 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:07:05.235500 23125 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:05.275315 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.235711 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:05.291927 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.292590 21809 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:05.293462 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.294570 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.300843 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.302402 21809 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:05.303678 21809 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:05.314404 23153 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:05.316138 23155 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.000s
I20260709 13:07:05.316404 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:05.316586 23155 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.318305 23224 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.318884 23155 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.320684 22903 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.324306 23273 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.289525 21806 raft_consensus.cc:2368] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
W20260709 13:07:05.332486 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.274757 23123 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.287390 23269 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.271207 23266 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.315106 23153 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.311643 23251 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.004s
I20260709 13:07:05.327379 23242 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.346446 21805 raft_consensus.cc:2368] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4.
W20260709 13:07:05.371141 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 180064us
I20260709 13:07:05.361656 23251 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:05.374934 21115 leader_election.cc:336] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.846s (SENT)
W20260709 13:07:05.377316 21115 leader_election.cc:336] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.868s (SENT)
I20260709 13:07:05.377689 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:05.381464 21115 leader_election.cc:336] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.952s (SENT)
I20260709 13:07:05.381899 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:05.362171 23153 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:05.388521 23309 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:05.392452 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2099) took 1456 ms. Trace:
I20260709 13:07:05.392845 21291 rpcz_store.cc:276] 0709 13:07:03.935800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.098326 (+1162526us) service_pool.cc:224] Handling call
0709 13:07:05.098664 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.138878 (+ 40214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.138938 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.138995 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.139036 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.392218 (+253182us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b540001e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:05.392259 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.392385 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91870080}
I20260709 13:07:05.394111 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:05.394639 21291 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.397579 21810 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.398790 21810 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:05.400170 21149 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:05.400525 21149 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:05.401166 21149 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.402180 21149 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.403851 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.405051 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.406509 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2106) took 1150 ms. Trace:
I20260709 13:07:05.408831 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.409188 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 364) took 1293 ms. Trace:
I20260709 13:07:05.409461 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:05.409547 21295 rpcz_store.cc:276] 0709 13:07:04.115771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.174180 (+1058409us) service_pool.cc:224] Handling call
0709 13:07:05.174489 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.174695 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.174720 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.192707 (+ 17987us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.340427 (+147720us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.340478 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.340570 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.408996 (+ 68426us) raft_consensus.cc:1685] finished
0709 13:07:05.409015 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.409134 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":123017,"threads_started":1,"wal-append.queue_time_us":166119}
I20260709 13:07:05.406801 21292 rpcz_store.cc:276] 0709 13:07:04.256655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.405802 (+1149147us) service_pool.cc:224] Handling call
0709 13:07:05.406053 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.406207 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.406231 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.406269 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.406302 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.406351 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.406461 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.410782 21807 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:05.380559 22903 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.417738 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2094) took 1539 ms. Trace:
I20260709 13:07:05.418258 21297 rpcz_store.cc:276] 0709 13:07:03.878094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.878253 (+   159us) service_pool.cc:224] Handling call
0709 13:07:03.878512 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.088658 (+210146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.417444 (+1328786us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540001d454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:05.417669 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424989440}
I20260709 13:07:05.423908 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46392 (request call id 89) took 1069 ms. Trace:
I20260709 13:07:05.424293 21295 rpcz_store.cc:276] 0709 13:07:04.354542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.410830 (+1056288us) service_pool.cc:224] Handling call
0709 13:07:05.423842 (+ 13012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.427733 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2108) took 1059 ms. Trace:
I20260709 13:07:05.428196 21295 rpcz_store.cc:276] 0709 13:07:04.368120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.426669 (+1058549us) service_pool.cc:224] Handling call
0709 13:07:05.427034 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.427303 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.427342 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.427399 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.427450 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.427520 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.427664 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.429145 21291 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:05.387532 21806 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.412688 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:05.386406 21293 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:05.439337 21299 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.444172 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.444819 21298 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:05.445248 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1697) took 1294 ms. Trace:
I20260709 13:07:05.445554 21298 rpcz_store.cc:276] 0709 13:07:04.150598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.152962 (+  2364us) service_pool.cc:224] Handling call
0709 13:07:05.444024 (+1291062us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55e9c 00007f2b6ac55a5b 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:05.445194 (+  1170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44718208}
I20260709 13:07:05.446846 21298 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:05.425426 23300 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:05.448841 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2110) took 1019 ms. Trace:
I20260709 13:07:05.430580 23269 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.450028 21298 rpcz_store.cc:276] 0709 13:07:04.428966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.446256 (+1017290us) service_pool.cc:224] Handling call
0709 13:07:05.446553 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.447133 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.448792 (+  1659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.696094 21149 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:05.654064 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.608310 23312 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:05.457660 23269 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.625154 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 737) took 1083 ms. Trace:
W20260709 13:07:05.581251 21115 leader_election.cc:336] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.074s (SENT)
I20260709 13:07:05.720084 21148 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.727648 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 365) took 1611 ms. Trace:
W20260709 13:07:05.727190 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 145997us
I20260709 13:07:05.728456 21296 rpcz_store.cc:276] 0709 13:07:04.116053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.190569 (+1074516us) service_pool.cc:224] Handling call
0709 13:07:05.190860 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.192858 (+  1998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.192886 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.214849 (+ 21963us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.373246 (+158397us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.373286 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.373352 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.727461 (+354109us) raft_consensus.cc:1685] finished
0709 13:07:05.727480 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.727600 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1350,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":125219,"threads_started":1,"wal-append.queue_time_us":188825}
I20260709 13:07:05.712749 23153 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.648926 23266 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.731920 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:05.455724 23224 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.466799 21293 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:05.571780 23240 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:05.733975 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 370) took 1172 ms. Trace:
W20260709 13:07:05.466423 23257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.013s	sys 0.026s
I20260709 13:07:05.655139 23123 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.621251 23229 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:05.724627 23269 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.735381 21296 rpcz_store.cc:276] 0709 13:07:04.561936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.733196 (+1171260us) service_pool.cc:224] Handling call
0709 13:07:05.733468 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.733632 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.733657 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.733697 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.733729 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.733780 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.733906 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.734871 21293 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:05.743072 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2105) took 1490 ms. Trace:
I20260709 13:07:05.745812 21299 rpcz_store.cc:276] 0709 13:07:04.256164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.258272 (+1002108us) service_pool.cc:224] Handling call
0709 13:07:05.437115 (+178843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.439838 (+  2723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.742865 (+303027us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400160dd0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:05.743017 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382018816}
W20260709 13:07:05.738945 23257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.066s	sys 0.074s
I20260709 13:07:05.723984 21809 rpcz_store.cc:276] 0709 13:07:04.542000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.315054 (+773054us) service_pool.cc:224] Handling call
0709 13:07:05.315468 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.315859 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.315915 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.316494 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.430877 (+114383us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:05.435753 (+  4876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.439584 (+  3831us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.495245 (+ 55661us) raft_consensus.cc:1685] finished
0709 13:07:05.555368 (+ 60123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.612687 (+ 57319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12426,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5605,"thread_start_us":96450,"threads_started":1,"wal-append.queue_time_us":105644}
I20260709 13:07:05.767483 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:05.768209 21812 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:05.768707 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 728) took 1228 ms. Trace:
I20260709 13:07:05.769889 21293 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.769106 21812 rpcz_store.cc:276] 0709 13:07:04.539863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.553310 (+ 13447us) service_pool.cc:224] Handling call
0709 13:07:05.767326 (+1214016us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:05.768636 (+  1310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6403328}
I20260709 13:07:05.773960 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 731) took 1233 ms. Trace:
I20260709 13:07:05.780725 21143 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:05.783237 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.787433 21189 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:05.792747 21814 rpcz_store.cc:276] 0709 13:07:04.540615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.838620 (+298005us) service_pool.cc:224] Handling call
0709 13:07:04.838888 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.901017 (+ 62129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.901047 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.901086 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.901123 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.773605 (+872482us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b54005c4ed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:05.773667 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.773873 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142446976}
I20260709 13:07:05.736615 23240 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.814673 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1699) took 1363 ms. Trace:
I20260709 13:07:05.815086 21298 rpcz_store.cc:276] 0709 13:07:04.451633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.451497 (+999864us) service_pool.cc:224] Handling call
0709 13:07:05.654049 (+202552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.654316 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:05.730539 (+ 76223us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.814346 (+ 83807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.814394 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.814435 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.814513 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.814620 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1540,"prepare.queue_time_us":93844,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"thread_start_us":130624,"threads_started":2}
I20260709 13:07:05.745272 23229 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.819190 21293 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.817826 23251 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:05.820245 23251 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.820685 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:05.822219 23251 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:05.823454 22932 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:05.824007 22932 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:05.824927 22932 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:05.828400 21813 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.828962 21813 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:05.811681 23257 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:05.832753 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2116) took 1027 ms. Trace:
I20260709 13:07:05.828547 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:05.833362 21298 rpcz_store.cc:276] 0709 13:07:04.804968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.816386 (+1011418us) service_pool.cc:224] Handling call
0709 13:07:05.831615 (+ 15229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.832380 (+   765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.832404 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.832442 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.832479 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.832531 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.832681 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.831955 21813 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.818634 23146 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:05.838065 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2109) took 1469 ms. Trace:
I20260709 13:07:05.838441 21292 rpcz_store.cc:276] 0709 13:07:04.368648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.431047 (+1062399us) service_pool.cc:224] Handling call
0709 13:07:05.432908 (+  1861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.433165 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:05.739895 (+306730us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.837768 (+ 97873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.837816 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.837858 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.837917 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.838015 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":304918,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1315,"thread_start_us":386697,"threads_started":2}
I20260709 13:07:05.841938 21813 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.836913 23229 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.860575 21813 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:07:05.862088 21813 pending_rounds.cc:85] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:05.862885 21813 pending_rounds.cc:107] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:05.863713 21813 raft_consensus.cc:2889] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.842010 23146 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:05.873478 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 727) took 1333 ms. Trace:
I20260709 13:07:05.873946 21813 rpcz_store.cc:276] 0709 13:07:04.539599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.553093 (+ 13494us) service_pool.cc:224] Handling call
0709 13:07:05.828058 (+1274965us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:05.828257 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.873205 (+ 44948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.873412 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7736192}
I20260709 13:07:05.862871 23153 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:05.864694 23167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.005s	sys 0.006s
I20260709 13:07:05.867187 23146 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:05.880800 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60167.3us
I20260709 13:07:05.882836 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2169) took 1038 ms. Trace:
W20260709 13:07:05.881857 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 53367.5us
I20260709 13:07:05.883693 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:05.883279 21222 rpcz_store.cc:276] 0709 13:07:04.844971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.845385 (+   414us) service_pool.cc:224] Handling call
0709 13:07:04.845706 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.887214 (+ 41508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.896324 (+  9110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.896390 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.896449 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.882589 (+986140us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400116054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:05.882648 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.882777 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94989696}
I20260709 13:07:05.882716 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2117) took 1047 ms. Trace:
I20260709 13:07:05.885058 21292 rpcz_store.cc:276] 0709 13:07:04.835341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.839747 (+1004406us) service_pool.cc:224] Handling call
0709 13:07:05.842056 (+  2309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.881409 (+ 39353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.881440 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.881481 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:05.881511 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.881576 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.882660 (+  1084us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64,"raft.queue_time_us":19416,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":4459,"thread_start_us":38918,"threads_started":1}
I20260709 13:07:05.877432 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2114) took 1091 ms. Trace:
I20260709 13:07:05.888211 23242 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.893843 21114 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:05.895577 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:05.895911 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.896631 21295 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:05.898969 22976 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.899451 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:05.901324 22976 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:05.901728 22976 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.902079 22976 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:05.903636 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.906445 23291 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.959s	user 0.002s	sys 0.000s
I20260709 13:07:05.909358 23170 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:05.909641 22976 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:05.910498 23170 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:05.913123 23299 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.807s	user 0.003s	sys 0.005s
W20260709 13:07:05.916452 23288 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.031s	user 0.002s	sys 0.000s
I20260709 13:07:05.920220 22976 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.902086 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:05.923996 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2166) took 1356 ms. Trace:
I20260709 13:07:05.924633 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:05.925690 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:05.924472 21225 rpcz_store.cc:276] 0709 13:07:04.567613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.745948 (+178335us) service_pool.cc:224] Handling call
0709 13:07:04.784027 (+ 38079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.784353 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.784385 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.802095 (+ 17710us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.007989 (+205894us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:05.018215 (+ 10226us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.228797 (+210582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.228871 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.912475 (+683604us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:05.923614 (+ 11139us) raft_consensus.cc:1685] finished
0709 13:07:05.923762 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.923932 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10569,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":25718,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":33950,"spinlock_wait_cycles":21755776,"thread_start_us":368662,"threads_started":2,"wal-append.queue_time_us":216881}
I20260709 13:07:05.927342 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 669) took 2612 ms. Trace:
I20260709 13:07:05.927824 21811 rpcz_store.cc:276] 0709 13:07:03.314525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.705538 (+391013us) service_pool.cc:224] Handling call
0709 13:07:03.705866 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.930752 (+224886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.930780 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.931197 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.523534 (+592337us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b1800212380. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:04.599516 (+ 75982us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.867656 (+268140us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.868235 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.868475 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.915734 (+1047259us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:05.927034 (+ 11300us) raft_consensus.cc:1685] finished
0709 13:07:05.927060 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.927230 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222030,"prepare.queue_time_us":390289,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":255338,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":9804,"spinlock_wait_cycles":39049216,"thread_start_us":220705,"threads_started":2,"wal-append.queue_time_us":893073}
I20260709 13:07:05.933984 23273 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:05.934518 23273 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:05.910950 23170 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:05.878175 22923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.621s	user 0.032s	sys 0.062s
W20260709 13:07:05.948211 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.944952 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 372) took 1121 ms. Trace:
I20260709 13:07:05.878129 23153 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:05.881333 23167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.006s
I20260709 13:07:05.948189 23170 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.943898 23175 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:05.949203 22923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.693s	user 0.032s	sys 0.063s
I20260709 13:07:05.958151 23255 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:05.955188 22980 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.953537 23153 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.009575 23197 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:05.879797 23257 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.011191 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.011986 21150 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:06.012574 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1299) took 1518 ms. Trace:
I20260709 13:07:06.013042 21150 rpcz_store.cc:276] 0709 13:07:04.494576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.497332 (+  2756us) service_pool.cc:224] Handling call
0709 13:07:06.011046 (+1513714us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:06.012506 (+  1460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426112}
W20260709 13:07:06.017824 23265 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.791s	user 0.000s	sys 0.011s
I20260709 13:07:06.021395 21143 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:05.951347 21298 rpcz_store.cc:276] 0709 13:07:04.823162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.834283 (+1011121us) service_pool.cc:224] Handling call
0709 13:07:05.850960 (+ 16677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.851230 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:05.865676 (+ 14446us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.944616 (+ 78940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.944668 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.944713 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.944779 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.944895 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14215,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2398,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4610,"thread_start_us":78594,"threads_started":1}
I20260709 13:07:06.033416 21298 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:06.003929 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 373) took 1139 ms. Trace:
I20260709 13:07:05.999395 23255 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:06.012388 23175 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.042296 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 116675us
I20260709 13:07:05.954126 23273 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.052613 23255 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.056069 23273 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.046319 21808 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.048561 21292 rpcz_store.cc:276] 0709 13:07:04.865054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.886266 (+1021212us) service_pool.cc:224] Handling call
0709 13:07:05.886562 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.886759 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:05.887038 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.003604 (+116566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.003653 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.003694 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.003758 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.003873 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19031,"prepare.queue_time_us":43320,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":20175,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":1415,"thread_start_us":97142,"threads_started":1}
I20260709 13:07:06.047657 22980 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:06.060603 22980 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.062703 22980 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:06.063374 23327 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:06.064440 23326 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.065004 23326 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.067759 21264 leader_election.cc:336] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.535s (SENT)
I20260709 13:07:06.068189 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.067101 23326 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.069792 23197 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.070604 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:06.070519 23326 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:06.071926 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:06.079906 23258 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.083832 23149 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:06.084256 23149 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:06.085142 23149 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.042924 23240 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:06.096321 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 66549.2us
I20260709 13:07:06.091872 21298 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:06.093225 21264 leader_election.cc:336] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.913s (SENT)
I20260709 13:07:06.101605 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 591) took 1587 ms. Trace:
W20260709 13:07:06.109272 23307 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.736s	user 0.000s	sys 0.009s
I20260709 13:07:05.887578 21299 rpcz_store.cc:276] 0709 13:07:04.786338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.746700 (+960362us) service_pool.cc:224] Handling call
0709 13:07:05.749425 (+  2725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.749572 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:05.752990 (+  3418us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.877058 (+124068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.877116 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:05.877162 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.877222 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.877378 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3964,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2775,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2268,"thread_start_us":121558,"threads_started":1}
I20260709 13:07:06.057852 23175 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.112159 23175 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.113379 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1563) took 1322 ms. Trace:
I20260709 13:07:06.113795 21151 rpcz_store.cc:276] 0709 13:07:04.790604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.793713 (+  3109us) service_pool.cc:224] Handling call
0709 13:07:04.806805 (+ 13092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.007371 (+200566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.007402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.012015 (+  4613us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.234916 (+222901us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:05.234954 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.095530 (+860576us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001ddb54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:06.095577 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.108747 (+ 13170us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:06.113194 (+  4447us) raft_consensus.cc:1685] finished
0709 13:07:06.113213 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.113324 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41393,"raft.queue_time_us":79999,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":341086336,"thread_start_us":190295,"threads_started":1,"wal-append.queue_time_us":300641}
I20260709 13:07:06.136117 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:06.136827 21299 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:06.137665 21222 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.144062 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.141738 21222 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:06.145218 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:06.145311 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:06.148898 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:06.147943 23175 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.149798 23175 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.152382 23175 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.102116 21808 rpcz_store.cc:276] 0709 13:07:04.514110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.523620 (+  9510us) service_pool.cc:224] Handling call
0709 13:07:06.045948 (+1522328us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:06.046137 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.095938 (+ 49801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.101546 (+  5608us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369280}
I20260709 13:07:06.158165 21293 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:06.143918 23170 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.149528 21222 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.160024 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.160826 21217 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.102234 23146 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.164839 21145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1300) took 1669 ms (client timeout 2170 ms). Trace:
W20260709 13:07:06.165256 21145 rpcz_store.cc:269] 0709 13:07:04.495923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.496038 (+   115us) service_pool.cc:224] Handling call
0709 13:07:05.390989 (+894951us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:06.159894 (+768905us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55e9c 00007f2b6ac55a5b 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:06.164771 (+  4877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80154752}
I20260709 13:07:06.165951 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.168175 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.168962 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:06.172020 23170 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:06.172863 21264 leader_election.cc:336] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.003s (SENT)
I20260709 13:07:06.173359 21264 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.174544 23197 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.179590 21811 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.180547 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.181234 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.181805 21224 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:06.185174 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.185179 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.187052 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.188530 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.189235 21150 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.189236 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.190603 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.178409 23153 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.186647 21151 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:06.195935 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.170712 21223 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.197934 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.199494 21150 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:06.197089 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:06.199757 21813 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
W20260709 13:07:06.203454 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.210017 21291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:07:06.223904 21291 raft_consensus.cc:606] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:06.196827 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.189779 23330 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.179426 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1700) took 1727 ms. Trace:
I20260709 13:07:06.229441 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.230477 21813 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:07:06.231325 21222 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:06.231675 21264 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.629s (SENT)
I20260709 13:07:06.232146 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.219031 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:06.224969 21805 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:06.227296 23255 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:06.234402 21300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 368) took 1691 ms (client timeout 1562 ms). Trace:
I20260709 13:07:06.234532 21225 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:06.234838 21300 rpcz_store.cc:269] 0709 13:07:04.542662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.561211 (+ 18549us) service_pool.cc:224] Handling call
0709 13:07:06.234210 (+1672999us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:06.234335 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439463296}
I20260709 13:07:06.235620 23255 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:06.235991 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2113) took 1454 ms. Trace:
I20260709 13:07:06.238869 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.236357 21296 rpcz_store.cc:276] 0709 13:07:04.781917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.744174 (+962257us) service_pool.cc:224] Handling call
0709 13:07:05.744490 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.832085 (+ 87595us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:05.849771 (+ 17686us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.153719 (+303948us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180035d940. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a 00007f2b6dd84a2a
0709 13:07:06.198813 (+ 45094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.198862 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:06.198900 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.235756 (+ 36856us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b5400327654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:06.235806 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.235936 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"prepare.queue_time_us":16965,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4458,"raft.queue_time_us":3477,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4540,"spinlock_wait_cycles":195076736,"thread_start_us":44844,"threads_started":1}
W20260709 13:07:06.246601 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.237555 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:06.258275 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.260284 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.260887 21813 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:06.261224 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.261783 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.262013 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.262357 21813 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:06.262620 21811 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.266027 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:06.267150 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.268360 21812 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:06.264715 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:06.270922 21300 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:06.263085 23326 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:07:06.272349 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.273005 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:06.274490 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:06.271771 21814 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:06.227694 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.202198 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:06.279481 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.244585 23224 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.275067 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.283653 22980 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:06.284070 21806 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:06.284202 22980 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.285763 21115 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.532s (SENT)
I20260709 13:07:06.286454 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.279050 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.287919 21291 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:06.290210 21811 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:06.268155 23229 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:06.293834 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48594.5us
I20260709 13:07:06.291467 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:06.292716 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:06.272140 23266 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:06.267517 23278 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:06.296532 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:06.230005 23175 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.300715 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:06.255218 23257 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:06.237434 23330 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.285909 23242 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.275183 23255 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:07:06.325625 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.339804 23255 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.340370 23255 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.342468 23255 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.342509 23149 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.233292 21293 rpcz_store.cc:276] 0709 13:07:04.451872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.456875 (+1005003us) service_pool.cc:224] Handling call
0709 13:07:05.466653 (+  9778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.160081 (+693428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.179364 (+ 19283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.327353 23251 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.329290 23266 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:06.344688 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.345355 23266 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:06.348707 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.350122 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.350677 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.327086 23146 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.344704 23251 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:06.351611 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.351944 23251 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.352326 21049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 252) took 4774 ms. Trace:
I20260709 13:07:06.357024 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.330289 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.298183 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.312646 23153 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.350353 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:06.336970 23296 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:06.361761 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.372764 21300 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.293437 22932 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:06.355706 21046 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.358440 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:06.293650 23229 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:06.303745 22976 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.352732 21049 rpcz_store.cc:276] 0709 13:07:01.583509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.589037 (+  5528us) service_pool.cc:224] Handling call
0709 13:07:06.352262 (+4763225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:03.928737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:03.939670 (+ 10933us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:03.939709 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:03.939721 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:03.969523 (+ 29802us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:03.969583 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:03.969616 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:03.970145 (+   529us) tablet.cc:701] Row locks acquired
0709 13:07:03.970161 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:03.970331 (+   170us) write_op.cc:270] Start()
0709 13:07:03.970462 (+   131us) write_op.cc:276] Timestamp: P: 1783602423970283 usec, L: 0
0709 13:07:03.970483 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:03.971138 (+   655us) log.cc:844] Serialized 2434 byte log entry
0709 13:07:04.449108 (+477970us) op_driver.cc:464] REPLICATION: finished
0709 13:07:04.831551 (+382443us) write_op.cc:301] APPLY: starting
0709 13:07:04.842959 (+ 11408us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:04.867007 (+ 24048us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:04.900320 (+ 33313us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:05.162456 (+262136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:05.162653 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:05.162697 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:05.162963 (+   266us) log.cc:844] Serialized 53 byte log entry
0709 13:07:05.163141 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.163244 (+   103us) write_op.cc:454] Released schema lock
0709 13:07:05.163322 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:05.163668 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.163697 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":322005,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":339493,"apply.run_cpu_time_us":4122,"apply.run_wall_time_us":352798,"num_ops":6,"prepare.queue_time_us":242573,"prepare.run_cpu_time_us":35759,"prepare.run_wall_time_us":189251,"raft.queue_time_us":114975,"raft.run_cpu_time_us":25145,"raft.run_wall_time_us":149343,"replication_time_us":468705,"thread_start_us":426882,"threads_started":4,"wal-append.queue_time_us":164725,"wal-append.run_cpu_time_us":29572,"wal-append.run_wall_time_us":2028042}]]}
I20260709 13:07:06.315117 21219 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.297360 23278 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:06.373342 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:06.398718 21291 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.376394 21805 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:06.285742 23270 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:07:06.377022 23241 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:06.377228 22923 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.368953 23247 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.374666 21294 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.362205 23255 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.385607 21300 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:06.387642 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:06.387180 21264 leader_election.cc:336] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.217s (SENT)
I20260709 13:07:06.384816 22932 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:06.439931 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:06.391634 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 95151.6us
I20260709 13:07:06.402861 23278 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.382625 21046 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.334682 23242 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:06.335230 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.368023 21809 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:06.454736 21046 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:06.405128 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 113750us
W20260709 13:07:06.412395 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 107925us
I20260709 13:07:06.414464 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1580) took 1098 ms. Trace:
I20260709 13:07:06.418661 21291 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:06.381454 23277 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.388872 23229 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.409320 23153 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.391652 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:06.482914 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.441476 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:06.362789 23224 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.403975 23197 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.443020 23353 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.454067 23242 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.460868 21143 rpcz_store.cc:276] 0709 13:07:05.315896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.316156 (+   260us) service_pool.cc:224] Handling call
0709 13:07:06.414199 (+1098043us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540017c354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:06.414342 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066259840}
I20260709 13:07:06.411926 23247 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:06.465405 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.589993 21811 raft_consensus.cc:2376] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3. Re-sending same reply.
I20260709 13:07:06.466048 21046 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.411917 23170 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:06.476045 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.368160 23240 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:07:06.439095 23255 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:06.444984 22932 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.413025 23326 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:06.510954 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.631904 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.435710 23300 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:07:06.581384 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.583110 23364 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.639083 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:06.584412 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 197248us
I20260709 13:07:06.639742 21142 raft_consensus.cc:1217] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[4.7-4.7]   Dedup: 4.7->[]
I20260709 13:07:06.640237 21142 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:07:06.640512 21264 leader_election.cc:336] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.754s (SENT)
I20260709 13:07:06.640949 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:06.641707 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 228677us
I20260709 13:07:06.642354 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.642887 21150 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.586000 23366 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.460616 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.648777 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.649344 21808 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:07:06.649541 21150 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:06.650265 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.650849 21808 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:07:06.485829 23224 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.607609 21294 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:06.651446 23224 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.651537 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.447472 23146 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:07:06.482733 23250 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.614348 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.652168 21145 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.652560 21813 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:06.652944 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.653357 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.504308 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.610001 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.657974 21811 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:06.504140 23277 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:06.579147 22980 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:06.621925 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 334536us
W20260709 13:07:06.623555 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 147626us
I20260709 13:07:06.661273 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:06.625423 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 184036us
W20260709 13:07:06.625732 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 162028us
I20260709 13:07:06.628400 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.628630 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.665378 21810 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:06.637017 21812 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.503279 23153 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.577030 23197 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.629863 23328 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.644901 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.666815 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.674023 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.677949 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.694696 21149 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:06.690229 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 278099us
I20260709 13:07:06.691128 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.695647 23255 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.587559 23353 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.698931 23277 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.699707 23358 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:07:06.709190 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.643043 23326 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:06.664090 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:06.647018 23251 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.722559 21149 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:06.622637 23170 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.676705 23175 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:06.733870 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.713068 23224 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.739050 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:06.753286 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.728286 23328 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.716671 22980 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.768369 21296 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.771834 21812 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:06.728066 23364 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.738583 21805 raft_consensus.cc:2410] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:06.797170 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.785313 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 98374us
I20260709 13:07:06.690950 23310 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:06.666047 23250 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.800590 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46824.8us
I20260709 13:07:06.811048 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:06.817086 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:06.817373 21776 connection.cc:256] RPC call timeout handler was delayed by -2.7617118179999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:07:06.817560 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 177071us
I20260709 13:07:06.798612 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:06.817934 21776 connection.cc:256] RPC call timeout handler was delayed by -2.7500118179999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:07:06.818260 21776 connection.cc:256] RPC call timeout handler was delayed by -2.6537118179999197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:07:06.821563 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:06.788026 23149 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.822414 21814 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:06.784205 23366 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:06.826222 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:06.812884 23345 log.cc:927] Time spent T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.650s	user 0.004s	sys 0.000s
W20260709 13:07:06.822767 21776 connection.cc:256] RPC call timeout handler was delayed by -2.5709118179998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:07:06.882884 21776 connection.cc:256] RPC call timeout handler was delayed by -2.5592118179998806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:07:06.883292 21776 connection.cc:256] RPC call timeout handler was delayed by -2.3855118179999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:07:06.883625 21776 connection.cc:256] RPC call timeout handler was delayed by -2.35401181799989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:07:06.883909 21776 connection.cc:256] RPC call timeout handler was delayed by -2.3513118179998855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:07:06.884202 21776 connection.cc:256] RPC call timeout handler was delayed by -2.3216118179999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:07:06.835080 21296 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:06.797854 23330 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:06.887773 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 224515us
W20260709 13:07:06.884235 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 153102us
I20260709 13:07:06.815294 23258 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.888928 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 227724us
I20260709 13:07:06.890568 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:06.816190 21809 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:06.826321 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:06.884531 21776 connection.cc:256] RPC call timeout handler was delayed by -2.2649118179999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:07:06.830366 23149 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.829528 23359 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:06.813190 23240 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:07:06.708110 23247 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.800806 23175 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:06.898396 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 164608us
W20260709 13:07:06.891750 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.903548 21776 connection.cc:256] RPC call timeout handler was delayed by -1.7618118179999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2641s for a response
W20260709 13:07:06.911420 21776 connection.cc:256] RPC call timeout handler was delayed by -1.5359118179999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2892s for a response
I20260709 13:07:06.912025 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.887291 21293 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.902741 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:06.900499 23355 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.916771 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.914429 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:06.921325 23328 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:06.921959 23328 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:06.923032 23328 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.913394 23239 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:06.939851 23251 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:06.897285 23258 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:06.941679 21223 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.002s
I20260709 13:07:06.913852 23376 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.906368 23340 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.905184 23377 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:06.937942 23375 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.936765 23366 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:06.946746 21145 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:06.908252 23149 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.959825 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 47877.3us
I20260709 13:07:06.960665 23359 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:06.962507 23273 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.001s
I20260709 13:07:06.927065 23364 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.982136 23326 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:06.926957 23351 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:06.965277 23378 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:06.983703 23375 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:06.981436 21776 leader_election.cc:400] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3.
I20260709 13:07:06.985502 21220 raft_consensus.cc:2410] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:06.968182 21223 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:06.975209 23153 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:06.980943 23197 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.024140 21776 leader_election.cc:400] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:06.963127 23355 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.032315 23258 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:07.033156 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 116391us
I20260709 13:07:07.029667 23224 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.036809 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.040944 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.978550 23373 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:07:07.027608 23367 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:07:06.988790 23375 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:06.965397 23385 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:07.042419 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.043468 23365 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.049489 23229 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.026503 23351 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:07.065919 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.053028 23378 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:07.050912 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 213735us
I20260709 13:07:07.077893 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:06.980479 23376 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.076074 21217 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:07.066643 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 268083us
I20260709 13:07:07.088732 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.109444 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.073962 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.104679 21224 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.111346 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.112681 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.113270 21812 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:07.114069 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.114645 21810 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:07.115574 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.116236 21811 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.116915 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.118124 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.118693 21811 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.119879 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.120579 21812 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.121500 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.122316 21810 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.123351 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.124239 21810 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:07.129442 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.039027 23242 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.144971 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.130636 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.148242 21226 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:07.107674 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.087575 23167 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.132982 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.169874 21807 raft_consensus.cc:2376] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3. Re-sending same reply.
I20260709 13:07:07.076978 23153 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.133329 23365 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.072062 23374 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.133939 21293 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:07.134307 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.134891 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.137969 23355 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:07.139294 23375 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.143481 23353 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.218185 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.219666 21812 raft_consensus.cc:2410] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:07.146685 23170 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:07.162164 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.165735 21813 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.166155 21814 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:07.171030 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.133172 23326 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.109359 23354 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.190227 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.131832 23251 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.205400 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:07.210386 21221 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.226263 23393 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:07:07.213210 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 324632us
I20260709 13:07:07.229619 23326 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.252200 23326 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.238920 23351 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.143131 23149 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.253947 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.255296 23149 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.240170 21809 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:07.255976 21809 pending_rounds.cc:85] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 4
I20260709 13:07:07.245968 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.258525 21264 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:07.127940 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.260460 21810 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:07.225486 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 336493us
W20260709 13:07:07.226912 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.227676 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.263772 21813 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.263815 21300 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:07.263998 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:07.264714 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.266157 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.266973 21813 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:07.267534 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 77403.7us
I20260709 13:07:07.268716 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.268981 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.270054 21810 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:07.270823 21295 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:07.266637 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:07.229746 23380 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:07:07.229382 21807 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:07.089221 23359 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.248353 23241 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.209168 23224 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:07.205811 23153 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.214166 21218 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:07.230262 21223 raft_consensus.cc:1217] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Deduplicated request from leader. Original: 3.6->[4.7-4.7]   Dedup: 4.7->[]
I20260709 13:07:07.249861 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.159680 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.226490 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.305084 21812 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:07.278548 21226 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:07.278512 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.233922 21811 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:07.306764 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.238073 21808 raft_consensus.cc:2368] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:07.256256 21809 pending_rounds.cc:107] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:07.267814 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:07.280238 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 55796.1us
W20260709 13:07:07.309127 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 59346.3us
I20260709 13:07:07.286357 23354 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:07.247787 22932 consensus_meta.cc:287] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 13:07:07.252190 23071 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.243739 23247 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.228154 23229 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:07.249274 23393 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.327221 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.246229 23377 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:07.267165 23278 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.000s
I20260709 13:07:07.256268 23376 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:07.199851 23386 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:07.255172 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.270954 23353 raft_consensus.cc:2764] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:07.271142 23364 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.238346 23242 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.276834 23366 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.302870 21810 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:07.276703 23197 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.270576 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.312845 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:07.288324 23241 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:07.318987 21225 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:07.322515 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.323897 23354 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.365307 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.365830 23354 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.325273 23153 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.316130 21223 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:07:07.367213 23399 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:07.328182 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:07.343461 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.324513 23167 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.369477 23167 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.370119 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.370191 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.279527 23388 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:07:07.371521 23167 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:07.371833 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.371523 21813 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.372550 21812 raft_consensus.cc:2393] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.362385 23366 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.373025 23366 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.316805 23251 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.358343 21299 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.320660 22932 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.375546 23250 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:07.289220 23360 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:07.316459 23071 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:07.363273 21292 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:07.347493 23377 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.345162 23392 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:07.364138 23386 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.328125 23355 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:07.364714 23197 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.347765 23278 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.309273 23395 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:07:07.354015 21217 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:07.380072 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.406606 21810 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.327525 23393 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:07.381832 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.355496 23376 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.411206 23393 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.412498 23393 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:07.412946 23387 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.378s	user 0.000s	sys 0.003s
I20260709 13:07:07.414476 23326 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.389518 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.414964 23326 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.415987 21294 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:07.354897 23229 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.417111 23326 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:07.417526 23229 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.373042 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.314042 21809 raft_consensus.cc:2889] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.406922 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.355387 23389 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:07.425534 21217 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:07.426604 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.427438 21217 raft_consensus.cc:2368] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4.
W20260709 13:07:07.407807 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 129418us
I20260709 13:07:07.409106 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.429293 21813 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.428185 21807 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.405710 23250 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.430198 23250 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.409667 21299 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:07.409747 22976 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:07.390700 23386 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:07.411005 23071 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.384509 23364 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.414956 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2195) took 1030 ms. Trace:
I20260709 13:07:07.389325 23377 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.431032 23250 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.431717 21810 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:07.550067 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.551129 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:07.538323 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.551599 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.471398 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:07.464587 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:07.552999 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 81697.8us
I20260709 13:07:07.552306 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.553467 21217 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:07.554029 21810 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:07.553988 21221 rpcz_store.cc:276] 0709 13:07:06.384713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.384862 (+   149us) service_pool.cc:224] Handling call
0709 13:07:06.387694 (+  2832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.246433 (+858739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.414724 (+168291us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:07.414881 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891656064}
W20260709 13:07:07.489221 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 218715us
I20260709 13:07:07.555717 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.466862 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.437256 21813 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:07.550122 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 234200us
I20260709 13:07:07.559072 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:07.553607 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 89147.6us
I20260709 13:07:07.562178 21221 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:07.555682 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:07.568010 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:07.569572 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:07.570138 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:07.570845 21143 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:07.571091 21150 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.571378 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:07.571931 21142 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.572149 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:07.470752 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.584057 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.566251 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:07.585649 21221 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:07.586182 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.587965 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:07.439404 23296 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:07.528647 23269 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.561065 23389 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.494112 23362 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.560909 23326 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.603961 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.574198 23406 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.604735 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.605611 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:07.573941 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:07.565905 23395 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.527446 23360 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.611974 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.612826 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:07.565119 23405 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.584870 23251 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.588886 23239 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:07.658380 21221 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:07.610982 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:07.589905 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.591136 23365 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.599457 23197 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.560899 22976 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:07.659286 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 48539.3us
I20260709 13:07:07.589483 23167 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.605275 23354 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:07.585067 23153 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:07:07.600960 23187 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:07:07.609690 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:07.616254 23404 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:07:07.664592 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51811.3us
I20260709 13:07:07.692817 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.693359 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.589202 23296 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:07.661182 21806 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:07.617308 23328 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.614842 23395 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.618337 23278 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:07.656857 23389 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.688740 21221 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:07.694123 21812 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:07.693594 23354 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.667240 21809 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.725899 21807 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:07.668370 23071 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.666687 23353 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.705375 21776 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.727809 21190 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:07.744623 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.616333 23378 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:07:07.745775 23352 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.667210 23197 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.663450 23410 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.608114 23269 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.616745 23326 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.686895 23365 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.712427 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.703055 23224 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.709748 23395 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.713024 23405 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.663559 23360 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.677357 23229 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:07.614666 23362 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.701308 23258 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.718844 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:07.772248 21812 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.696663 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:07.709103 23328 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.749522 23408 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.709698 23394 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.658946 23386 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.745791 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:07.746369 23378 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:07.761111 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 194422us
I20260709 13:07:07.764535 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.782156 21217 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:07.749553 23167 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:07.748632 23351 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.748483 23197 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.720528 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:07.789073 21221 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:07.785774 21217 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:07.746402 23352 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:07.875295 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.718327 23389 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.889835 21813 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:07.776000 23328 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.785516 23167 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.775754 23341 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.910753 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:07.897814 23384 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.765938 23224 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.777675 23394 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:07.894060 23386 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.913087 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:07.939925 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.920755 21146 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:07.923674 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.925788 21142 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:07.927543 23362 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:07.927814 23384 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:07.953181 23384 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.921423 23247 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:07.930817 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.956511 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.957489 21300 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:07.899446 23153 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.770162 23377 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.932004 21291 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:07.932412 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:07.932744 21295 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.751072 23296 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:07.973822 23415 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:07:07.751015 23354 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.874027 23376 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.874830 23353 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.935931 21264 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:07.904127 21812 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:07.936791 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:07.985558 21035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48818us
I20260709 13:07:07.941601 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:07.898139 23410 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:07.915817 23403 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 13:07:07.933544 23278 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:07.931422 23382 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.961380 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:07.905339 23351 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:07.968430 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:07.972937 23412 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:07.958055 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.947185 23341 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:07.996896 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 61052.5us
I20260709 13:07:07.976205 23153 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.777746 23405 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:07.978973 23296 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.003839 23330 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.013895 23392 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:07.987083 23247 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:07.997413 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 55890.1us
I20260709 13:07:07.927572 23167 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.992014 23270 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:08.053287 23330 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:08.015269 23394 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:07.899638 23365 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:08.063553 23419 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:07:08.065433 23377 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.066385 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:07.996248 23353 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.068251 22932 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.072567 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:07.992655 23376 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:08.023957 23366 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.001s
I20260709 13:07:08.072739 23389 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.010743 23382 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:08.668056 23153 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:08.668358 23394 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.557977 21221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.041s	sys 0.076s
W20260709 13:07:08.310003 21117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.115s	sys 0.284s
W20260709 13:07:08.670614 21117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.186s	sys 0.457s
W20260709 13:07:08.434007 21776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.082s	sys 0.099s
W20260709 13:07:08.253996 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.671509 21776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.095s	sys 0.109s
W20260709 13:07:08.672065 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.023794 21294 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:08.094033 21298 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:08.632975 21115 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.024s	sys 0.052s
I20260709 13:07:08.673870 23170 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.189822 22923 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.674387 23167 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:08.402544 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.676900 23353 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.601565 21218 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:08.428504 23341 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:08.679718 21221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.045s	sys 0.084s
W20260709 13:07:08.686858 21115 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.025s	sys 0.052s
W20260709 13:07:08.688308 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.667538 23422 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:07:08.460176 23247 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:08.057037 23392 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:08.697330 21809 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.974s	user 0.003s	sys 0.008s
I20260709 13:07:08.054921 23427 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:08.670259 23393 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.257s	user 0.012s	sys 0.000s
W20260709 13:07:08.247007 23416 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:07:08.671154 23330 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.702059 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 793814us
I20260709 13:07:08.309669 23406 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.699994 23377 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:08.093277 23269 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:08.728802 23269 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:08.710582 23355 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.730479 23269 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.730886 23393 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.718843 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 678) took 1607 ms. Trace:
I20260709 13:07:08.731453 23393 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:08.721079 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 282) took 1646 ms. Trace:
I20260709 13:07:08.732358 21225 rpcz_store.cc:276] 0709 13:07:07.074767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.074857 (+    90us) service_pool.cc:224] Handling call
0709 13:07:07.108606 (+ 33749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.362782 (+254176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.720852 (+1358070us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540039b7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:08.721029 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477620096}
I20260709 13:07:08.732932 23269 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.723171 21292 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:08.689790 23326 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:08.224979 23266 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:08.733570 23393 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:08.734153 23393 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:08.733991 23266 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.688760 23170 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:08.727684 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:08.142861 23270 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:07:08.706990 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.742345 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:08.744014 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:08.744736 21150 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:08.748123 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:08.748389 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:08.748706 21151 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:08.729955 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.730557 23355 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.705823 23300 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.232298 23351 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.734735 23393 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.729311 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1280) took 1164 ms. Trace:
I20260709 13:07:08.720793 23360 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:08.705101 23353 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.737668 21300 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:08.024641 23410 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:08.694509 23366 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.754348 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:08.721258 21809 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:08.995450 23366 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:08.995718 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 767) took 1575 ms. Trace:
W20260709 13:07:08.995846 23071 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.252s	user 0.010s	sys 0.000s
I20260709 13:07:08.996181 23366 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.838860 21150 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:08.729648 23427 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:08.694582 22923 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:08.977892 21223 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.979568 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1730) took 1051 ms. Trace:
I20260709 13:07:09.013242 21292 rpcz_store.cc:276] 0709 13:07:07.927787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.936117 (+  8330us) service_pool.cc:224] Handling call
0709 13:07:08.072407 (+136290us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:08.979371 (+906964us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54003af554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:08.979513 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96591104}
I20260709 13:07:08.985500 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:09.014552 21812 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.987010 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1733) took 1058 ms. Trace:
I20260709 13:07:09.016177 21300 rpcz_store.cc:276] 0709 13:07:07.928777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.970417 (+ 41640us) service_pool.cc:224] Handling call
0709 13:07:08.727523 (+757106us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:08.986931 (+259408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16509184}
I20260709 13:07:09.017354 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:09.018038 21300 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:08.952113 23197 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.047s	user 0.010s	sys 0.000s
I20260709 13:07:08.994032 23170 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.997377 21151 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:08.998781 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.004457 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:08.735472 23377 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.033242 23197 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.039750 23427 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.041536 23197 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.043560 21297 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.999852 23353 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:08.731624 21805 rpcz_store.cc:276] 0709 13:07:07.110726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.131235 (+ 20509us) service_pool.cc:224] Handling call
0709 13:07:08.717431 (+1586196us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:08.717781 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.718087 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.718116 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.718183 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.718233 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.718299 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.718419 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7120128}
I20260709 13:07:09.023092 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.033787 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:09.048835 21292 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:09.051914 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.052946 21151 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:09.005609 23384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.019s	sys 0.066s
I20260709 13:07:08.996660 23366 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.087798 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:08.996099 21809 rpcz_store.cc:276] 0709 13:07:07.420131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.556817 (+136686us) service_pool.cc:224] Handling call
0709 13:07:08.995656 (+1438839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.729419 23406 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:08.995450 23410 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:08.997354 23382 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:09.107306 21220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2182) took 2965 ms (client timeout 2111 ms). Trace:
I20260709 13:07:08.957334 21218 rpcz_store.cc:276] 0709 13:07:07.565968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.600910 (+1034942us) service_pool.cc:224] Handling call
0709 13:07:08.601305 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.704650 (+103345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.727425 (+ 22775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.050839 21147 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:09.044572 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:08.997722 23405 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:09.087162 23384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.019s	sys 0.072s
I20260709 13:07:09.062433 21807 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:07:09.109735 21220 rpcz_store.cc:269] 0709 13:07:06.141810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.145099 (+  3289us) service_pool.cc:224] Handling call
0709 13:07:09.099458 (+2954359us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540038b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.107195 (+  7737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927268224}
I20260709 13:07:09.118237 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.129509 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:09.087247 23170 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.087927 21148 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:09.119367 21300 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:09.121374 23376 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.126253 21812 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:08.992045 23300 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.091511 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2204) took 1153 ms. Trace:
W20260709 13:07:09.132615 21224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 285) took 2042 ms (client timeout 2050 ms). Trace:
W20260709 13:07:09.136039 21224 rpcz_store.cc:269] 0709 13:07:07.090118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.112136 (+ 22018us) service_pool.cc:224] Handling call
0709 13:07:09.129368 (+2017232us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:09.132562 (+  3194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39004416}
I20260709 13:07:09.059626 23197 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:09.143281 23384 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:09.143499 21296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2128) took 2776 ms (client timeout 3175 ms). Trace:
I20260709 13:07:09.144037 23384 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:09.144126 21296 rpcz_store.cc:269] 0709 13:07:06.364652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.387360 (+ 22708us) service_pool.cc:224] Handling call
0709 13:07:09.140863 (+2753503us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540029e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.141002 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755902848}
I20260709 13:07:09.146668 23353 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.148795 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1732) took 1220 ms. Trace:
I20260709 13:07:09.149338 21293 rpcz_store.cc:276] 0709 13:07:07.928426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.934085 (+  5659us) service_pool.cc:224] Handling call
0709 13:07:07.980224 (+ 46139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.996467 (+1016243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.996498 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.996542 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:08.996578 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.148483 (+151905us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000c5b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:09.148559 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.148719 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328591616}
I20260709 13:07:09.151455 21806 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:09.154930 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1315) took 1584 ms (client timeout 1979 ms). Trace:
W20260709 13:07:09.155476 21146 rpcz_store.cc:269] 0709 13:07:07.570421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.570659 (+   238us) service_pool.cc:224] Handling call
0709 13:07:09.154728 (+1584069us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000852d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.154857 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364973824}
I20260709 13:07:09.156894 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:09.158521 23386 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.209s	user 0.002s	sys 0.005s
I20260709 13:07:09.160389 23393 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.131484 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:09.163407 21805 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:09.163937 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 755) took 1793 ms. Trace:
I20260709 13:07:09.164299 21811 rpcz_store.cc:276] 0709 13:07:07.370047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.371590 (+  1543us) service_pool.cc:224] Handling call
0709 13:07:07.371938 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.418746 (+ 46808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.418775 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.419155 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.613230 (+194075us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.779446 (+166216us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.874318 (+ 94872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.163612 (+1289294us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b54003c3554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:09.163655 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.163698 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:09.163788 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.163891 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98542,"prepare.queue_time_us":108874,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":118135,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":8615,"spinlock_wait_cycles":106859520,"thread_start_us":251950,"threads_started":2,"wal-append.queue_time_us":341435}
I20260709 13:07:09.165709 21805 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:09.166404 21811 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.171546 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:09.172200 21809 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:09.138196 21223 rpcz_store.cc:276] 0709 13:07:07.909185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.977369 (+1068184us) service_pool.cc:224] Handling call
0709 13:07:08.977699 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.035071 (+ 57372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.062561 (+ 27490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.176950 21146 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:09.171066 23421 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.202s	user 0.011s	sys 0.032s
I20260709 13:07:09.123176 23406 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:09.183931 23394 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 13:07:09.185803 23330 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.130650 22923 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.132989 21808 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:09.192862 21265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.019s	sys 0.079s
W20260709 13:07:09.212514 21265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.019s	sys 0.081s
I20260709 13:07:09.138396 23376 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:09.215704 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.176307 23266 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:09.234746 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.007s	sys 0.017s
W20260709 13:07:09.235209 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.537s	user 0.007s	sys 0.017s
I20260709 13:07:09.242892 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:09.257087 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.258037 21222 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 1.
W20260709 13:07:09.258704 21222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 290) took 2089 ms (client timeout 1583 ms). Trace:
W20260709 13:07:09.259207 21222 rpcz_store.cc:269] 0709 13:07:07.169213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.207920 (+ 38707us) service_pool.cc:224] Handling call
0709 13:07:09.256866 (+2048946us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:09.258599 (+  1733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7858560}
I20260709 13:07:09.219566 22923 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.219126 23406 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:09.226501 23393 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.289562 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.229452 23429 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.176560 23392 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.234948 21294 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.182976 23197 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.259886 23355 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.308141 23377 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.219739 23376 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.309763 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 764) took 1913 ms. Trace:
I20260709 13:07:09.327243 21810 rpcz_store.cc:276] 0709 13:07:07.396226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.555700 (+159474us) service_pool.cc:224] Handling call
0709 13:07:07.555977 (+   277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:07.570940 (+ 14963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.570969 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:07.587191 (+ 16222us) log.cc:844] Serialized 52 byte log entry
0709 13:07:07.727702 (+140511us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.727742 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.727808 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.170447 (+1442639us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:09.295311 (+124864us) raft_consensus.cc:1685] finished
0709 13:07:09.295337 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.309691 (+ 14354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12879,"raft.queue_time_us":13042,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":23638,"spinlock_wait_cycles":13773056,"thread_start_us":69877,"threads_started":1,"wal-append.queue_time_us":265687}
W20260709 13:07:09.328601 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:09.283118 23356 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.294472 21151 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:09.340346 23403 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.013s	sys 0.014s
W20260709 13:07:09.340811 23403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.013s	sys 0.014s
I20260709 13:07:09.341665 23377 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.348781 23376 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.350219 22976 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.350843 23197 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.308530 23435 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 13:07:09.351979 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.312033 23366 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:09.350409 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.311084 23300 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.353755 23149 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.320019 23270 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.326323 23384 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.390039 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:09.393363 23167 consensus_meta.cc:287] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.001s
I20260709 13:07:09.393600 21223 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:09.381549 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.382948 23330 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.385757 23428 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.386050 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:09.399324 21219 raft_consensus.cc:2368] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:09.399520 21142 raft_consensus.cc:606] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:09.399915 21142 raft_consensus.cc:614] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:09.387172 23395 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.617s	user 0.005s	sys 0.006s
I20260709 13:07:09.400871 23395 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.316115 23393 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.404942 23393 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.405364 23356 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:09.403126 23395 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.406041 23356 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.407750 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.408639 23356 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:09.411202 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.400871 21150 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:09.347076 23377 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:09.412875 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1728) took 1486 ms (client timeout 1744 ms). Trace:
I20260709 13:07:09.413517 23377 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.316080 23406 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:09.390316 23149 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.415578 23406 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.317019 23429 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.415864 23149 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.416340 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.417573 23429 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.417645 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:09.387283 23392 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.418393 23359 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:09.384544 23375 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.398012 21144 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.398825 23428 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:09.399868 21219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 278) took 2326 ms (client timeout 1689 ms). Trace:
W20260709 13:07:09.419317 21219 rpcz_store.cc:269] 0709 13:07:07.073376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.076804 (+  3428us) service_pool.cc:224] Handling call
0709 13:07:09.385852 (+2309048us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:09.399770 (+ 13918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24221056}
W20260709 13:07:09.413314 21298 rpcz_store.cc:269] 0709 13:07:07.926968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.934557 (+  7589us) service_pool.cc:224] Handling call
0709 13:07:09.412701 (+1478144us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b540022ddd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.412817 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196103424}
I20260709 13:07:09.420571 23428 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:09.388625 23296 consensus_meta.cc:287] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.333s	user 0.009s	sys 0.000s
I20260709 13:07:09.418831 23359 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:09.391974 23170 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:09.390029 23328 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.464s	user 0.011s	sys 0.000s
I20260709 13:07:09.418720 21223 raft_consensus.cc:2410] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:09.428416 21814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 679) took 2317 ms (client timeout 2170 ms). Trace:
I20260709 13:07:09.429046 23241 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:09.432109 21814 rpcz_store.cc:269] 0709 13:07:07.110990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.111099 (+   109us) service_pool.cc:224] Handling call
0709 13:07:09.428177 (+2317078us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54006bbf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.428318 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124583296}
I20260709 13:07:09.432505 23435 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.433185 23241 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.429423 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:09.441121 21291 raft_consensus.cc:2410] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:09.417457 23255 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.434391 23328 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.442178 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 634) took 1744 ms. Trace:
I20260709 13:07:09.442687 21806 rpcz_store.cc:276] 0709 13:07:07.697334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.875388 (+178054us) service_pool.cc:224] Handling call
0709 13:07:07.938517 (+ 63129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.152006 (+1213489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.440964 (+288958us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400700154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:09.442110 (+  1146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748945280}
I20260709 13:07:09.444684 23328 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.448897 23250 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.442212 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1735) took 1512 ms. Trace:
I20260709 13:07:09.450142 21291 rpcz_store.cc:276] 0709 13:07:07.929395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.969640 (+ 40245us) service_pool.cc:224] Handling call
0709 13:07:09.429279 (+1459639us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:09.442141 (+ 12862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11148672}
I20260709 13:07:09.449707 23356 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:09.471763 23379 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.480618 23379 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.471817 23224 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.486045 23379 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.534518 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:09.434304 21189 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:09.538086 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:09.539706 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 105362us
I20260709 13:07:09.539899 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.543573 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.543645 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.545544 21189 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:09.546459 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.553005 21149 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:09.561565 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.565138 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.565688 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:09.574792 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.575847 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.576576 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.576979 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.576857 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.583380 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.584568 21222 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:09.603909 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a837dff96224f8b8795bace63448d84"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:09.605494 21142 raft_consensus.cc:606] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:09.606555 21142 raft_consensus.cc:614] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:09.611104 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 69885.9us
I20260709 13:07:09.632589 21226 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:09.421339 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 632) took 1724 ms. Trace:
W20260709 13:07:09.439136 21813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 630) took 1743 ms (client timeout 1508 ms). Trace:
I20260709 13:07:09.434304 23170 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.433035 23435 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:09.437902 23270 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.433960 23352 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:09.436885 23359 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.758128 23352 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.758698 23352 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.680394 23241 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:09.672891 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 289) took 2504 ms (client timeout 2030 ms). Trace:
I20260709 13:07:09.759205 23352 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.759788 23359 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:09.759568 21226 rpcz_store.cc:269] 0709 13:07:07.168841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.307832 (+138991us) service_pool.cc:224] Handling call
0709 13:07:09.671951 (+2364119us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540038de54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.672767 (+   816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5109251328}
W20260709 13:07:09.693359 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 127900us
W20260709 13:07:09.762615 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.749717 23328 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.759486 23241 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.750516 23379 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:09.763747 23241 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.763585 23382 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.767187 21222 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:09.763823 23328 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.767889 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:09.688140 21813 rpcz_store.cc:269] 0709 13:07:07.696202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.696342 (+   140us) service_pool.cc:224] Handling call
0709 13:07:09.438951 (+1742609us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54005c5b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.439062 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267911552}
I20260709 13:07:09.732023 21807 rpcz_store.cc:276] 0709 13:07:07.696800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.726810 (+ 30010us) service_pool.cc:224] Handling call
0709 13:07:09.003642 (+1276832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.131960 (+128318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.421140 (+289180us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540035aa50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:09.421277 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2920147712}
I20260709 13:07:09.767382 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:09.776746 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.777784 21142 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:09.748915 23149 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:09.748320 23242 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.792912 21219 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:09.789467 21264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.004s	sys 0.023s
W20260709 13:07:09.800294 21264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.004s	sys 0.023s
I20260709 13:07:09.798614 23149 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:09.843549 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:09.799191 23270 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:09.850142 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.018s	sys 0.040s
I20260709 13:07:09.840591 23242 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:09.867398 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.019s	sys 0.040s
I20260709 13:07:09.874763 21142 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:09.878576 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.019s	sys 0.038s
W20260709 13:07:09.887923 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.013s	sys 0.019s
W20260709 13:07:09.888128 23365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.008s	sys 0.028s
W20260709 13:07:09.888525 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.014s	sys 0.019s
W20260709 13:07:09.890877 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.020s	sys 0.038s
I20260709 13:07:09.871090 23328 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.888043 23436 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.898829 23224 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:09.899326 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.014s	sys 0.022s
I20260709 13:07:09.899794 23375 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.899942 21116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.019s	sys 0.043s
W20260709 13:07:09.900262 23427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.021s	sys 0.027s
W20260709 13:07:09.902089 21776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.153s	user 0.017s	sys 0.021s
W20260709 13:07:09.903098 21296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.011s	sys 0.025s
W20260709 13:07:09.903481 21295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.021s	sys 0.035s
W20260709 13:07:09.903817 21217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.753s	user 0.007s	sys 0.028s
I20260709 13:07:09.904119 23170 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:09.904564 23247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.021s	sys 0.016s
W20260709 13:07:09.891425 21299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.011s	sys 0.042s
W20260709 13:07:09.888489 23071 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.025s	sys 0.045s
I20260709 13:07:09.870507 23273 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.893733 23365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.009s	sys 0.028s
W20260709 13:07:09.918951 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.015s	sys 0.022s
W20260709 13:07:09.921964 21776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.017s	sys 0.022s
W20260709 13:07:09.919464 21116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.020s	sys 0.043s
W20260709 13:07:09.915863 21221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.000s	sys 0.085s
W20260709 13:07:09.928509 21296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.013s	sys 0.025s
W20260709 13:07:09.914124 21225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.021s	sys 0.015s
W20260709 13:07:09.893867 23354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.827s	user 0.064s	sys 0.090s
W20260709 13:07:09.924327 23071 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.026s	sys 0.045s
W20260709 13:07:09.929771 21295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.022s	sys 0.035s
W20260709 13:07:09.930174 21217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.844s	user 0.008s	sys 0.028s
I20260709 13:07:09.931406 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:09.921711 23427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.021s	sys 0.027s
I20260709 13:07:09.928840 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:09.945703 21225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.022s	sys 0.016s
W20260709 13:07:09.930449 23247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.021s	sys 0.017s
W20260709 13:07:09.933851 21299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.011s	sys 0.043s
W20260709 13:07:09.941377 21221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.001s	sys 0.085s
W20260709 13:07:09.941684 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.20618e+06us
I20260709 13:07:09.949010 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:09.972131 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 76087.4us
W20260709 13:07:09.973085 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.956240 23372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.011s	sys 0.015s
W20260709 13:07:09.981300 23372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.011s	sys 0.015s
W20260709 13:07:09.983167 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.945082 23354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.930s	user 0.066s	sys 0.090s
I20260709 13:07:09.989454 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.005070 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:10.006335 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:10.022255 21115 connection.cc:256] RPC call timeout handler was delayed by -1.1877483099999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:07:10.009600 21809 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.019603 23379 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.074574 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:10.042797 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2200) took 2670 ms. Trace:
I20260709 13:07:10.010339 23270 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.004345 21807 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:10.001938 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.971832 23341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.018s
I20260709 13:07:10.032095 23149 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.024055 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:10.050824 23439 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.041416 23453 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.043344 23258 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:10.012395 23242 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.005674 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:10.072570 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2143) took 1320 ms. Trace:
I20260709 13:07:10.000371 21143 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:10.039531 23458 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.011655 21142 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:10.007783 21811 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:09.999104 23465 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.951472 23273 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.024127 23247 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.001670 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:10.036098 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1279) took 2473 ms. Trace:
W20260709 13:07:10.074548 21116 connection.cc:256] RPC call timeout handler was delayed by -1.2503169220000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3175s for a response
I20260709 13:07:10.080003 21294 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:10.082728 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:10.107640 23341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.012s	sys 0.020s
I20260709 13:07:09.913076 23436 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.140574 23436 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.141299 23436 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:10.141875 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1317) took 2203 ms. Trace:
I20260709 13:07:10.002844 23435 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.054744 23444 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:10.143014 23444 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.145563 23444 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:09.918514 23375 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.004559 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.147648 21814 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.148523 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.149959 23375 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.150102 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:10.053972 23449 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.151338 23449 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.151341 21223 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:10.152458 23270 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.154331 23449 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:09.932453 23224 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:10.155802 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 81475.4us
I20260709 13:07:10.156309 23465 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.156749 23224 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.041689 23440 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.097920 21221 rpcz_store.cc:276] 0709 13:07:07.372410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.890616 (+518206us) service_pool.cc:224] Handling call
0709 13:07:07.890931 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.891141 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:08.702085 (+810944us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.042182 (+1340097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.042297 (+   115us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:10.042412 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.042548 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.042712 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37335,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":115,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":240,"thread_start_us":2033941,"threads_started":2,"wal-append.queue_time_us":1337103}
I20260709 13:07:10.157776 23440 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.160593 23440 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:09.975338 21145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.032s	sys 0.035s
W20260709 13:07:10.162226 21145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.033s	sys 0.036s
W20260709 13:07:10.162401 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.971433 21812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.004s	sys 0.025s
W20260709 13:07:10.163125 21812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.005s	sys 0.025s
I20260709 13:07:10.164222 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 773) took 1179 ms. Trace:
I20260709 13:07:10.164556 21812 rpcz_store.cc:276] 0709 13:07:08.984429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.133867 (+149438us) service_pool.cc:224] Handling call
0709 13:07:09.134278 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.139074 (+  4796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.139108 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.139817 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.163793 (+1023976us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:10.163885 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.163980 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.164016 (+    36us) raft_consensus.cc:1685] finished
0709 13:07:10.164026 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.164160 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4248,"raft.queue_time_us":190466,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12869,"thread_start_us":1015728,"threads_started":1,"wal-append.queue_time_us":889752}
I20260709 13:07:10.097292 21813 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.007609 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.099849 21810 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.030843 23352 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:10.106336 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.098907 23379 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:10.116999 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 93105.7us
I20260709 13:07:10.081744 21300 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:10.122956 21217 rpcz_store.cc:276] 0709 13:07:07.562450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.008072 (+445622us) service_pool.cc:224] Handling call
0709 13:07:08.020006 (+ 11934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.020408 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.020461 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.022308 (+  1847us) log.cc:844] Serialized 494 byte log entry
0709 13:07:09.998408 (+1976100us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b18003e4dc0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1
0709 13:07:09.998677 (+   269us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.998735 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.021104 (+ 22369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.028108 (+  7004us) raft_consensus.cc:1685] finished
0709 13:07:10.028131 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.035985 (+  7854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22951296,"thread_start_us":1860472,"threads_started":1,"wal-append.queue_time_us":1896435}
W20260709 13:07:10.125976 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.120160 23453 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.125882 23258 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.129060 23439 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.126608 21298 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:10.133466 23273 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.134115 23247 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:10.135371 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 162375us
I20260709 13:07:10.136751 23242 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:10.126547 23458 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:09.988915 21147 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:10.146166 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.151782 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.076570 21293 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:10.037191 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 299) took 2341 ms. Trace:
W20260709 13:07:10.070411 21777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.009s	sys 0.020s
I20260709 13:07:10.118974 21295 rpcz_store.cc:276] 0709 13:07:08.752372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.752490 (+   118us) service_pool.cc:224] Handling call
0709 13:07:08.752852 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.753230 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.753265 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.947006 (+193741us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.984381 (+1037375us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:09.984478 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.984618 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.072175 (+ 87557us) raft_consensus.cc:1685] finished
0709 13:07:10.072214 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.072443 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289087,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"thread_start_us":942993,"threads_started":1,"wal-append.queue_time_us":1095302}
I20260709 13:07:10.142459 21143 rpcz_store.cc:276] 0709 13:07:07.938252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.938413 (+   161us) service_pool.cc:224] Handling call
0709 13:07:07.938683 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.139382 (+2200699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.141546 (+  2164us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001f7a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:10.141780 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4740516736}
W20260709 13:07:10.106228 23351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.010s	sys 0.009s
W20260709 13:07:10.173080 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.180310 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.180836 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.213642 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.207230 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:10.207710 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.225075 21226 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:10.141952 23436 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.212000 21808 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:10.177525 23379 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.221809 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:10.232538 21777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.010s	sys 0.021s
I20260709 13:07:10.185228 23375 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:10.207974 23242 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.213828 21225 rpcz_store.cc:276] 0709 13:07:07.695646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.733632 (+1037986us) service_pool.cc:224] Handling call
0709 13:07:08.734123 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.734455 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.734485 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.734929 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.993014 (+1258085us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.993511 (+   497us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.993791 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.993918 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.036949 (+ 43031us) raft_consensus.cc:1685] finished
0709 13:07:10.036964 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.037120 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1049,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":1352,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":119394,"thread_start_us":1217026,"threads_started":1,"wal-append.queue_time_us":1299351}
I20260709 13:07:10.261996 21218 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.264307 23440 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.265180 23440 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.267916 21143 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
W20260709 13:07:10.235179 23351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.010s	sys 0.010s
I20260709 13:07:10.268615 23442 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.282529 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.282935 23273 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:10.301002 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.284745 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53261.7us
I20260709 13:07:10.302284 21813 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:10.548283 21814 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:10.283658 21293 raft_consensus.cc:2410] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:10.332942 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2150) took 1361 ms. Trace:
I20260709 13:07:10.550442 21810 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:10.269418 23242 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.481118 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:10.421496 23241 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.002s
I20260709 13:07:10.552613 23258 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.566339 23439 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.565623 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:10.318744 23375 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.568055 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:10.570365 23375 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:10.571604 23247 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.571799 23258 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:10.479517 23341 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.572315 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.572379 23258 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.573009 23258 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.572727 23341 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.458664 23224 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.575773 23224 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.577535 23270 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.577982 23224 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.560281 23352 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.370420 23440 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:10.464000 23458 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:10.281170 23444 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:10.579849 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.553179 21296 rpcz_store.cc:276] 0709 13:07:08.971109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.145287 (+174178us) service_pool.cc:224] Handling call
0709 13:07:09.145721 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.146172 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.146209 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.146940 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.991646 (+844706us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:10.317067 (+325421us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.332099 (+ 15032us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.332528 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.332642 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.332707 (+    65us) raft_consensus.cc:1685] finished
0709 13:07:10.332723 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.332886 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13,"raft.queue_time_us":2439,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":438,"thread_start_us":1115486,"threads_started":2,"wal-append.queue_time_us":904116}
I20260709 13:07:10.523541 23354 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.301306 23453 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.575098 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:10.577984 23270 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.283743 23273 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.580745 23341 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:10.596100 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.598130 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1594) took 1627 ms. Trace:
W20260709 13:07:10.599388 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 436146us
I20260709 13:07:10.603606 21225 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:10.588130 23224 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.604854 23447 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.594538 23270 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.584223 23241 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.614744 23475 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:10.594123 23375 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:10.617142 21776 connection.cc:256] RPC call timeout handler was delayed by -1.201613296000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:07:10.605274 23442 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.590502 23444 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.598492 21145 rpcz_store.cc:276] 0709 13:07:08.970526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.970681 (+   155us) service_pool.cc:224] Handling call
0709 13:07:08.997397 (+ 26716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.997603 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:10.162583 (+1164980us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.557620 (+395037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.560366 (+  2746us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:10.564238 (+  3872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.586284 (+ 22046us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.598073 (+ 11789us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1014977,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":33176,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":23153,"thread_start_us":1412241,"threads_started":2}
I20260709 13:07:10.623454 23442 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.615924 23359 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.599042 23354 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.621024 23278 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.635179 23475 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.635596 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.635456 23278 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.636240 21300 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:10.631247 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:10.628049 21776 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.583s (SENT) [suppressed 17 similar messages]
I20260709 13:07:10.637431 23475 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.621537 23439 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:10.620854 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2205) took 2711 ms. Trace:
I20260709 13:07:10.629696 23341 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.640523 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.609782 23447 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.651605 21296 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:10.645439 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 413841us
I20260709 13:07:10.634212 23359 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.656235 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.622038 23224 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.658300 21300 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:10.664674 21217 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:10.668478 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.665122 21217 pending_rounds.cc:85] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 1
I20260709 13:07:10.670897 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.659904 23359 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.660060 23436 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:10.675274 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.642912 21293 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:10.669075 21225 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:10.669064 21217 pending_rounds.cc:107] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:10.677508 21217 raft_consensus.cc:2889] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.660863 23439 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.678503 21225 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:10.676573 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.682101 21300 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:10.688941 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.663579 23352 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.706446 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:10.664028 23375 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:10.710201 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.683584 23071 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.718535 23447 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:10.674961 23278 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.673229 23257 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:07:10.740005 23439 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.721199 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.747045 21298 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:10.643765 21218 rpcz_store.cc:276] 0709 13:07:07.909577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.130153 (+1220576us) service_pool.cc:224] Handling call
0709 13:07:09.178901 (+ 48748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.262556 (+1083655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.620557 (+358001us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:10.620789 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466401536}
I20260709 13:07:10.753396 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.750053 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.752583 21300 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:10.752249 21115 leader_election.cc:336] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.007s (SENT)
I20260709 13:07:10.760833 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.760913 21115 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:10.763875 23487 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:10.764571 23375 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:10.766281 21115 leader_election.cc:336] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.048s (SENT)
I20260709 13:07:10.766113 23270 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.766811 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:10.768278 23278 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.768561 23444 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.720121 23352 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:10.770025 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.771293 23352 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.771409 23257 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:10.755196 21296 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:10.776469 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 93408us
I20260709 13:07:10.682785 23379 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:10.782735 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:10.792651 23478 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:07:10.794227 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1725) took 2893 ms. Trace:
I20260709 13:07:10.794651 21299 rpcz_store.cc:276] 0709 13:07:07.900823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.901460 (+   637us) service_pool.cc:224] Handling call
0709 13:07:07.901774 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.124333 (+2222559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.127643 (+  3310us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.128454 (+   811us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.586153 (+457699us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:10.586194 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.615810 (+ 29616us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540029de54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:10.615857 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.793852 (+177995us) raft_consensus.cc:1685] finished
0709 13:07:10.793874 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.794140 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559,"raft.queue_time_us":50100,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":1599,"spinlock_wait_cycles":1779472768,"thread_start_us":1737657,"threads_started":2,"wal-append.queue_time_us":512298}
I20260709 13:07:10.797323 23465 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:10.798002 23465 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:10.798178 23480 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:07:10.799086 23465 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.801431 23270 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.744951 23071 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:10.811414 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 236389us
I20260709 13:07:10.812394 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:10.812740 23379 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.813176 23071 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.814395 23224 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:10.814721 23485 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.772006 23257 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.822645 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.824150 23257 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:10.825726 23473 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:07:10.827126 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.828176 23379 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:10.833591 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.839738 21145 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
W20260709 13:07:10.824282 23471 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:07:10.868088 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:10.869422 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.870260 23258 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.870690 23354 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:10.871389 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 89757.4us
I20260709 13:07:10.871588 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.872496 21293 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:10.873337 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.873915 21293 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:10.874848 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:10.875699 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.863466 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:10.867651 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:10.888820 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 260765us
I20260709 13:07:10.887710 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.789283 23273 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:10.891940 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 79701.2us
I20260709 13:07:10.915961 21296 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:10.917759 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:10.891383 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.923421 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.876433 23354 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.892598 21297 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:10.886519 23241 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.944218 23341 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:10.944221 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.949266 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.950847 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:10.949347 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 71070.5us
I20260709 13:07:10.952229 21295 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.952623 21814 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.951351 21142 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.955834 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.960057 21299 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:10.960309 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:10.960973 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.961737 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:10.962019 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:10.962383 21224 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.963522 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:10.964672 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 133638us
I20260709 13:07:10.965193 23447 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.965417 23483 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.965615 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.965731 23447 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.966323 21294 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:10.966015 23483 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.967993 23447 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.968743 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:10.969010 23483 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:10.963126 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.963335 23487 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.915511 23071 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:07:10.969589 23479 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
I20260709 13:07:11.005369 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.005215 23341 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:10.918771 23442 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.006642 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:11.007402 21292 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:11.007722 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.008077 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:11.008328 23442 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:11.008610 21292 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.008354 21294 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:10.991298 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:10.919446 23352 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.912705 21293 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:10.994884 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.924127 23486 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.995137 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.996286 21812 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.996855 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.996855 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:10.998440 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:11.000372 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:11.003218 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:11.020005 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.031150 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.018585 21146 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:11.025709 21811 raft_consensus.cc:2410] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:10.995049 21291 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:11.004316 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.034386 23258 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:11.035840 21150 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:10.956390 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.016966 21264 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:11.037420 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.038479 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:11.024518 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 67909.5us
I20260709 13:07:11.040799 21144 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:11.049474 21808 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:11.049606 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.041095 23486 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.050770 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:11.051445 21808 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.052290 23486 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:11.053578 21813 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:11.054180 23242 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.054793 21813 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:07:11.057101 23474 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:07:11.057432 21805 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:11.061184 21776 connection.cc:256] RPC call timeout handler was delayed by -1.0495132959999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:07:10.926045 23359 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.063160 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:10.948504 23484 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:07:10.948779 23354 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.080535 21224 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:11.067478 21147 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:11.027349 23352 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:11.063441 21297 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:11.076850 21142 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:11.079444 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85885us
W20260709 13:07:11.094611 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.100879 23242 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:11.097720 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:11.107475 23224 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.042013 23458 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.110551 21144 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.116024 23458 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.118209 21292 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:11.118808 23458 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:11.119807 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:11.120997 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:11.122828 23359 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:11.080453 23442 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:11.097555 23352 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.163627 23242 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.173431 21151 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:11.175813 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:11.174391 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75427.9us
I20260709 13:07:11.177377 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.178046 21151 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.169968 23442 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.191802 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:11.199651 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 101181us
I20260709 13:07:11.203186 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:11.227464 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:11.247871 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46164.6us
I20260709 13:07:11.248003 21226 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:11.248310 21217 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:11.251797 21224 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:11.253515 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:11.253538 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.145998 23487 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:11.172405 23242 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.253932 21151 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:11.256268 21142 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:11.254410 23258 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.179649 23354 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:11.263379 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:11.202657 23465 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.263161 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:11.282594 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.261231 23242 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.263085 23483 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.279707 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.295948 23483 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:11.296301 21148 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.296481 23483 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.279465 21223 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:11.301095 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:11.283879 23257 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:11.303155 23257 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.303558 23257 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.304565 23257 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.305457 23071 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.305809 23257 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.305997 23071 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.279970 23258 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:11.309113 23258 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.300871 23487 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.318574 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.333624 21144 raft_consensus.cc:2410] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:11.328202 21295 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:11.346333 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:11.312523 23470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.017s	sys 0.031s
I20260709 13:07:11.313874 23224 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.312757 23354 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.358026 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.358599 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:11.357105 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 247255us
W20260709 13:07:11.353340 23470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.017s	sys 0.031s
I20260709 13:07:11.349937 23487 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.366860 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.307121 23071 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.369207 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.375397 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.375212 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.356582 23224 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:11.378189 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.367241 23465 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:11.381412 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.347718 23485 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:07:11.384958 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 109874us
W20260709 13:07:11.388674 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.389139 21263 connection.cc:256] RPC call timeout handler was delayed by -1.4637165950000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:07:11.390293 21145 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
W20260709 13:07:11.386600 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 127460us
W20260709 13:07:11.389515 21263 connection.cc:256] RPC call timeout handler was delayed by -1.3872165950000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:07:11.391799 21263 connection.cc:256] RPC call timeout handler was delayed by -1.2414165950000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:07:11.392120 21263 connection.cc:256] RPC call timeout handler was delayed by -1.2414165950000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:07:11.392429 21263 connection.cc:256] RPC call timeout handler was delayed by -1.1884519210000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:07:11.377297 23435 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.368549 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.385471 23224 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.406742 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.407534 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:11.408295 21814 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.408411 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:11.408762 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.409440 21147 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:11.409723 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:11.410315 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:11.406097 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.408429 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.412907 21145 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:11.394142 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:11.393324 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 45705.1us
I20260709 13:07:11.393503 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.399441 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.399560 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.401959 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.402417 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:11.402645 21295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:43572
I20260709 13:07:11.417299 21295 raft_consensus.cc:606] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:11.417811 21295 raft_consensus.cc:614] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:11.404093 21808 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:11.407624 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.390755 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.418255 21296 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:11.419935 21300 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:11.461849 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:11.463112 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.464736 21814 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:11.460412 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:11.463920 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:11.470063 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75222.3us
I20260709 13:07:11.473129 21145 raft_consensus.cc:2368] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:11.382200 23351 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:11.476014 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:11.463413 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49291.2us
I20260709 13:07:11.421445 23354 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.366791 23442 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.424790 23440 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.483620 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.489588 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.492210 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:11.482884 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 87056.5us
I20260709 13:07:11.425316 23435 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:11.489454 23071 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.495609 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:11.496021 21807 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:11.496394 21224 raft_consensus.cc:2368] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:11.464675 21219 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:11.496488 23435 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.475670 23149 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:11.418483 23341 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:07:11.511863 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:11.516516 21300 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:11.480010 21148 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:11.491755 23354 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:11.489452 23458 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.519801 21296 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:11.493621 23483 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.546463 23354 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.550988 23440 raft_consensus.cc:2764] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:11.570658 23341 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.573570 23467 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.573817 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:11.574319 23512 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.574218 23511 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.574805 23520 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:11.576097 23510 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:07:11.612720 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 210380us
I20260709 13:07:11.614916 21810 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.560495 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:11.627112 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 111043us
W20260709 13:07:11.629752 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 126690us
W20260709 13:07:11.636137 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 158612us
I20260709 13:07:11.599501 23341 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:11.538609 23465 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.629832 23258 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:11.637619 23503 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:07:11.512327 23487 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:11.665478 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 159105us
I20260709 13:07:11.655037 23485 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:11.599630 23518 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:07:11.630568 23351 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:11.660053 23258 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.679955 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:11.684471 23500 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:07:11.685345 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:11.692699 23509 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:11.647408 23224 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.637447 23512 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.646895 23486 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:11.693701 23519 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:11.720778 21144 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:11.723500 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77969.7us
W20260709 13:07:11.737869 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 360142us
W20260709 13:07:11.746367 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 115849us
W20260709 13:07:11.747524 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 195325us
I20260709 13:07:11.718068 23258 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.678722 23273 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:11.771517 21149 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:11.673126 23484 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 13:07:11.790212 23517 log.cc:927] Time spent T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:07:11.795432 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 127745us
W20260709 13:07:11.788462 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 76156.4us
W20260709 13:07:11.840216 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 128656us
I20260709 13:07:11.779341 23071 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.862075 23526 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:07:11.759097 23242 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:11.865962 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 91729.2us
I20260709 13:07:11.863076 23526 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.794742 23354 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.873406 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.873612 21300 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:11.874071 21299 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:11.875216 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.875841 21299 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:11.876796 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.877478 21294 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:11.874012 21300 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:11.880223 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:11.786585 23273 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.889418 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.891829 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.892675 23224 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:11.893431 21297 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:11.896080 23453 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:11.898012 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:11.899801 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:11.900338 21291 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.892620 21293 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:11.901567 21298 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:11.869562 23242 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:11.907845 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:11.871454 23526 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.910645 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:11.918500 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:11.918917 21296 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.912384 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:11.919474 21149 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.920713 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:11.923012 21298 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:11.913312 23258 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.906466 23458 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:11.915989 23224 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.917711 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:11.856583 23520 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:11.840839 23341 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.901782 23351 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.947490 23351 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.948498 23258 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:11.949864 23351 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:11.917686 23515 raft_consensus.cc:2764] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:11.872808 23071 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:11.902664 23483 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:11.942852 23273 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:11.943360 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73914.5us
I20260709 13:07:11.943813 21299 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.932302 23530 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.933863 21300 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:11.923964 23512 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:11.968048 23544 consensus_queue.cc:1175] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:11.969162 23352 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.798s	user 0.004s	sys 0.008s
I20260709 13:07:11.969448 21297 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.969636 23352 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:11.965416 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47800.2us
I20260709 13:07:11.972821 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:11.967579 21300 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:11.967887 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 69016.8us
W20260709 13:07:11.963086 23535 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.077s	user 0.021s	sys 0.017s
I20260709 13:07:11.961884 23530 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.986461 21296 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:11.952596 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:11.990911 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:11.991991 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:11.971903 23515 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.996084 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:11.996340 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 122916us
I20260709 13:07:11.997493 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:11.988839 23447 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.989123 23530 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.990715 23273 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.993245 21294 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:11.997383 23352 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:12.004374 21294 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:12.005517 23487 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:12.006574 23533 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:12.006976 23533 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:11.995730 23484 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.964005 23458 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.024828 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:12.000875 23486 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:12.026731 23486 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:12.021166 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48482.1us
I20260709 13:07:12.028561 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:12.007851 23273 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:12.029580 23273 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.032689 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:12.033056 21150 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:12.033953 23540 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:12.034528 23540 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:12.035434 23540 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:12.038592 21115 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.039448 23359 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.040256 23522 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:12.040925 23458 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.022557 23533 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.072521 23536 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:12.020545 23526 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.075381 23538 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.031376 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:12.112376 21291 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:12.119055 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 90608.7us
W20260709 13:07:12.119855 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 88835.9us
I20260709 13:07:12.116350 23538 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.125815 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.124622 21300 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:12.129642 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:12.125190 21149 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:12.132700 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 94228.9us
I20260709 13:07:12.128968 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:12.007963 23519 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:07:12.022763 23447 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:12.123800 23534 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 13:07:12.146337 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.147616 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:12.145833 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.124343 23270 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.127534 23224 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.159288 21291 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:12.131632 23538 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.209048 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 52499.2us
I20260709 13:07:12.210291 21191 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.214931 23552 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:12.216982 23541 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:07:12.219391 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59667.1us
I20260709 13:07:12.221246 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.156024 23508 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.160467 23533 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:12.231778 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 117896us
I20260709 13:07:12.232687 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:12.236092 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:12.240052 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.160960 23224 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:12.162773 23465 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.209734 23526 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.251150 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.222764 23071 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:12.224541 23379 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.225442 23508 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.287427 21263 leader_election.cc:400] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:12.295470 21263 leader_election.cc:403] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:12.288750 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67604us
I20260709 13:07:12.224139 23487 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.251981 23224 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.252257 23543 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.289850 23270 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.288136 23458 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.295912 23379 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:12.353076 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.321318 23552 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.355407 23544 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:12.356480 23556 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:07:12.367421 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 208746us
W20260709 13:07:12.357508 23555 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:07:12.298009 23508 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.297531 23351 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.352703 21191 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:12.360035 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.380285 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.357179 23440 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:12.330041 23543 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:12.354375 23270 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:12.361346 23379 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.395715 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:12.398216 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 76419.6us
I20260709 13:07:12.399070 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.386475 23543 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.420415 23532 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:12.389412 23270 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.387614 23351 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:12.427096 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.428762 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.432915 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.417522 23485 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.435631 21115 leader_election.cc:400] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:12.436071 21115 leader_election.cc:403] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.405833 23465 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:12.425848 23515 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.369581 23552 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:12.441946 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 199270us
I20260709 13:07:12.451819 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.453403 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:12.453473 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:12.425668 23440 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:07:12.593427 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 162642us
I20260709 13:07:12.444098 23447 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.438416 23485 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:12.606411 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.609599 23242 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:12.612648 23242 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:12.613111 23242 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.610078 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1330) took 1247 ms. Trace:
I20260709 13:07:12.446048 23515 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:12.614576 21144 rpcz_store.cc:276] 0709 13:07:11.358245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.358379 (+   134us) service_pool.cc:224] Handling call
0709 13:07:12.605351 (+1246972us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54000857d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:12.605477 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701759360}
W20260709 13:07:12.610532 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 177720us
I20260709 13:07:12.590008 23564 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
W20260709 13:07:12.612149 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 158760us
I20260709 13:07:12.618999 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.619529 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.590102 23465 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:12.581096 23071 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:12.622613 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.590240 23487 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:12.627964 23354 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.628527 23458 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.603451 23498 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:12.634660 23554 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:12.635044 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.650326 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:12.650585 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57882.8us
I20260709 13:07:12.614303 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2234) took 1437 ms. Trace:
I20260709 13:07:12.620219 23515 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.646826 23566 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.610447 23485 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.656497 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:12.659420 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 212734us
I20260709 13:07:12.651274 23490 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.665035 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:12.667433 21299 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.649801 23498 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:12.664362 23557 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:07:12.642584 23071 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.679314 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.647894 23487 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:12.681946 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.667186 23354 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:12.686555 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 48394.8us
I20260709 13:07:12.668934 23490 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:12.669164 23498 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.647234 23351 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:12.670478 23564 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:12.655821 23513 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:12.695888 23569 raft_consensus.cc:2764] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:07:12.710501 23558 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:07:12.733541 21291 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:12.698359 23529 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:12.736639 23523 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:12.695775 23564 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.737246 23568 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:12.737480 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59036.5us
I20260709 13:07:12.699862 23490 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.733508 23514 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.771214 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 91994.8us
I20260709 13:07:12.771485 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:12.757974 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.758566 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.751076 21046 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 362) took 11069 ms. Trace:
I20260709 13:07:12.699103 23465 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.761123 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:12.772006 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.747016 23515 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:12.760584 23523 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:12.701890 23554 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.763681 23568 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:12.781906 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:12.695227 23224 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:12.787613 21811 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.775143 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:12.775143 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:12.798338 21806 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:12.784531 21294 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:12.798638 23224 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:12.789098 23568 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:12.781076 23530 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:07:12.796370 21805 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.796689 23551 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:07:12.796931 23071 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:12.781595 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:12.797803 23564 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:12.801872 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:12.794368 23526 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.002s
I20260709 13:07:12.797134 23577 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:12.784664 23552 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.798574 23270 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.773175 23514 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.774796 21046 rpcz_store.cc:276] 0709 13:07:01.681253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.685290 (+  4037us) service_pool.cc:224] Handling call
0709 13:07:12.750841 (+11065551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:06.901878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:06.942608 (+ 40730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:06.942640 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:07:06.942659 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:07.022000 (+ 79341us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.028077 (+  6077us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.035297 (+  7220us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:07.129537 (+ 94240us) tablet.cc:701] Row locks acquired
0709 13:07:07.143838 (+ 14301us) write_op.cc:260] PREPARE: finished
0709 13:07:07.144007 (+   169us) write_op.cc:270] Start()
0709 13:07:07.144130 (+   123us) write_op.cc:276] Timestamp: P: 1783602427143961 usec, L: 0
0709 13:07:07.144156 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.231973 (+ 87817us) log.cc:844] Serialized 1675 byte log entry
0709 13:07:09.981297 (+2749324us) op_driver.cc:464] REPLICATION: finished
0709 13:07:10.371018 (+389721us) write_op.cc:301] APPLY: starting
0709 13:07:10.371227 (+   209us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:10.371555 (+   328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:10.371760 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:10.578051 (+206291us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:10.578410 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:07:10.578472 (+    62us) write_op.cc:312] APPLY: finished
0709 13:07:10.641802 (+ 63330us) log.cc:844] Serialized 41 byte log entry
0709 13:07:11.035084 (+393282us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6ac700ac 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b
0709 13:07:11.381353 (+346269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.425114 (+ 43761us) write_op.cc:454] Released schema lock
0709 13:07:11.477827 (+ 52713us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:11.567276 (+ 89449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.568926 (+  1650us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":461619,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":389270,"apply.run_cpu_time_us":65883,"apply.run_wall_time_us":1180762,"num_ops":4,"prepare.queue_time_us":216812,"prepare.run_cpu_time_us":32292,"prepare.run_wall_time_us":460416,"raft.queue_time_us":1655346,"raft.run_cpu_time_us":8687,"raft.run_wall_time_us":293868,"replication_time_us":2774602,"spinlock_wait_cycles":48364416,"thread_start_us":2243246,"threads_started":5,"wal-append.queue_time_us":892568,"wal-append.run_cpu_time_us":35077,"wal-append.run_wall_time_us":4323801}]]}
I20260709 13:07:12.807019 23224 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.784804 23520 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:12.834299 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.841666 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.822212 23554 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.855659 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.856884 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:12.846601 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 66705.8us
I20260709 13:07:12.862089 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.806918 23530 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.864113 21809 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:12.864617 23487 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.867347 23224 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:12.868695 23270 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:12.888836 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.868444 23543 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.823767 23564 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:12.855530 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.859656 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.874805 21299 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:12.879951 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1646) took 1137 ms. Trace:
I20260709 13:07:12.883131 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.895596 21145 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:12.884174 21144 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.847123 23569 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.890897 21811 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:12.890188 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.894800 21142 rpcz_store.cc:276] 0709 13:07:11.742198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.742791 (+   593us) service_pool.cc:224] Handling call
0709 13:07:11.756983 (+ 14192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.788200 (+ 31217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.788251 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.601895 (+813644us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b180036ce20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a
0709 13:07:12.753309 (+151414us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:12.753915 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.822756 (+ 68841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.831883 (+  9127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.831980 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.879767 (+ 47787us) raft_consensus.cc:1685] finished
0709 13:07:12.879784 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.879890 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8635,"raft.queue_time_us":25261,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12328,"spinlock_wait_cycles":123267072,"thread_start_us":68303,"threads_started":1,"wal-append.queue_time_us":117285}
I20260709 13:07:12.888585 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:12.891204 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.903143 21805 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:12.908373 23515 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.909262 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.909967 21220 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:12.911664 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.912407 21221 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:12.902911 21297 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.903208 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:12.906318 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:12.981899 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 122309us
I20260709 13:07:12.975993 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.981439 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.988653 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:12.988814 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:12.651952 21218 rpcz_store.cc:276] 0709 13:07:11.173539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.199865 (+ 26326us) service_pool.cc:224] Handling call
0709 13:07:11.257689 (+ 57824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.302912 (+ 45223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.302961 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.303544 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.398941 (+ 95397us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:11.416726 (+ 17785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.419527 (+  2801us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.575369 (+155842us) raft_consensus.cc:1685] finished
0709 13:07:11.575391 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.444634 (+869243us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b540038b650. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:12.610625 (+165991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2411,"raft.queue_time_us":24607,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":85,"spinlock_wait_cycles":65724288,"thread_start_us":84268,"threads_started":1,"wal-append.queue_time_us":178502,"wal-append.run_cpu_time_us":2002,"wal-append.run_wall_time_us":1085323}
I20260709 13:07:12.981439 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.987983 21297 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:12.981508 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.988691 21811 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.913515 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:13.015070 21144 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:13.015563 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:12.970512 23549 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.815s	user 0.002s	sys 0.004s
W20260709 13:07:12.967408 23533 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.011s
I20260709 13:07:13.019996 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:13.021512 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:12.982456 23583 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.022228 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.021544 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.023406 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:13.023746 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:13.025050 23575 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.036350 21149 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:13.036502 21217 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:12.965837 21807 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:13.029685 23538 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.798s	user 0.012s	sys 0.007s
W20260709 13:07:12.998741 23379 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.006s
I20260709 13:07:13.031904 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.895004 23487 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:07:12.982877 23543 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.032974 21219 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.033790 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:12.903043 23554 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.898329 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:12.981767 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:12.902750 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:12.902379 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.026652 23514 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.021616 21297 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.034401 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.037942 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.112116 21299 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.039855 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:13.037562 23583 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.020046 23520 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.020840 23530 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:13.046802 21811 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:13.041553 23587 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:13.037557 23575 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:13.047379 23538 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:12.911101 23568 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.049858 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:13.047394 23273 consensus_meta.cc:287] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.003s
I20260709 13:07:13.054692 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.055626 23242 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:13.058521 23508 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.007s
I20260709 13:07:13.137866 23273 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.139506 23242 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.140785 23273 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:13.070509 23581 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:07:13.143618 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.072664 23569 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:13.079156 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.144613 23569 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.050890 23379 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.144876 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.145776 21807 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:13.146721 23379 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:12.913887 23485 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.119059 23543 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.147588 23543 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.147651 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.148042 23543 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.148837 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.150147 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.150660 21807 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.120365 21223 raft_consensus.cc:2368] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:13.080284 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:13.151770 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71567.6us
I20260709 13:07:13.152823 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:13.084218 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 802) took 1186 ms. Trace:
I20260709 13:07:13.089211 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:13.154834 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 65710.6us
I20260709 13:07:13.088310 21142 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:12.966717 23498 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:13.100680 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 79253.2us
I20260709 13:07:13.156795 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:13.095857 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:13.099627 23554 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:13.112136 21148 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:13.157941 23465 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.161909 23554 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.162271 23465 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.162551 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.162710 23465 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.163712 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.164261 21294 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.122123 21297 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.121440 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.122864 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.132256 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.133034 23568 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.133212 21143 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.168531 23149 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.136679 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 805) took 1237 ms. Trace:
I20260709 13:07:13.137199 23538 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.137830 23508 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.064123 23490 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:13.068666 23580 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:07:13.140965 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.140965 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.142390 23583 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.120743 23575 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.203624 21806 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:13.204334 23498 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:13.204665 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.205966 23508 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.135845 21295 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.208714 23490 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:13.205984 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.148989 23485 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.158649 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:13.159832 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 64101.1us
I20260709 13:07:13.218379 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:13.132059 23514 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.154557 21813 rpcz_store.cc:276] 0709 13:07:11.898254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.904071 (+  5817us) service_pool.cc:224] Handling call
0709 13:07:11.914785 (+ 10714us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.915247 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.915292 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.915858 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.992149 (+ 76291us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.323078 (+330929us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.323317 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.323410 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.969955 (+646545us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:13.083873 (+113918us) raft_consensus.cc:1685] finished
0709 13:07:13.083979 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.084123 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19082,"prepare.queue_time_us":134894,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":55954,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":3106,"spinlock_wait_cycles":3833728,"thread_start_us":340111,"threads_started":2,"wal-append.queue_time_us":196871}
I20260709 13:07:13.119920 21299 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:13.178025 23530 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.175137 23529 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.168337 23270 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.166848 23502 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.179339 23379 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:13.183454 23531 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:13.186544 23465 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.187928 23257 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:13.188736 23544 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:13.189356 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.190958 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2169) took 1295 ms. Trace:
I20260709 13:07:13.170090 21812 raft_consensus.cc:2376] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5. Re-sending same reply.
I20260709 13:07:13.195161 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:13.112155 21809 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.120833 23585 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:07:13.215838 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.222491 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:13.217674 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60131.9us
I20260709 13:07:13.217655 23149 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:13.259593 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.256253 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.229895 21295 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:13.210296 21806 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:13.201757 21805 raft_consensus.cc:2376] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7. Re-sending same reply.
I20260709 13:07:13.250054 21147 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.210146 21294 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:13.259135 21811 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:13.238653 23529 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.251879 23485 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.397385 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.398012 23485 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.398609 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.399718 23543 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.400415 23485 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:13.260741 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.402305 23543 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.402912 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.403589 23149 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.404362 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.405289 21805 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 1.
I20260709 13:07:13.385851 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2164) took 1491 ms. Trace:
I20260709 13:07:13.261135 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:13.385690 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 217729us
W20260709 13:07:13.334230 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 111774us
I20260709 13:07:13.407583 21292 rpcz_store.cc:276] 0709 13:07:11.894189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.921919 (+ 27730us) service_pool.cc:224] Handling call
0709 13:07:13.369621 (+1447702us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.369877 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.385389 (+ 15512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.385433 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.385493 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.385557 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.385639 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.385785 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25302272}
I20260709 13:07:13.313622 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:13.412151 21297 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:13.413959 21297 pending_rounds.cc:85] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 5
I20260709 13:07:13.414343 21297 pending_rounds.cc:107] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:13.230708 23568 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.230882 23530 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.230847 23483 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.348708 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.426514 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2168) took 1517 ms. Trace:
I20260709 13:07:13.427032 21295 rpcz_store.cc:276] 0709 13:07:11.895285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.921569 (+ 26284us) service_pool.cc:224] Handling call
0709 13:07:13.054488 (+1132919us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:13.412872 (+358384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21108992}
I20260709 13:07:13.365226 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.411758 21116 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:13.409860 21812 raft_consensus.cc:2376] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4. Re-sending same reply.
I20260709 13:07:13.414718 21297 raft_consensus.cc:2889] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.438650 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:13.406373 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.419245 21299 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:13.442411 21149 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:13.248972 23544 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.249202 23257 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:13.445211 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.445894 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.288754 23351 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.452116 21296 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.451999 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.452833 21806 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:13.453605 21296 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:13.454885 21296 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.250559 21293 rpcz_store.cc:276] 0709 13:07:11.895514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.941553 (+ 46039us) service_pool.cc:224] Handling call
0709 13:07:13.190043 (+1248490us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.190293 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.190514 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.190556 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.190612 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:13.190673 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.190749 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.190887 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35287424}
W20260709 13:07:13.439563 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.315411 23592 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:13.440143 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.369581 23526 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.396623 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:13.394546 21809 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:13.239485 23514 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.432698 23530 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.421389 23568 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:13.448832 21812 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 1.
I20260709 13:07:13.472699 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.415493 21226 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:13.438241 23483 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.422101 23543 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.510407 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.514731 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:13.419824 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 160954us
I20260709 13:07:13.487788 21811 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:13.441496 23538 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.445055 23465 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.441908 23379 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:13.458724 23518 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:13.251837 23575 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.286072 23554 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.460067 21805 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:13.488456 23574 raft_consensus.cc:2764] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:13.507728 23483 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.459693 23351 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:13.492108 21296 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:13.444406 23583 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:07:13.487597 23526 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.521107 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:13.521934 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:13.632931 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 111892us
I20260709 13:07:13.539501 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:13.618188 21264 leader_election.cc:336] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.641s (SENT)
I20260709 13:07:13.492957 23568 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.628494 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.643118 21813 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 2: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:13.522742 23270 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:13.638315 21812 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:13.639125 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:13.615497 21293 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:13.640125 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 445015us
I20260709 13:07:13.651525 21263 leader_election.cc:400] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:13.652637 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:13.652993 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:13.654457 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:13.640036 23543 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.665628 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:13.646023 23512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.611s	user 0.043s	sys 0.052s
I20260709 13:07:13.667572 23529 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:13.669166 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.201229 21808 rpcz_store.cc:276] 0709 13:07:11.899187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.901476 (+  2289us) service_pool.cc:224] Handling call
0709 13:07:11.910605 (+  9129us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.916426 (+  5821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.916461 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.917074 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.940240 (+ 23166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:11.988330 (+ 48090us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.996177 (+  7847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.002065 (+  5888us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.876839 (+874774us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b1800082f60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:13.127778 (+250939us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b1800082f60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:13.135147 (+  7369us) raft_consensus.cc:1685] finished
0709 13:07:13.136352 (+  1205us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.136585 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44984,"prepare.queue_time_us":49860,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":9863,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":213,"spinlock_wait_cycles":7440896,"thread_start_us":56894,"threads_started":2,"wal-append.queue_time_us":102750}
I20260709 13:07:13.687208 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.690394 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.690935 21812 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:13.691700 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:13.692312 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.687438 23512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.653s	user 0.043s	sys 0.052s
I20260709 13:07:13.664047 21809 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.670684 21294 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:13.673154 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1778) took 1031 ms. Trace:
I20260709 13:07:13.643121 23486 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:13.674664 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:13.680409 23554 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:13.681557 23514 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:13.683135 23575 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:13.683844 23569 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:07:13.623340 23257 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.684603 23526 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:13.684998 23600 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:13.656263 23351 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:13.686101 21807 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 13:07:13.673187 23270 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:13.686612 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.689203 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.824790 21298 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.846153 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:13.692355 21812 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:13.930285 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 811) took 1167 ms. Trace:
W20260709 13:07:13.975593 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 357439us
W20260709 13:07:13.816762 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 132310us
I20260709 13:07:13.976898 21813 raft_consensus.cc:2410] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:13.977628 21264 leader_election.cc:336] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.677s (SENT)
I20260709 13:07:13.976097 21810 rpcz_store.cc:276] 0709 13:07:12.763572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.763945 (+   373us) service_pool.cc:224] Handling call
0709 13:07:13.929317 (+1165372us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.929539 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.929782 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.929819 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.929884 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.929935 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.930004 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.930139 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982208}
I20260709 13:07:13.978360 21291 rpcz_store.cc:276] 0709 13:07:12.641832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.755460 (+113628us) service_pool.cc:224] Handling call
0709 13:07:13.185671 (+430211us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.185844 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.186063 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.186087 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.201317 (+ 15230us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.469779 (+268462us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.469818 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.469938 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.672897 (+202959us) raft_consensus.cc:1685] finished
0709 13:07:13.672914 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.673101 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6453504,"thread_start_us":221158,"threads_started":1,"wal-append.queue_time_us":404317}
W20260709 13:07:13.980304 21264 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.733s (SENT)
I20260709 13:07:13.980970 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:13.973536 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:13.983842 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 137785us
I20260709 13:07:13.984287 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2165) took 2089 ms. Trace:
I20260709 13:07:13.984795 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:13.984789 21298 rpcz_store.cc:276] 0709 13:07:11.894489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.933328 (+ 38839us) service_pool.cc:224] Handling call
0709 13:07:12.736753 (+803425us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.824311 (+1087558us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55e9c 00007f2b6ac55a5b 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.824558 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.983379 (+158821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.983557 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75367424}
I20260709 13:07:13.986366 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:13.722920 23543 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.987944 23354 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:13.936146 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.992223 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.995729 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.997294 21225 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.996658 21812 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:13.998569 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.999626 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 310) took 1151 ms. Trace:
I20260709 13:07:14.000316 21225 rpcz_store.cc:276] 0709 13:07:12.848116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.848255 (+   139us) service_pool.cc:224] Handling call
0709 13:07:13.992119 (+1143864us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:13.992366 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.999337 (+  6971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.999563 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15983872}
I20260709 13:07:14.001341 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.002449 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:14.003943 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.006320 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:14.007323 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:14.009604 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:13.688565 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.746255 23458 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.997785 23257 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:14.012943 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 360347us
I20260709 13:07:13.997377 23584 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.034672 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:13.997658 23543 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:13.675206 21806 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:13.975659 21807 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:13.974817 23527 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:14.029520 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:14.042918 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 70517.3us
I20260709 13:07:14.013032 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:13.746384 23544 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:13.816156 23530 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.047297 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:14.007982 23575 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:14.037405 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60700.9us
I20260709 13:07:14.005369 23354 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.982105 23569 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.034457 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:14.083850 21298 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:14.006803 23486 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.086169 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:14.086913 21294 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:13.813345 23483 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.012929 23608 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:14.111145 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 101590us
I20260709 13:07:14.114275 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:13.945068 23583 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:07:14.038534 21813 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:14.027633 23604 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:14.012773 23502 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.045094 21291 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:14.044648 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:14.156694 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 666) took 1097 ms. Trace:
I20260709 13:07:14.157080 21813 rpcz_store.cc:276] 0709 13:07:13.058870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.012996 (+954126us) service_pool.cc:224] Handling call
0709 13:07:14.038313 (+ 25317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.156437 (+118124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.156642 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.003825 21293 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:14.028234 21805 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:14.072181 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:14.160636 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 116074us
W20260709 13:07:14.161176 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 89090.3us
I20260709 13:07:14.034694 23584 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:14.082473 23605 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.869772 23568 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.038722 23577 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.050036 23617 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:14.166525 21811 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.082129 23467 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:14.162040 21191 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:14.046236 23512 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:14.044406 23506 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.121s
W20260709 13:07:14.167642 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53480.4us
W20260709 13:07:14.167583 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 174658us
I20260709 13:07:14.175223 21813 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:14.036645 23458 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.178784 21291 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.179850 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.164798 23584 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.164968 23354 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.164986 23521 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:14.166524 23241 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:14.184777 21296 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:14.167529 23554 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.188949 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:14.192657 21812 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:14.195626 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.196169 21144 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.180917 23512 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:14.182667 23583 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.178194 23608 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:14.198002 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:14.199748 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.161427 23604 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:14.200377 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.200901 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.166960 23484 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:07:14.205237 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.205782 21151 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.190459 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.184638 23467 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:14.210094 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.213287 21147 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:14.180985 23585 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:14.215301 23502 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.194097 23621 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.220993 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.202841 23241 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:14.205029 23529 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.179435 23617 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.202041 23521 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:14.198415 23485 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:14.212049 23608 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:14.231621 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.227689 23467 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.229125 21805 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:14.232421 23604 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.239883 21144 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:14.206584 23583 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.247830 21151 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:14.253285 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.208778 23522 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:14.218612 23483 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.223557 23621 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.280011 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:14.195055 23543 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.294836 21217 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:14.300066 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46876.3us
I20260709 13:07:14.300971 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.303551 21808 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:14.254431 23529 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:14.307708 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:14.308753 21219 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.310577 21219 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:14.293612 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.284179 23621 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.296725 23568 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:14.298357 23622 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:14.305441 23625 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:14.301903 23569 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:14.335551 23616 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:14.314708 23241 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:14.305598 23521 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:14.336218 21218 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:14.579787 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.376443 23512 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.540531 21219 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:14.415807 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.722057 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.723686 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:14.317569 23483 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.782235 23483 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:14.783031 23483 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.785642 23483 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.374164 23617 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:14.485847 23502 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.369163 21808 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:07:14.787528 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 726) took 1097 ms. Trace:
I20260709 13:07:14.788122 21808 rpcz_store.cc:276] 0709 13:07:13.690371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.304449 (+614078us) service_pool.cc:224] Handling call
0709 13:07:14.304829 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.787132 (+482303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.787456 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.378391 23458 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.544016 23583 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:14.336448 23608 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:14.369019 23621 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:14.795215 23621 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.856127 21219 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:14.895403 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 594460us
I20260709 13:07:14.896557 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:14.898146 21776 leader_election.cc:400] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
W20260709 13:07:14.901602 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.899214 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:14.612349 23628 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:14.910211 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:14.475008 23629 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:14.475574 21805 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:14.915421 21777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.015s
I20260709 13:07:14.909415 23522 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:14.914885 23071 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:07:14.919569 23483 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:14.925616 23529 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:14.926457 23241 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:14.930605 23257 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.001s
I20260709 13:07:14.912942 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 825) took 1500 ms. Trace:
W20260709 13:07:14.945108 21777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.004s	sys 0.015s
I20260709 13:07:14.973352 23486 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.971159 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 730) took 1034 ms. Trace:
I20260709 13:07:14.976619 21805 rpcz_store.cc:276] 0709 13:07:13.937090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.307442 (+370352us) service_pool.cc:224] Handling call
0709 13:07:14.323337 (+ 15895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.953900 (+630563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.966985 (+ 13085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.985773 21150 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:14.941267 23621 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:14.326722 23622 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:14.992476 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 82377.7us
I20260709 13:07:14.971518 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2190) took 1262 ms. Trace:
I20260709 13:07:14.994249 23241 consensus_queue.cc:1059] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.000030 23241 raft_consensus.cc:3055] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.000533 23241 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:14.999516 21293 rpcz_store.cc:276] 0709 13:07:13.704431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.175740 (+471309us) service_pool.cc:224] Handling call
0709 13:07:14.183094 (+  7354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.208676 (+ 25582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.212505 (+  3829us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.226136 (+ 13631us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.293897 (+ 67761us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.873868 (+579971us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.913493 (+ 39625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.933127 (+ 19634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.956221 (+ 23094us) raft_consensus.cc:1685] finished
0709 13:07:14.956239 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.966989 (+ 10750us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":299498,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":47,"raft.queue_time_us":4372,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":12691,"thread_start_us":327935,"threads_started":2,"wal-append.queue_time_us":104528}
I20260709 13:07:14.994890 23071 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:14.995213 23257 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:14.966676 21809 rpcz_store.cc:276] 0709 13:07:13.412545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.036282 (+623737us) service_pool.cc:224] Handling call
0709 13:07:14.151879 (+115597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.186035 (+ 34156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.190962 (+  4927us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.228704 (+ 37742us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.481844 (+253140us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:14.481887 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.481974 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.614844 (+132870us) raft_consensus.cc:1685] finished
0709 13:07:14.877382 (+262538us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.910267 (+ 32885us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28331,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13837,"thread_start_us":150195,"threads_started":1,"wal-append.queue_time_us":325069}
I20260709 13:07:15.026542 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:15.005734 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 106582us
I20260709 13:07:15.011540 23453 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.013844 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.023728 21221 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.004956 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 325) took 2094 ms. Trace:
I20260709 13:07:15.038719 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 809) took 2273 ms. Trace:
I20260709 13:07:15.039294 21814 rpcz_store.cc:276] 0709 13:07:12.761672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.762101 (+   429us) service_pool.cc:224] Handling call
0709 13:07:15.013648 (+2251547us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:15.034914 (+ 21266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254016}
I20260709 13:07:15.026566 23522 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.001324 23241 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.021446 23622 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.023715 23529 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:15.035009 21222 rpcz_store.cc:276] 0709 13:07:12.910663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.110722 (+200059us) service_pool.cc:224] Handling call
0709 13:07:13.117984 (+  7262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.118298 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.118326 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.125071 (+  6745us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.422499 (+297428us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.470290 (+ 47791us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.488626 (+ 18336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.488719 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.982938 (+1494219us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b18003f8f80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:15.004693 (+ 21755us) raft_consensus.cc:1685] finished
0709 13:07:15.004779 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.004901 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105046,"prepare.queue_time_us":75270,"prepare.run_wall_time_us":3360,"raft.queue_time_us":18577,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":38176,"spinlock_wait_cycles":26945664,"thread_start_us":264422,"threads_started":1,"wal-append.queue_time_us":369754}
I20260709 13:07:15.051108 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.051811 21805 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:15.056003 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.054032 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.028812 23453 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.059796 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.044520 23486 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:15.057731 23584 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.864s	user 0.007s	sys 0.003s
I20260709 13:07:15.064896 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:15.033649 23257 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.043077 23634 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.066779 21222 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.067137 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.062549 23540 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.068185 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.040779 23635 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:15.066315 23486 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.070875 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.056334 23522 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.069654 23622 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.069011 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.072212 23634 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.083817 23486 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.062139 23529 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.076792 23621 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:15.086831 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:15.104166 23621 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.104301 21144 raft_consensus.cc:606] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Received request to transfer leadership to TS f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.087632 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.078123 23483 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.104595 23621 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.104828 23483 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.105543 23529 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.106132 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.105870 23483 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.106719 21144 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:15.107532 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:15.107635 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.108253 21293 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.108557 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:15.109120 21144 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.098174 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.109957 21298 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:15.110811 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.111316 21298 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.111578 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.112298 21291 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:15.112718 21297 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.113224 21291 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.114781 23634 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.107049 23483 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.066524 23584 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.117455 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.118024 21814 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:15.119361 21291 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.099536 23622 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.100304 23522 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.100831 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.086831 23453 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.125205 23599 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.125512 23453 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.126209 23273 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.126569 23273 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:15.127429 23273 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.128633 23273 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.079515 23540 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.104898 21151 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:15.130972 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.131524 21151 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:15.131763 23540 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:15.103482 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.132251 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.132609 21813 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:15.132877 21151 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:15.113269 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2176) took 1703 ms. Trace:
I20260709 13:07:15.099134 23257 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:15.121273 21264 connection.cc:256] RPC call timeout handler was delayed by -1.0529078409999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:07:15.133709 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:15.133919 21264 leader_election.cc:336] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.886s (SENT)
I20260709 13:07:15.134521 21151 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:15.134369 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:15.095319 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.122098 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.135857 23543 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.133486 21297 rpcz_store.cc:276] 0709 13:07:13.409669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.112267 (+1702598us) service_pool.cc:224] Handling call
0709 13:07:15.112554 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.113060 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.113210 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.136617 23584 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:15.124585 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.137246 21225 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.138273 23634 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.138469 21291 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:15.138666 23634 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.139058 23634 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.125586 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:15.142958 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:15.142992 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 450) took 2282 ms. Trace:
I20260709 13:07:15.144629 21143 rpcz_store.cc:276] 0709 13:07:12.860128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.860246 (+   118us) service_pool.cc:224] Handling call
0709 13:07:12.889273 (+ 29027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.199757 (+310484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.142771 (+1943014us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001f7554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.142936 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560435072}
I20260709 13:07:15.137284 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.145949 21297 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 1.
I20260709 13:07:15.121975 21298 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:15.148881 21144 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:15.150079 21222 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:15.151512 21297 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:15.153159 21151 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:15.155948 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.156795 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.157577 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.158388 23486 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.158752 23486 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.143750 23622 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.160689 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:15.111980 23621 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.162050 23635 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:15.159099 23486 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.162904 23599 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:15.183125 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.165880 21293 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:15.167379 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:15.184566 21814 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:15.182511 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47027.4us
I20260709 13:07:15.183214 23554 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.187337 23554 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:15.189451 23554 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:15.190784 21264 leader_election.cc:336] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.982s (SENT)
I20260709 13:07:15.190950 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.191246 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:15.193442 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:15.168799 23617 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.196049 23617 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.192513 23522 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.169203 21807 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:15.199906 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.168653 23543 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:15.168653 23635 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.216779 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.191581 23540 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.225365 23621 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.214198 23359 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.226001 23529 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.197990 23554 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.235121 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.232863 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2243) took 1162 ms. Trace:
I20260709 13:07:15.236156 21226 rpcz_store.cc:276] 0709 13:07:14.070778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.081777 (+ 10999us) service_pool.cc:224] Handling call
0709 13:07:14.082112 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.219314 (+137202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.219344 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.219383 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.219422 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.232558 (+1013136us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540035be54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.232621 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.232788 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315010432}
I20260709 13:07:15.236932 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:15.237571 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:15.238569 23655 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.233807 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:15.238636 23657 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.211539 23522 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.240736 23502 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.241222 23502 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.241590 23502 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.242106 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.242442 23522 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.239269 23655 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.233228 23617 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.250516 23617 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:15.250875 23617 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:15.251219 23617 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.251633 23655 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.252175 23655 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.252731 23657 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:15.253201 23657 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.244419 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 717) took 1556 ms. Trace:
I20260709 13:07:15.255646 21807 rpcz_store.cc:276] 0709 13:07:13.687881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.085350 (+397469us) service_pool.cc:224] Handling call
0709 13:07:15.166358 (+1081008us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:15.166566 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.212223 (+ 45657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.235897 (+ 23674us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31991040}
I20260709 13:07:15.256944 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.244112 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:15.259189 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.261435 21814 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:15.262427 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.264633 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:15.265600 23486 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.266165 21222 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.265535 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.267926 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.268447 21814 raft_consensus.cc:2376] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2. Re-sending same reply.
I20260709 13:07:15.269170 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.227294 23635 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.226550 23359 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.269973 21814 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:15.248387 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 90863.9us
I20260709 13:07:15.273255 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.274495 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.275298 21295 raft_consensus.cc:2368] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:15.275389 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.276005 21300 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:15.274045 23655 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.277918 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.278192 23655 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.280321 23655 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.281267 21300 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.282346 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.283435 21297 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:15.283675 23486 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.283727 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.284348 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.284942 21297 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.285015 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.286152 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.264016 23644 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.264199 23621 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.275913 21814 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.273576 23359 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.295024 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.234973 23543 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.301496 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:15.294557 21778 leader_election.cc:400] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5.
I20260709 13:07:15.303213 21297 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:15.304194 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:15.308171 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.304694 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.308882 21144 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:15.302804 23486 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.287006 23502 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.286707 21293 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:15.311566 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.313016 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.313850 21295 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:15.315721 21295 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.316642 23583 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.317135 23583 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:15.318090 23583 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.310201 23651 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.320005 23656 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.320068 23486 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.316654 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:15.324098 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 82051.9us
W20260709 13:07:15.325131 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51807.4us
I20260709 13:07:15.297909 23483 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:15.329680 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 715) took 1642 ms. Trace:
I20260709 13:07:15.324885 21807 raft_consensus.cc:2410] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:15.330122 21810 rpcz_store.cc:276] 0709 13:07:13.687274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.035622 (+348348us) service_pool.cc:224] Handling call
0709 13:07:14.043357 (+  7735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.217739 (+174382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.217768 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.248882 (+ 31114us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.477989 (+229107us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.614513 (+136524us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.318833 (+704320us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b180033c940. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:07:15.324479 (+  5646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.324574 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.324617 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:15.329496 (+  4879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.329627 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10765,"prepare.queue_time_us":136192,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":6144,"raft.queue_time_us":287986,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7756,"spinlock_wait_cycles":793025792,"thread_start_us":306601,"threads_started":3,"wal-append.queue_time_us":693510}
I20260709 13:07:15.331926 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.332620 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.333093 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.302266 23621 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.334672 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.337571 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.332038 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:15.304661 23634 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.340273 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.361596 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:15.362710 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:15.340684 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2244) took 1255 ms. Trace:
I20260709 13:07:15.363417 21221 rpcz_store.cc:276] 0709 13:07:14.084989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.085104 (+   115us) service_pool.cc:224] Handling call
0709 13:07:14.085798 (+   694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.036322 (+950524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.340470 (+304148us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400127ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.340626 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109017472}
W20260709 13:07:15.365609 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.341612 23529 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.340963 21814 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:15.338639 23658 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:15.378270 23651 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.342231 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:15.333633 23644 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.355387 23522 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.356330 23657 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.357264 23486 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.366919 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.336925 23257 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.369006 23506 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.386263 23651 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.359432 23617 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.388423 23634 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.334813 23656 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:15.369681 23655 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.369781 23270 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:15.370313 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.370643 23502 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.370916 23273 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.371469 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:15.407754 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 93035.7us
I20260709 13:07:15.407953 21291 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:15.409113 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:15.409664 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:15.409818 21291 raft_consensus.cc:2376] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2. Re-sending same reply.
I20260709 13:07:15.410405 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.372042 23599 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:15.373925 23603 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:15.347234 23659 raft_consensus.cc:2764] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:15.378746 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.416594 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.413074 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.380075 21115 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:15.417099 21814 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:15.417958 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.410967 21810 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5. Re-sending same reply.
I20260709 13:07:15.418254 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:15.418908 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.328125 23453 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:15.403456 21295 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.384311 23522 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.383757 23538 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.406651 21300 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.378954 23554 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.336426 23543 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.421118 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:15.422935 23617 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.405054 23634 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.431501 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:15.407624 23273 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:15.432296 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.429128 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.433130 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:15.434737 21814 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.434356 21810 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:15.434593 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:15.426136 23257 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.427562 23522 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.425637 23651 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.428637 23538 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.418426 23502 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:15.431587 23634 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.429354 23529 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.478579 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:15.479924 21810 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.474749 21300 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:15.432662 23599 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:15.433408 23453 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.428339 23554 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:15.510835 23554 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.511647 23639 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:15.512231 23554 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.513957 23351 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.437767 23273 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.470698 23467 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.477964 23585 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.508935 23599 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.529688 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1345) took 1337 ms. Trace:
I20260709 13:07:15.530586 23662 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:15.489434 23538 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.537585 21146 rpcz_store.cc:276] 0709 13:07:14.192745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.192855 (+   110us) service_pool.cc:224] Handling call
0709 13:07:14.193161 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.194475 (+  1314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.194507 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.198533 (+  4026us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.320609 (+1122076us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b180035b4e0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:15.381020 (+ 60411us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:15.381047 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.381090 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.516964 (+135874us) raft_consensus.cc:1685] finished
0709 13:07:15.516985 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.529616 (+ 12631us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":677,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6230,"spinlock_wait_cycles":9611648,"thread_start_us":60269,"threads_started":1,"wal-append.queue_time_us":1208793}
I20260709 13:07:15.534049 23621 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:15.480297 23483 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.535334 23467 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.534868 23273 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.550117 23467 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.538600 21295 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:15.543589 23453 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.543789 23359 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.529740 23529 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.489490 23644 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:15.541311 23662 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.570299 23662 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.554442 23529 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:15.573380 23529 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.574487 23529 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:15.575915 21264 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.149s (SENT)
W20260709 13:07:15.576803 21264 leader_election.cc:336] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.155s (SENT)
I20260709 13:07:15.577270 21264 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:15.551309 23635 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.580737 21810 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.589670 23554 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:15.539484 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 60970.6us
I20260709 13:07:15.543684 23622 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.555626 23483 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.564687 23359 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.549535 23585 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:15.625046 23585 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.623046 23622 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:15.627596 23622 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.628788 23622 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.630717 23483 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:15.649798 21116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 2.238s (SENT) [suppressed 46 similar messages]
W20260709 13:07:15.672626 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 68153.2us
W20260709 13:07:15.680444 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 103680us
W20260709 13:07:15.553906 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 125937us
I20260709 13:07:15.674310 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:15.711509 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:15.715502 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.675978 23662 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.688894 23518 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:15.742136 23512 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:15.713459 23522 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.743208 23512 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.743561 23512 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:15.744347 23512 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.744887 23522 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.745536 23512 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.742050 23518 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.687999 23657 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:15.702486 23635 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.714478 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:15.737033 23658 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.758381 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:15.759516 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.708406 23659 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.737262 23543 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:15.737404 23656 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:15.764510 23518 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:15.768378 23669 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:15.737620 23617 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:15.769507 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:15.770138 21291 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:15.771934 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:15.732455 23666 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:07:15.776165 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.736893 23515 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:07:15.732709 23538 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.713593 23359 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:15.837791 23523 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.843832 23621 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.756543 23453 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:15.901944 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:15.771220 23543 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.762718 23656 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.774487 23658 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:15.761498 23522 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:15.762457 23554 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.881916 23273 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:15.774194 23657 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.814095 23635 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.895860 23544 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.897696 21291 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.898753 23359 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.885916 23467 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.900075 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2242) took 1856 ms. Trace:
I20260709 13:07:15.900557 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:15.900687 21147 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:07:15.900837 21145 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:15.901423 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:15.912843 23543 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.917961 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:15.915215 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:15.925119 23359 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:15.926223 23608 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.934901 23608 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.920424 23657 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:15.936429 23657 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.916783 23523 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:15.940266 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.925460 21220 rpcz_store.cc:276] 0709 13:07:14.043672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.043842 (+   170us) service_pool.cc:224] Handling call
0709 13:07:14.070281 (+ 26439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.216002 (+145721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.216031 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.216070 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.216118 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.899863 (+1683745us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540038c554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.899906 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.900019 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334677376}
I20260709 13:07:15.911065 23656 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.948422 21223 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.943039 23527 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.948947 23527 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:15.949868 23527 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.932376 23467 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:15.773090 23659 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.943442 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1661) took 2697 ms. Trace:
I20260709 13:07:15.952237 21149 rpcz_store.cc:276] 0709 13:07:13.245706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.246759 (+  1053us) service_pool.cc:224] Handling call
0709 13:07:13.300032 (+ 53273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.442878 (+142846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.943151 (+2500273us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000ac654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.943379 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326595840}
I20260709 13:07:15.953516 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.953672 23659 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:15.954447 21809 raft_consensus.cc:2410] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:15.949199 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2257) took 1405 ms. Trace:
I20260709 13:07:15.955533 21223 rpcz_store.cc:276] 0709 13:07:14.543865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.947882 (+1404017us) service_pool.cc:224] Handling call
0709 13:07:15.948226 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.948910 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.949142 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.956193 23359 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.957413 23359 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.959408 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.962188 21809 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:15.963112 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.963610 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2245) took 1863 ms. Trace:
I20260709 13:07:15.963850 21809 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:15.964039 21218 rpcz_store.cc:276] 0709 13:07:14.100649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.146025 (+ 45376us) service_pool.cc:224] Handling call
0709 13:07:14.185768 (+ 39743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.718789 (+533021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.963380 (+1244591us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400127fd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:15.963556 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317654272}
I20260709 13:07:15.964717 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.965253 21809 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.966800 23583 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.968598 23619 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.969005 23619 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:15.944109 23658 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:15.923368 23554 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:15.919070 23522 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.951414 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:15.973930 21814 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:15.974835 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.975869 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:15.976265 21814 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:15.972162 21264 leader_election.cc:336] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.986s (SENT)
I20260709 13:07:15.904780 23621 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.924520 23635 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.909351 23453 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:15.951196 23527 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.979591 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:15.981151 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.942082 23622 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:07:15.988745 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.969887 23619 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:15.980154 23635 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.977144 23544 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:15.975394 23659 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:16.006809 21814 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:16.010571 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2241) took 1975 ms. Trace:
I20260709 13:07:16.010958 21225 rpcz_store.cc:276] 0709 13:07:14.035113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.035290 (+   177us) service_pool.cc:224] Handling call
0709 13:07:14.035626 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.137633 (+1102007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.010367 (+872734us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000dfcd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.010517 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533089024}
I20260709 13:07:16.014894 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:16.015936 21814 raft_consensus.cc:2410] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:16.005173 23619 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.019608 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:16.023416 23341 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.049377 23522 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:16.052656 23655 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.053108 23655 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:16.016803 23554 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.053911 23655 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:16.055658 23673 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:16.071137 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.077298 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2174) took 2668 ms. Trace:
I20260709 13:07:16.077695 21299 rpcz_store.cc:276] 0709 13:07:13.408633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.408752 (+   119us) service_pool.cc:224] Handling call
0709 13:07:13.410300 (+  1548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.441972 (+ 31672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.077122 (+2635150us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b540022e7d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.077246 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896768}
W20260709 13:07:16.083161 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.084007 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.084406 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.084862 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.088107 21217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2254) took 1821 ms (client timeout 1502 ms). Trace:
W20260709 13:07:16.088622 21217 rpcz_store.cc:269] 0709 13:07:14.266889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.295964 (+ 29075us) service_pool.cc:224] Handling call
0709 13:07:16.087817 (+1791853us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002378d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.087994 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624893696}
I20260709 13:07:16.102677 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2258) took 1558 ms. Trace:
I20260709 13:07:16.103171 21219 rpcz_store.cc:276] 0709 13:07:14.544337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.798314 (+253977us) service_pool.cc:224] Handling call
0709 13:07:14.798684 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.857482 (+ 58798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.092880 (+1235398us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b540038e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.102597 (+  9717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130959104}
W20260709 13:07:16.120165 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.133616 21224 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:16.135281 23530 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:16.179031 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.186065 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:16.141000 23379 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.191627 23379 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.206471 23530 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:16.220264 23530 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.138696 23656 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.222366 23530 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:16.237529 23675 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:07:16.237871 23656 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.239795 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 647) took 3246 ms. Trace:
I20260709 13:07:16.240165 21811 rpcz_store.cc:276] 0709 13:07:12.993085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.521094 (+528009us) service_pool.cc:224] Handling call
0709 13:07:13.541467 (+ 20373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.167068 (+625601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.239553 (+2072485us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54004eedd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.239736 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436863872}
I20260709 13:07:16.241668 21811 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:16.252025 21811 pending_rounds.cc:85] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 5
I20260709 13:07:16.245662 23663 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.252283 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 836) took 1060 ms. Trace:
W20260709 13:07:16.252455 21296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2185) took 2731 ms (client timeout 1737 ms). Trace:
I20260709 13:07:16.252624 23663 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:16.252924 21296 rpcz_store.cc:269] 0709 13:07:13.520768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.641012 (+120244us) service_pool.cc:224] Handling call
0709 13:07:16.252225 (+2611213us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54001b1f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.252360 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214072192}
W20260709 13:07:16.246717 21224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2236) took 4578 ms (client timeout 2244 ms). Trace:
I20260709 13:07:16.247226 21809 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:16.248843 21806 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:16.250679 23634 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.254245 21297 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:16.598320 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.407804 23658 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:16.587990 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:16.726390 23658 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:16.416817 23678 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:07:16.590612 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.586493 23359 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
W20260709 13:07:16.656133 23657 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 13:07:16.252312 21811 pending_rounds.cc:107] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:16.730746 21811 raft_consensus.cc:2889] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.730422 23657 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.384550 23643 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.731791 23643 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:16.267489 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.732658 23643 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.656623 23530 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.734441 23530 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.253610 23663 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.149682 23635 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.735683 23663 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.736181 21808 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:16.737210 23530 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.648277 23458 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.824306 23458 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.631933 23519 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.737957 23635 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.338629 21296 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:16.738660 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 739) took 1027 ms. Trace:
W20260709 13:07:16.263998 21812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 731) took 2291 ms (client timeout 2238 ms). Trace:
W20260709 13:07:16.253883 21224 rpcz_store.cc:269] 0709 13:07:11.668189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.668311 (+   122us) service_pool.cc:224] Handling call
0709 13:07:16.246449 (+4578138us) spinlock_profiling.cc:243] Waited 4.38 s on lock 0x7b54000ed3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.246565 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10072568576}
W20260709 13:07:16.828146 21812 rpcz_store.cc:269] 0709 13:07:13.973108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.998301 (+ 25193us) service_pool.cc:224] Handling call
0709 13:07:16.263805 (+2265504us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400788cd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.263925 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444632960}
I20260709 13:07:16.739315 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 716) took 3051 ms. Trace:
I20260709 13:07:16.334205 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.833184 21295 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:16.740253 23656 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.740356 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 834) took 1572 ms. Trace:
I20260709 13:07:16.340523 23538 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:16.725299 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.839073 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:16.733784 23643 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.252741 21807 rpcz_store.cc:276] 0709 13:07:15.192226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.256610 (+ 64384us) service_pool.cc:224] Handling call
0709 13:07:16.252086 (+995476us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54005c4ed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.252225 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69152640}
I20260709 13:07:16.741950 23379 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.826969 23519 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:16.289584 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.848031 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.273002 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:16.280097 23622 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.832526 21806 rpcz_store.cc:276] 0709 13:07:13.687593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.083225 (+395632us) service_pool.cc:224] Handling call
0709 13:07:16.248316 (+2165091us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:16.248544 (+   228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.739015 (+490471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.739241 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31425408}
I20260709 13:07:16.851784 23622 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.743510 23625 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:16.254446 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.252406 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.855484 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.856287 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.744302 23621 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.725359 23655 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:16.721140 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 663736us
I20260709 13:07:16.272500 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:16.858973 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.745901 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 520697us
I20260709 13:07:16.859622 21300 raft_consensus.cc:2410] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:07:16.746330 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 664645us
I20260709 13:07:16.860462 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:16.720965 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.861042 21300 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:16.747983 23241 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.749034 23658 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:16.863346 23658 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:16.856958 23635 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.863792 23658 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.864532 23270 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:16.865069 23270 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.865810 23658 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:16.866312 23658 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.735033 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.858420 23538 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.867699 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.758019 21150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1342) took 2567 ms (client timeout 1922 ms). Trace:
I20260709 13:07:16.759460 23544 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:16.761682 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.770366 21049 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:16.775359 23453 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.867045 23270 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.778333 23634 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.779134 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1801) took 1411 ms. Trace:
W20260709 13:07:16.725163 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 2.61812e+06us
I20260709 13:07:16.785385 23608 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:16.807623 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 418) took 1534 ms. Trace:
W20260709 13:07:16.487887 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.814188 23523 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
W20260709 13:07:16.814759 23527 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.829s	user 0.006s	sys 0.003s
I20260709 13:07:16.820750 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 424) took 1540 ms. Trace:
I20260709 13:07:16.733456 23657 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:16.886116 23657 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.886474 23642 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.886533 23657 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.887051 23642 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.835124 21811 rpcz_store.cc:276] 0709 13:07:15.168211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.241077 (+1072866us) service_pool.cc:224] Handling call
0709 13:07:16.241363 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.740120 (+498757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.740306 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.874771 21293 rpcz_store.cc:276] 0709 13:07:15.367666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.370303 (+  2637us) service_pool.cc:224] Handling call
0709 13:07:15.370615 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.424348 (+ 53733us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:15.428771 (+  4423us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.566142 (+137371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.566206 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:15.566257 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.778885 (+1212628us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b540001a754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.778930 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.779073 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":80,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":111871744,"thread_start_us":126008,"threads_started":1,"wal-append.queue_time_us":327354,"wal-append.run_cpu_time_us":1368,"wal-append.run_wall_time_us":1085059}
I20260709 13:07:16.889452 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.890193 21293 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:16.891518 23458 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.892119 23622 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.836432 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.842782 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.844026 23584 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:16.893221 21189 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:16.894961 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.260696 21810 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.848973 21291 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.852886 23498 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:16.856678 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.898494 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:16.899029 21142 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.899605 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:16.900141 21146 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.725049 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:16.861948 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.901062 21814 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:16.830296 21809 rpcz_store.cc:276] 0709 13:07:15.711401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.964470 (+253069us) service_pool.cc:224] Handling call
0709 13:07:16.738599 (+774129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.864315 23635 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.759910 21292 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [3.6-5.7]
W20260709 13:07:16.869478 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.868517 21150 rpcz_store.cc:269] 0709 13:07:14.190274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.190382 (+   108us) service_pool.cc:224] Handling call
0709 13:07:16.757769 (+2567387us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b540031ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.757905 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760108288}
I20260709 13:07:16.902824 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:16.866736 23658 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.776832 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 833) took 1617 ms. Trace:
I20260709 13:07:16.908290 21149 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:16.857582 23359 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.839246 23656 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.907768 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:16.914029 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:16.867692 23538 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.914599 21147 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.867930 21807 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:16.881762 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.862412 23554 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.882165 21298 rpcz_store.cc:276] 0709 13:07:15.273238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.273437 (+   199us) service_pool.cc:224] Handling call
0709 13:07:15.273697 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.313502 (+ 39805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.313549 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.313605 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.313692 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.473288 (+1159596us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54001603d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.807418 (+334130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.807565 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90984320}
I20260709 13:07:16.916222 21142 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:16.916577 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:16.917142 21298 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.915055 23498 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:16.918056 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.918192 23608 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:16.918637 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.919075 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.892501 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.880327 21049 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:16.859463 23625 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.880743 23453 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:16.922576 21049 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 2 to 3, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:16.923928 23554 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.924592 23625 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.925168 21295 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:16.925993 23554 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:16.926550 23554 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:16.927546 21292 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.928650 21298 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:16.929677 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.930729 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.931456 21298 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:16.895568 21296 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:16.858045 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.904019 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:16.904106 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 835) took 1712 ms. Trace:
I20260709 13:07:16.933833 21810 rpcz_store.cc:276] 0709 13:07:15.192027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.260065 (+1068038us) service_pool.cc:224] Handling call
0709 13:07:16.260471 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.896827 (+636356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.904043 (+  7216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.935799 23635 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:16.936393 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:16.905280 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:16.894007 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:16.907763 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:16.938067 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:16.857833 23663 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.911921 21151 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.912986 21809 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.913479 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:16.919488 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.882519 21297 rpcz_store.cc:276] 0709 13:07:15.279830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.309706 (+ 29876us) service_pool.cc:224] Handling call
0709 13:07:16.254067 (+944361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.722566 (+468499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.820503 (+ 97937us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54001b1f50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:16.820680 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170385280}
I20260709 13:07:16.949128 21145 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.908468 21808 rpcz_store.cc:276] 0709 13:07:15.159826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.220578 (+1060752us) service_pool.cc:224] Handling call
0709 13:07:16.221006 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.736597 (+515591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.776558 (+ 39961us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54005136d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:16.776770 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184332544}
I20260709 13:07:16.872179 23544 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.921643 21814 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 3. Ops: []
I20260709 13:07:16.963680 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 740) took 1230 ms. Trace:
I20260709 13:07:16.964015 21814 rpcz_store.cc:276] 0709 13:07:15.733251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.905956 (+1172705us) service_pool.cc:224] Handling call
0709 13:07:16.921471 (+ 15515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.963431 (+ 41960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.963632 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.927176 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:16.964875 21295 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:16.933526 21144 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.909344 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:16.969822 21150 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:16.938431 21143 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.970000 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:16.938503 21293 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:16.970590 21810 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:16.938843 21049 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 5, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 5 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.918695 23498 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:16.920787 21806 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:16.938887 21291 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:16.940626 21292 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:16.879768 23519 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.944146 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:16.921418 23241 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.946223 21147 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:16.955456 21151 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:16.956966 23538 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:16.990727 21151 pending_rounds.cc:85] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 6
I20260709 13:07:16.949204 23554 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.960456 23643 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.896638 23584 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:16.954059 23608 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.948330 23530 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:16.982234 21297 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 3. Ops: []
I20260709 13:07:16.942517 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:16.988637 21149 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:16.958636 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:16.991025 21151 pending_rounds.cc:107] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:16.991652 21293 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.999822 21151 raft_consensus.cc:2889] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.000204 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.000898 21142 raft_consensus.cc:2410] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:07:17.001241 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:16.992615 21300 raft_consensus.cc:2410] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:16.993480 21291 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.994297 21298 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:16.995070 21295 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.990334 21049 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:16.992122 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.007591 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.007222 21049 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 4, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.948597 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 691) took 1438 ms. Trace:
I20260709 13:07:16.974453 21144 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:16.998072 21147 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:17.010924 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.008785 21049 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 4, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.011335 21292 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:16.989032 23458 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.011844 21049 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 6, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 6 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.012477 23680 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.012742 23458 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.013063 23680 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.013321 21049 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:17.013700 23458 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.013991 23680 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.015404 23625 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:16.997401 23241 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.015426 23662 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:17.017489 23241 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.018042 23241 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:17.018376 23241 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:17.018711 23241 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.019268 21807 rpcz_store.cc:276] 0709 13:07:15.510406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.856979 (+1346573us) service_pool.cc:224] Handling call
0709 13:07:16.867582 (+ 10603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.915484 (+ 47902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.937232 (+ 21748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.020452 23544 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:17.021123 21145 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:17.021202 23519 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.023509 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:17.024710 23662 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.026741 21146 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:17.027398 23642 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.027654 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.027979 23642 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.028375 23642 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.028483 21150 raft_consensus.cc:2410] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:17.028748 23642 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.036633 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:16.921075 23359 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.038813 21291 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.014703 21049 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.042225 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.005976 23684 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:16.976758 23622 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:07:16.961405 23663 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.034215 23538 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.054039 21049 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
I20260709 13:07:17.051770 23625 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.058857 23622 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.059422 23622 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.059352 23625 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.060498 23622 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.062038 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:17.040757 23608 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.068255 21049 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.048166 23662 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.070272 23544 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:17.001717 23643 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.078893 23643 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.079937 23544 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.082393 21143 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:17.082528 23544 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.054994 23684 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.088490 23656 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:17.089077 23684 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.089078 23656 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.090210 23656 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.090674 23359 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.091056 23656 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.092334 23656 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.008157 23530 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.091565 23658 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.102924 21811 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.102504 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.104933 21143 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
W20260709 13:07:17.127622 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.104698 21049 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:17.151635 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 150437us
I20260709 13:07:17.153772 21049 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 4 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.155809 21049 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:17.199581 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 340627us
I20260709 13:07:17.204396 23538 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:17.152575 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:07:17.205899 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53433us
I20260709 13:07:17.103715 23621 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.087214 23241 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.213594 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 737) took 1503 ms. Trace:
I20260709 13:07:17.213967 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.214052 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.209757 21049 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.218084 21049 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:17.213997 21811 rpcz_store.cc:276] 0709 13:07:15.710094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.888503 (+1178409us) service_pool.cc:224] Handling call
0709 13:07:16.888791 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.103990 (+215199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.213354 (+109364us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400293954. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:17.213536 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432456960}
I20260709 13:07:17.221065 21049 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:17.148437 23359 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.148567 23662 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:17.263945 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:17.245725 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 377064us
I20260709 13:07:17.266989 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.267588 21224 raft_consensus.cc:2376] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5. Re-sending same reply.
I20260709 13:07:17.270344 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.273898 21225 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:17.277266 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.279239 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.223152 23657 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:17.290970 21217 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:17.291110 21224 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:17.292454 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 327348us
W20260709 13:07:17.287387 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 430137us
I20260709 13:07:17.296574 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:17.248049 23538 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.288465 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:17.300359 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:17.310946 21151 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.267072 23684 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.280146 23685 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.223884 23621 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.265506 23359 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:17.296846 23608 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:17.297791 23538 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:17.380730 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.039s	sys 0.082s
W20260709 13:07:17.436012 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.040s	sys 0.082s
W20260709 13:07:17.436300 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 593365us
I20260709 13:07:17.394564 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:17.424208 23682 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:07:17.367988 23700 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.425693 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.426846 23584 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.427274 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.427435 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.333225 23657 raft_consensus.cc:2764] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:07:17.429025 21226 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:17.437402 21147 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.322956 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.447007 23538 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:17.451118 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:17.361742 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.350548 23684 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.468247 21225 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
W20260709 13:07:17.887476 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.004s
I20260709 13:07:17.506711 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:17.903461 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 603164us
I20260709 13:07:17.907938 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:17.665786 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.904842 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.005s	sys 0.004s
W20260709 13:07:17.910591 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 695693us
W20260709 13:07:17.470161 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.916844 21150 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:17.551592 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 277944us
I20260709 13:07:17.919382 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2194) took 1164 ms. Trace:
I20260709 13:07:17.919862 21299 rpcz_store.cc:276] 0709 13:07:16.755329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.755451 (+   122us) service_pool.cc:224] Handling call
0709 13:07:16.755821 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.050861 (+295040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.050910 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.053949 (+  3039us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.267365 (+213416us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:17.267402 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.267478 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.919138 (+651660us) raft_consensus.cc:1685] finished
0709 13:07:17.919158 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.919316 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55851,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"thread_start_us":402611,"threads_started":2,"wal-append.queue_time_us":818009}
I20260709 13:07:17.924959 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.925220 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:17.925724 21150 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.927075 21145 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:17.797830 23530 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:17.817490 23241 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.777536 21223 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.928781 21145 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:17.817164 23663 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:17.930115 21145 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.816387 23359 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:17.930529 21145 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:17.931388 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:17.931453 21145 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:17.932386 21145 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:17.938488 21805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.007s	sys 0.007s
W20260709 13:07:17.939100 21805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.007s	sys 0.007s
W20260709 13:07:17.939612 21812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.004s	sys 0.008s
W20260709 13:07:17.940065 21812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.004s	sys 0.009s
I20260709 13:07:17.940574 21217 raft_consensus.cc:2376] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3. Re-sending same reply.
I20260709 13:07:17.940083 23685 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:17.544721 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.942360 23706 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.942941 23706 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:17.945096 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:17.490463 23658 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.650506 23680 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.946981 23680 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.949045 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:17.949985 23686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.004s
W20260709 13:07:17.950397 23686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.003s	sys 0.004s
I20260709 13:07:17.572095 23701 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.951642 23701 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:17.952072 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.953745 23701 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:17.953209 21150 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:17.954515 23498 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:17.957010 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 520152us
W20260709 13:07:17.957773 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.959987 23270 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.960500 23498 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:17.961037 23692 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.963563 23693 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:17.786068 23656 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.000s
I20260709 13:07:17.967098 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:17.973974 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.942021 23685 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.006682 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:17.975036 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:17.975087 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63925.5us
W20260709 13:07:17.976285 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 68440us
I20260709 13:07:17.949143 23680 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:18.007248 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 331346us
I20260709 13:07:18.007699 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.010329 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.010547 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.010949 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.012974 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:17.996017 21145 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:18.015981 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.964669 23270 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:18.017784 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:17.570637 23704 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.513829 23554 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.022608 21145 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:18.012202 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.025679 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.027462 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:18.028298 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.002539 23701 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.001348 23694 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.003873 23700 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:18.028970 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:18.030220 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:18.028786 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.009s	sys 0.004s
W20260709 13:07:18.043471 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 124308us
I20260709 13:07:18.020727 23699 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:18.036118 21145 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:18.036422 21263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.002s	sys 0.012s
W20260709 13:07:18.046929 21263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.002s	sys 0.012s
W20260709 13:07:18.038723 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.020421 23657 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.028597 23692 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:18.044587 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.009s	sys 0.004s
W20260709 13:07:18.035202 21813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.006s	sys 0.008s
I20260709 13:07:18.003316 23359 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:17.453018 23608 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:17.552479 23662 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.032016 23698 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:18.087196 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 790649us
I20260709 13:07:18.003407 23498 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:18.047307 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 620142us
I20260709 13:07:18.097252 21226 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:18.087124 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.098397 23498 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.098955 23498 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.032855 23538 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.099457 23498 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.101537 23498 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.103559 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:18.087769 21813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.010s	sys 0.008s
W20260709 13:07:18.088339 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 59461.3us
I20260709 13:07:18.034264 23554 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.104532 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:18.105480 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 837) took 2912 ms. Trace:
W20260709 13:07:18.105700 21263 leader_election.cc:336] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.548s (SENT)
I20260709 13:07:18.106230 21263 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:18.033902 23658 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:18.095359 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.050129 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.105794 21813 rpcz_store.cc:276] 0709 13:07:15.192879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.727601 (+1534722us) service_pool.cc:224] Handling call
0709 13:07:16.727969 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.728194 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:16.951737 (+223543us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.105156 (+1153419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.105204 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.105265 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.105325 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.105426 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14972,"prepare.queue_time_us":244800,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":705940,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8706,"spinlock_wait_cycles":3701632,"thread_start_us":1375782,"threads_started":3,"wal-append.queue_time_us":1076748}
I20260709 13:07:18.107185 23658 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:18.107930 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 60012.6us
I20260709 13:07:18.108738 21116 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:18.110049 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:18.059415 23642 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.030s	user 0.009s	sys 0.003s
I20260709 13:07:18.114517 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:18.115126 21150 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.116464 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:18.117060 21147 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5. Re-sending same reply.
I20260709 13:07:18.117888 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.118619 21224 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.119123 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.119375 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.120277 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.120357 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.121330 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.122462 21222 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.017778 23693 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.122988 21150 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:18.123471 23691 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.124789 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.147545 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.136248 21222 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:18.150995 21147 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:18.131162 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:18.136656 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.125249 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.131213 21145 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:18.125685 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 98312.8us
I20260709 13:07:18.157374 21144 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:18.157977 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:18.159935 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.161662 21147 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:18.108165 23698 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:18.162549 21150 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:18.163319 21778 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.087109 23657 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.114687 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.165860 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.170670 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.113788 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 838) took 2837 ms. Trace:
I20260709 13:07:18.167620 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.199915 21150 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:18.200465 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.109236 23635 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.202054 21144 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:18.167992 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.113721 23706 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.205117 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:18.032960 23704 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.112725 23241 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:07:18.241183 21147 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:18.165366 23523 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.123812 23710 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.242199 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.056995 23699 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:18.251353 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.130685 23359 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.254551 23698 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.255894 23453 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.255723 23710 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.152199 23686 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.254244 23523 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.201820 23657 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.165215 23712 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:18.284148 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.234405 21218 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:18.287283 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123874us
I20260709 13:07:18.126921 23656 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:18.292162 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.241662 23527 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.207154 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.255756 23714 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.281494 23359 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.205346 23727 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.244429 23719 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.244015 23680 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.315841 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.258051 23706 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.128151 23642 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:18.292528 21143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.006s
I20260709 13:07:18.307101 21222 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:18.351052 21143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.004s	sys 0.006s
W20260709 13:07:18.339116 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.351791 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.319195 21217 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:18.351998 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.352981 21222 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:18.327440 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 162555us
I20260709 13:07:18.353744 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.354322 21222 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:18.355237 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:18.350549 21263 leader_election.cc:336] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.591s (SENT)
I20260709 13:07:18.356658 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:18.358048 21263 leader_election.cc:336] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.665s (SENT)
I20260709 13:07:18.291452 23712 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:18.358578 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:18.291934 23686 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.361588 21263 leader_election.cc:336] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.668s (SENT)
I20260709 13:07:18.366559 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:18.367662 21263 leader_election.cc:336] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.733s (SENT)
I20260709 13:07:18.368115 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:18.363363 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 126053us
I20260709 13:07:18.347437 23359 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.333801 23684 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.241248 23658 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.335183 23698 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.351006 23715 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.291357 23453 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.317799 23709 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:18.358548 23702 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:07:18.363404 23554 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:18.390453 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.397578 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.398005 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.331679 23724 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.360458 23711 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.349362 23714 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.350032 23725 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.364785 23686 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.356067 23270 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:18.391868 23690 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:07:18.394136 23684 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.394480 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.389554 23708 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.439842 23708 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:18.257062 23700 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.392306 23727 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.393523 23729 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.412004 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44360.2us
I20260709 13:07:18.427088 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:18.448962 21263 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.798s (SENT)
I20260709 13:07:18.449365 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:18.426169 21146 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:07:18.482048 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 164017us
I20260709 13:07:18.394207 23709 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.381492 23723 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:18.397939 23715 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:18.362532 23706 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.497184 23706 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.436579 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.498392 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.462649 23684 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.441263 23712 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:18.463207 23729 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.483412 23642 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.360993 23719 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.422345 23608 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:18.460861 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49150.9us
I20260709 13:07:18.483605 23699 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.445859 23711 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:18.400651 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45479.7us
I20260709 13:07:18.441738 23730 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:18.489126 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 331203us
I20260709 13:07:18.581079 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:18.581082 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.582013 21811 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:18.493819 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.494695 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.391563 23735 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:07:18.503451 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.204994 21805 rpcz_store.cc:276] 0709 13:07:15.276773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.745389 (+1468616us) service_pool.cc:224] Handling call
0709 13:07:16.745711 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.745930 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:17.204789 (+458859us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003bfec0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf
0709 13:07:17.204983 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.045016 (+840033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.046832 (+  1816us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.063969 (+ 17137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.093499 (+ 29530us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.111589 (+ 18090us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103860,"prepare.queue_time_us":293105,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":148617,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16891,"spinlock_wait_cycles":6058880,"thread_start_us":1027315,"threads_started":2,"wal-append.queue_time_us":822672}
I20260709 13:07:18.574167 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:18.499888 23720 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:07:18.460377 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.499125 21221 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.585033 21300 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:18.599578 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:18.600060 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.598664 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.600780 21300 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:18.601105 21295 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:18.601624 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.598452 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.602181 21300 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:18.602381 21813 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:18.598932 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 138616us
I20260709 13:07:18.588528 21298 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:18.588595 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:18.590914 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:18.605109 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.591667 23523 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.592581 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.593762 21299 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:18.586908 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:18.500888 23716 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:07:18.616853 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.593158 23711 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.600090 21296 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.604055 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.586072 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.604987 23241 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.591076 23704 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.603057 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.499058 23657 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.490054 23709 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.488093 23693 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.504145 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.611441 23680 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:18.611105 21117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.020s
I20260709 13:07:18.614365 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.612701 23727 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.618640 21811 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.615721 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1668) took 1312 ms. Trace:
I20260709 13:07:18.500593 23710 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.620265 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.504547 23714 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.647459 21807 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:18.648438 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.649751 23729 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.658345 21808 raft_consensus.cc:2410] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:18.659409 23453 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.659761 21808 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:18.661548 21808 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:18.613390 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.668502 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.669171 21218 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:18.595613 23706 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:18.670058 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.657858 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.676019 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 345) took 1226 ms. Trace:
I20260709 13:07:18.676458 21225 rpcz_store.cc:276] 0709 13:07:17.449638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.657611 (+1207973us) service_pool.cc:224] Handling call
0709 13:07:18.675948 (+ 18337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:18.677559 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.678627 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.612592 23739 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.679536 23739 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.682161 23739 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.627686 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.683709 21223 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.685015 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.686046 21223 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.623463 23711 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.624711 23625 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.691764 23625 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.693846 23625 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.694473 23657 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:18.695196 21292 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:18.500056 23715 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.629987 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:18.696350 21809 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.702190 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.616400 23663 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.708937 23663 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.712580 23523 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.713229 23523 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:18.713750 23523 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:18.622282 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.624696 21300 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:18.625406 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.626371 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:18.598670 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 176020us
W20260709 13:07:18.725723 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 100375us
I20260709 13:07:18.725944 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.471891 23708 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:18.730090 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.625025 23241 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.605559 23724 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:18.631068 21117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.000s	sys 0.020s
I20260709 13:07:18.597148 23742 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.631305 21298 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:18.737584 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.738714 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.612934 23712 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.618883 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.746532 21296 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:18.747504 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.687143 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.643653 21297 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:18.640619 21294 raft_consensus.cc:2410] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:18.728663 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:18.656898 23719 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.628927 23684 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.733614 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.735733 23241 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.732753 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.744154 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.751288 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.632316 23700 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.765307 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.733078 23693 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.737042 23740 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 13:07:18.643213 21143 rpcz_store.cc:276] 0709 13:07:17.303126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.471389 (+168263us) service_pool.cc:224] Handling call
0709 13:07:17.657535 (+186146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.657791 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:18.351483 (+693692us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.615407 (+263924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.615457 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.615505 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.615565 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.615670 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":731705,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":29755,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":6436,"spinlock_wait_cycles":30096512,"thread_start_us":867199,"threads_started":3,"wal-append.queue_time_us":67976}
I20260709 13:07:18.774644 21151 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:18.776304 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.740196 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.793212 21291 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:18.779448 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:18.794019 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:18.794893 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 50827.4us
I20260709 13:07:18.780138 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.683005 23686 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.733454 23727 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:18.743963 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.784637 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:18.800185 23739 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.803709 23750 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.632417 23725 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:07:18.814884 23750 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.784160 23697 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:18.745702 23657 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.796777 21296 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:18.796859 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.784108 23706 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.649782 21807 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEARNER]: Advancing to term 4
W20260709 13:07:18.783936 23701 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.000s
I20260709 13:07:18.758731 23608 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:18.758404 23643 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.764109 23742 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:18.791376 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.776677 23730 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.777161 23684 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:18.776495 23722 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:18.771626 23721 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:18.784341 23719 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.783895 23708 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.797079 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.798697 21150 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:18.798815 21145 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:18.874656 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:18.875026 21225 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.875368 21296 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.875619 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.800413 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.798733 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.876579 21143 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:18.788370 21297 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:18.799374 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.839146 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.877610 21149 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:18.799921 23663 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.863000 21116 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:18.837750 23707 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:18.841207 23735 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:18.813361 23727 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:18.860790 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.803453 23685 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.800164 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.811833 23745 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.877071 21142 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:18.861865 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.813786 21809 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:18.882747 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.794818 23693 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.883229 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.883563 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.864717 23701 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.865824 23730 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.792250 23700 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:18.894114 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 110021us
I20260709 13:07:18.795030 23741 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:18.895614 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:18.871747 23684 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.931124 21225 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:18.867367 23643 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:18.915321 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:18.882912 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.919741 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.935318 21143 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:18.881115 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.914520 23642 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.924340 21296 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:18.919274 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 81417.7us
I20260709 13:07:18.870105 21806 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:18.926143 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.927304 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:18.933681 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:18.892596 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.825592 23680 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:18.909521 23694 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.008s
I20260709 13:07:18.967947 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.968402 23694 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.930150 23453 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:18.968784 21806 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:18.938378 21300 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:18.940469 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:18.909667 23735 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.921103 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:18.969897 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.881500 23719 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.963734 21291 raft_consensus.cc:2376] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2. Re-sending same reply.
I20260709 13:07:18.932739 23697 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:18.964833 23752 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:07:18.978128 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.979884 21294 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:18.980015 23742 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.913542 23685 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:18.983637 23643 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.984411 21142 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:18.929885 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.979444 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:18.984987 23685 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:18.868321 23706 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:18.919519 21148 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:18.969831 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.931015 23730 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.967885 23686 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.971728 21145 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:18.937673 21221 raft_consensus.cc:2368] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:18.963589 21144 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:18.974691 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:18.975288 23695 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:18.975366 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.032363 21809 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:19.033027 23763 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.033501 23735 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.033629 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:18.976836 23758 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.035126 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.036432 21809 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:19.037528 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.038239 21809 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:19.039186 23706 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.039287 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.040170 21809 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:18.985410 21299 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:18.985903 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:19.041956 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:19.042092 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:19.042594 21299 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:18.962060 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.043892 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.044272 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.045279 21225 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:18.968611 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.047462 21808 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:19.048435 23719 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:18.962702 23530 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.973285 23697 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:19.062892 23359 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.003s
I20260709 13:07:19.063459 23359 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.063880 23697 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.065609 23697 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.066012 23359 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.003818 23750 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:19.068624 23751 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:07:19.072388 23693 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.073042 23693 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.073559 23693 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:19.075022 23754 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:07:19.077335 23691 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.006s
I20260709 13:07:19.077917 23691 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.078907 21806 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:18.963333 23622 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:19.058764 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:19.086205 21291 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:19.044278 23709 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:19.006009 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:19.042614 21296 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:19.184543 21296 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:19.046398 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:18.986282 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:19.000243 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:19.186147 21143 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:19.050149 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:19.048782 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.058580 23530 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.058826 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:19.041301 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.059734 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:19.200883 21144 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.061468 23695 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:19.061820 23700 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:19.191768 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 185854us
W20260709 13:07:19.196285 23662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.002s	sys 0.009s
W20260709 13:07:19.198626 21263 leader_election.cc:336] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.923s (SENT)
W20260709 13:07:19.199088 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 149039us
I20260709 13:07:19.199312 21296 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:19.203117 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 216887us
W20260709 13:07:19.197278 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 264370us
I20260709 13:07:19.059782 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.033506 23763 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.293167 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.332710 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.205796 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:19.315644 21220 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:19.333732 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:19.258059 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.337016 21225 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 2: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:19.338207 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:19.338269 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.339035 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:19.191212 23359 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:19.197752 23721 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.194s
W20260709 13:07:19.425755 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 92278.2us
W20260709 13:07:19.351191 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 152583us
I20260709 13:07:19.656149 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:19.659340 21263 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.931s (SENT)
I20260709 13:07:19.200613 23722 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:19.425482 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 92348us
W20260709 13:07:19.332582 23662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.002s	sys 0.015s
I20260709 13:07:19.628547 21144 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:19.197815 23530 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.399863 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 839) took 4112 ms. Trace:
I20260709 13:07:19.659759 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:19.660332 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 322200us
I20260709 13:07:19.658033 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:19.721573 21263 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.974s (SENT)
I20260709 13:07:19.202785 23691 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.761446 21263 leader_election.cc:336] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.997s (SENT)
I20260709 13:07:19.203521 23706 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:19.395908 23523 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.000s
I20260709 13:07:19.257640 23729 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:19.400022 23711 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
W20260709 13:07:19.362392 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.785033 21296 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:19.762763 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1337) took 1088 ms. Trace:
I20260709 13:07:19.762099 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:19.789666 21225 rpcz_store.cc:276] 0709 13:07:18.674511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.352660 (+678149us) service_pool.cc:224] Handling call
0709 13:07:19.762698 (+410038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.346089 23701 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.398625 23693 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:19.398339 23527 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:19.400822 23657 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:19.659466 23766 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.282469 23241 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.794927 21144 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:19.768118 23727 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.785106 21812 rpcz_store.cc:276] 0709 13:07:15.287907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.829419 (+1541512us) service_pool.cc:224] Handling call
0709 13:07:16.829789 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.940483 (+1110694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.940512 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.943584 (+  3072us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.032548 (+ 88964us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.032591 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.399493 (+1366902us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b540035aa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:19.399541 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.399588 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:19.399602 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.399799 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14945,"raft.queue_time_us":23771,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":66485632,"thread_start_us":1169200,"threads_started":2,"wal-append.queue_time_us":309355,"wal-append.run_cpu_time_us":8874,"wal-append.run_wall_time_us":1385498}
I20260709 13:07:19.336366 23763 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.654654 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.385717 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:19.744755 23722 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:19.761504 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:19.628271 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 842) took 1005 ms. Trace:
I20260709 13:07:19.397542 23759 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:19.744431 23717 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.374747 23658 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.768412 23771 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:07:19.205752 21218 raft_consensus.cc:2376] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4. Re-sending same reply.
I20260709 13:07:19.786285 23729 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.807042 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.837792 21812 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:19.808619 23692 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.790247 23706 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.398120 21143 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:19.793650 23711 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:19.818527 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 57093.2us
I20260709 13:07:19.821555 23722 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.810351 23766 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.827502 21808 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.821373 21805 rpcz_store.cc:276] 0709 13:07:18.613851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.616813 (+  2962us) service_pool.cc:224] Handling call
0709 13:07:19.318966 (+702153us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:19.319188 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.319419 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.333665 (+ 14246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.347203 (+ 13538us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.384793 (+ 37590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.396355 (+ 11562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.619410 (+223055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3141504}
I20260709 13:07:19.848595 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:19.825286 23750 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.851577 23750 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:19.852093 23750 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.853168 23711 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:19.853761 23763 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:19.667325 23359 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.855412 23709 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:19.855990 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1332) took 1183 ms. Trace:
I20260709 13:07:19.856246 23763 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:19.856401 21218 rpcz_store.cc:276] 0709 13:07:18.673004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.002113 (+329109us) service_pool.cc:224] Handling call
0709 13:07:19.855924 (+853811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.857003 23763 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.857622 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.857761 23763 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.858731 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1344) took 1070 ms. Trace:
I20260709 13:07:19.860055 23763 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:19.862833 23708 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.000s
I20260709 13:07:19.816455 23727 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.872004 23727 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.873713 21808 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:19.874446 23697 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.003s
I20260709 13:07:19.866398 23530 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.875370 23706 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.877034 23530 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:19.796504 23701 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:19.883508 23701 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.824101 21144 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:19.887856 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1693) took 1018 ms. Trace:
I20260709 13:07:19.888262 21144 rpcz_store.cc:276] 0709 13:07:18.869120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.805062 (+935942us) service_pool.cc:224] Handling call
0709 13:07:19.823881 (+ 18819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.887503 (+ 63622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.887788 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.889951 21144 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:19.296689 23684 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:19.893105 23684 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:19.803774 23657 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.803658 23527 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.785868 23691 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:19.808373 21807 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.946s	user 0.010s	sys 0.001s
I20260709 13:07:19.896950 21807 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:19.897432 23691 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:19.897735 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 846) took 1281 ms. Trace:
I20260709 13:07:19.898183 21805 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.899435 21298 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:19.836855 23771 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.627926 23730 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.900179 23771 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:19.900710 23771 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.791612 23523 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.901959 23730 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.903146 21297 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:19.839377 23729 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.903828 23523 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.398998 23695 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.905135 23717 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.905781 23717 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.838784 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:19.907233 21812 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:19.910495 21150 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:19.807567 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:19.911465 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1341) took 1172 ms. Trace:
I20260709 13:07:19.911841 21225 rpcz_store.cc:276] 0709 13:07:18.739181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.797678 (+1058497us) service_pool.cc:224] Handling call
0709 13:07:19.911395 (+113717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.912949 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:19.913798 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1347) took 1111 ms. Trace:
I20260709 13:07:19.914171 21225 rpcz_store.cc:276] 0709 13:07:18.802903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.912625 (+1109722us) service_pool.cc:224] Handling call
0709 13:07:19.913737 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.846994 23766 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.857048 23359 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:19.917050 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 260982us
I20260709 13:07:19.920434 23621 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:19.867540 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.838318 23741 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.829553 23759 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:19.835392 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1340) took 1160 ms. Trace:
I20260709 13:07:19.868928 23241 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:19.898272 21807 rpcz_store.cc:276] 0709 13:07:18.615845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.649392 (+ 33547us) service_pool.cc:224] Handling call
0709 13:07:18.649657 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.897392 (+1247735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.897651 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.875309 21808 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:07:19.951411 21808 pending_rounds.cc:85] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:19.952709 21808 pending_rounds.cc:107] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:19.953724 21808 raft_consensus.cc:2889] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.957948 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 701) took 1150 ms. Trace:
I20260709 13:07:19.958462 21808 rpcz_store.cc:276] 0709 13:07:18.807251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.874540 (+1067289us) service_pool.cc:224] Handling call
0709 13:07:19.874889 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.957628 (+ 82739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.957879 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.960698 21808 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:19.961714 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 755) took 1018 ms. Trace:
I20260709 13:07:19.962708 21808 rpcz_store.cc:276] 0709 13:07:18.943676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.960224 (+1016548us) service_pool.cc:224] Handling call
0709 13:07:19.960517 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.961484 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.961664 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.940249 23766 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:07:19.977247 23723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.013s	sys 0.039s
W20260709 13:07:19.984195 23723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.013s	sys 0.039s
I20260709 13:07:20.001098 23722 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.005643 23771 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.013299 23759 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.015192 23764 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.015640 23764 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.016304 23764 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.017279 23764 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:07:20.051159 21114 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.801s	user 0.037s	sys 0.082s
I20260709 13:07:20.051162 21143 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.053682 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1696) took 1139 ms. Trace:
I20260709 13:07:20.054203 21143 rpcz_store.cc:276] 0709 13:07:18.914042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.841418 (+927376us) service_pool.cc:224] Handling call
0709 13:07:20.050463 (+209045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.053190 (+  2727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.053550 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.054968 21145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 503) took 1252 ms (client timeout 1541 ms). Trace:
W20260709 13:07:20.056053 21145 rpcz_store.cc:269] 0709 13:07:18.802851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.875373 (+ 72522us) service_pool.cc:224] Handling call
0709 13:07:20.054511 (+1179138us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540017c354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.054754 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219525504}
I20260709 13:07:20.059561 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 501) took 1257 ms. Trace:
I20260709 13:07:20.060046 21150 rpcz_store.cc:276] 0709 13:07:18.802387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.927037 (+124650us) service_pool.cc:224] Handling call
0709 13:07:20.059029 (+1131992us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000857d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.059327 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176934784}
I20260709 13:07:20.065678 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1677) took 2141 ms. Trace:
W20260709 13:07:20.069257 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 133205us
W20260709 13:07:19.926724 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 249422us
W20260709 13:07:20.069666 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.070174 21223 rpcz_store.cc:276] 0709 13:07:18.733021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.654183 (+921162us) service_pool.cc:224] Handling call
0709 13:07:19.835314 (+181131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.072122 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 454) took 1470 ms. Trace:
I20260709 13:07:20.072029 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.073022 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1821) took 1461 ms. Trace:
I20260709 13:07:20.007797 23717 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:20.075793 21300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2226) took 1452 ms (client timeout 1616 ms). Trace:
W20260709 13:07:20.077087 21217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1300) took 2068 ms (client timeout 1798 ms). Trace:
W20260709 13:07:20.078413 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1302) took 2069 ms (client timeout 1548 ms). Trace:
I20260709 13:07:19.859182 21218 rpcz_store.cc:276] 0709 13:07:18.788345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.857319 (+1068974us) service_pool.cc:224] Handling call
0709 13:07:19.858655 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.073982 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1810) took 1489 ms. Trace:
I20260709 13:07:20.197564 23771 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.199748 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 845) took 1584 ms. Trace:
I20260709 13:07:20.200186 21814 rpcz_store.cc:276] 0709 13:07:18.615367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.615503 (+   136us) service_pool.cc:224] Handling call
0709 13:07:18.630173 (+ 14670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.707582 (+ 77409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.707633 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.707694 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.707741 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.119241 (+1411500us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b54003c3554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.119849 (+   608us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.199537 (+ 79688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177309568}
I20260709 13:07:20.116317 21222 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:20.116571 21114 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.866s	user 0.037s	sys 0.085s
I20260709 13:07:20.203223 21151 rpcz_store.cc:276] 0709 13:07:17.923832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.923932 (+   100us) service_pool.cc:224] Handling call
0709 13:07:17.924166 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.796046 (+871880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.063400 (+1267354us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54000c33a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7da02 00007f2b6dd79dd6 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:20.065261 (+  1861us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400215054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.065515 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004490368}
I20260709 13:07:20.118508 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 695) took 1320 ms. Trace:
I20260709 13:07:20.086187 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 499) took 1286 ms. Trace:
I20260709 13:07:20.137557 21292 rpcz_store.cc:276] 0709 13:07:18.584266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.584381 (+   115us) service_pool.cc:224] Handling call
0709 13:07:18.600394 (+ 16013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.695667 (+ 95273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.073313 (+1377646us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b5400328554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.073777 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217380096}
I20260709 13:07:20.213526 21806 rpcz_store.cc:276] 0709 13:07:18.805334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.043627 (+238293us) service_pool.cc:224] Handling call
0709 13:07:20.117956 (+1074329us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54004fa1d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.118212 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78847872}
I20260709 13:07:20.216259 23729 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.102949 23750 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:20.203481 21217 rpcz_store.cc:269] 0709 13:07:18.008292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.050834 (+ 42542us) service_pool.cc:224] Handling call
0709 13:07:20.076609 (+2025775us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400116554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.076801 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487422848}
W20260709 13:07:20.202934 21300 rpcz_store.cc:269] 0709 13:07:18.623330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.725718 (+102388us) service_pool.cc:224] Handling call
0709 13:07:20.075395 (+1349677us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400327b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.075581 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486814976}
W20260709 13:07:20.085101 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 323518us
I20260709 13:07:20.196727 21296 rpcz_store.cc:276] 0709 13:07:18.611519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.349960 (+738441us) service_pool.cc:224] Handling call
0709 13:07:19.350327 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.787732 (+437405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.072347 (+284615us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54003af554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.072796 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998944640}
W20260709 13:07:20.137522 21226 rpcz_store.cc:269] 0709 13:07:18.008875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.012170 (+  3295us) service_pool.cc:224] Handling call
0709 13:07:20.077953 (+2065783us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b540035b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.078200 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156943744}
I20260709 13:07:20.105867 23722 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.112697 23739 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.083040 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:20.088687 21807 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:20.214522 21142 rpcz_store.cc:276] 0709 13:07:18.799523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.928818 (+129295us) service_pool.cc:224] Handling call
0709 13:07:18.929127 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.984750 (+ 55623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.085568 (+1100818us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400180bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.085958 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126356736}
I20260709 13:07:20.112283 23759 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.112253 23780 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.238509 23715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.010s	sys 0.017s
W20260709 13:07:20.239091 23715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.540s	user 0.010s	sys 0.017s
I20260709 13:07:20.240442 21294 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.241209 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1822) took 1629 ms. Trace:
I20260709 13:07:20.241716 21294 rpcz_store.cc:276] 0709 13:07:18.611813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.238947 (+1627134us) service_pool.cc:224] Handling call
0709 13:07:20.239695 (+   748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.240922 (+  1227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.241120 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.244524 23750 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.249388 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2225) took 1626 ms. Trace:
I20260709 13:07:20.249840 21299 rpcz_store.cc:276] 0709 13:07:18.623066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.247969 (+1624903us) service_pool.cc:224] Handling call
0709 13:07:20.248466 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.248889 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.248921 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.248977 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:20.249020 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.249081 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.249192 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.256346 21225 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:20.104794 23706 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:20.254212 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 2.00411e+06us
I20260709 13:07:20.260499 23739 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.267868 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:20.268199 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1679) took 2343 ms (client timeout 2173 ms). Trace:
W20260709 13:07:20.268632 23656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.865s	user 0.013s	sys 0.041s
W20260709 13:07:20.276466 23656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.914s	user 0.013s	sys 0.042s
I20260709 13:07:20.276872 23656 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:20.278759 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1809) took 1696 ms. Trace:
I20260709 13:07:20.259059 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 458) took 1604 ms. Trace:
I20260709 13:07:20.272384 23780 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.279232 21293 rpcz_store.cc:276] 0709 13:07:18.582519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.583527 (+  1008us) service_pool.cc:224] Handling call
0709 13:07:18.583794 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.630597 (+ 46803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.630624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.718454 (+ 87830us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.781530 (+ 63076us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.781587 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.277995 (+1496408us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54003d3bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.278104 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.278206 (+   102us) raft_consensus.cc:1685] finished
0709 13:07:20.278221 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.278568 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2596,"raft.queue_time_us":2830,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":60404,"spinlock_wait_cycles":100737920,"thread_start_us":22169,"threads_started":1,"wal-append.queue_time_us":44693,"wal-append.run_cpu_time_us":1542,"wal-append.run_wall_time_us":1001557}
W20260709 13:07:20.271004 21297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 455) took 1647 ms (client timeout 2160 ms). Trace:
W20260709 13:07:20.281761 21297 rpcz_store.cc:269] 0709 13:07:18.623461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.882973 (+259512us) service_pool.cc:224] Handling call
0709 13:07:20.270494 (+1387521us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54003afa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.270780 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274851712}
I20260709 13:07:20.282748 21293 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:07:20.271935 21146 rpcz_store.cc:269] 0709 13:07:17.924893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.925000 (+   107us) service_pool.cc:224] Handling call
0709 13:07:20.267616 (+2342616us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400214b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.267973 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094995840}
I20260709 13:07:20.274144 23739 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.114619 23781 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
I20260709 13:07:20.275804 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1342) took 1517 ms. Trace:
I20260709 13:07:20.307435 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1828) took 1563 ms. Trace:
I20260709 13:07:20.279493 21296 rpcz_store.cc:276] 0709 13:07:18.654906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.257314 (+1602408us) service_pool.cc:224] Handling call
0709 13:07:20.257992 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.258488 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.258536 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.258618 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.258744 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.258821 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.258980 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.296329 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1327) took 1664 ms. Trace:
I20260709 13:07:20.284909 23771 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.270938 23729 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:20.297784 21220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1307) took 2248 ms (client timeout 2145 ms). Trace:
I20260709 13:07:20.318688 21225 rpcz_store.cc:276] 0709 13:07:18.631713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.929056 (+1297343us) service_pool.cc:224] Handling call
0709 13:07:20.296201 (+367145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.300375 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 494) took 1502 ms. Trace:
I20260709 13:07:20.300657 23741 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:20.301119 23270 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.301465 23722 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:20.301980 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:20.304296 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 509) took 1182 ms. Trace:
I20260709 13:07:20.306504 21805 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:20.204033 21291 rpcz_store.cc:276] 0709 13:07:18.601935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.259067 (+657132us) service_pool.cc:224] Handling call
0709 13:07:19.259499 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.259967 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.260006 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.374484 (+114478us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.936896 (+562412us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.936954 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.937044 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.071449 (+134405us) raft_consensus.cc:1685] finished
0709 13:07:20.071516 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.071872 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":789,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":20180,"thread_start_us":277088,"threads_started":1,"wal-append.queue_time_us":336604}
I20260709 13:07:20.278604 23656 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.284072 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1825) took 1556 ms. Trace:
I20260709 13:07:20.317373 21299 rpcz_store.cc:276] 0709 13:07:18.739502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.301840 (+1562338us) service_pool.cc:224] Handling call
0709 13:07:20.302336 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.302848 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:20.302887 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.302948 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.302996 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.303065 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.303196 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.283172 21293 pending_rounds.cc:85] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 5
I20260709 13:07:20.281451 23780 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.285320 23731 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:20.283016 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 352) took 2625 ms. Trace:
I20260709 13:07:20.255610 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 754) took 1342 ms. Trace:
I20260709 13:07:20.331827 23270 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.332175 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2279) took 2085 ms. Trace:
I20260709 13:07:20.114044 23757 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:07:20.328538 21147 rpcz_store.cc:276] 0709 13:07:18.797997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.798788 (+   791us) service_pool.cc:224] Handling call
0709 13:07:18.799107 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.799377 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.196803 (+397426us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.491842 (+295039us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.299354 (+807512us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b180034c480. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:07:20.299681 (+   327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.299761 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.299892 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.299985 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.300209 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137198,"prepare.queue_time_us":247232,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":814093,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":375,"spinlock_wait_cycles":11894912,"thread_start_us":652323,"threads_started":2,"wal-append.queue_time_us":607967}
W20260709 13:07:20.397884 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.317328 21217 rpcz_store.cc:276] 0709 13:07:18.758897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.267457 (+1508560us) service_pool.cc:224] Handling call
0709 13:07:20.275705 (+  8248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.422293 21225 rpcz_store.cc:276] 0709 13:07:18.247122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.330896 (+2083774us) service_pool.cc:224] Handling call
0709 13:07:20.331415 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.331804 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.331828 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.331884 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.331920 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.331976 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.332093 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.328210 21220 rpcz_store.cc:269] 0709 13:07:18.048884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.116091 (+ 67207us) service_pool.cc:224] Handling call
0709 13:07:20.297211 (+2181120us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540038c054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.297517 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475472256}
I20260709 13:07:20.357854 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 340) took 2909 ms. Trace:
I20260709 13:07:20.397670 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:20.357741 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.424809 21297 rpcz_store.cc:276] 0709 13:07:18.728098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.282784 (+1554686us) service_pool.cc:224] Handling call
0709 13:07:20.283193 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.283651 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.283696 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.283753 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.283819 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.283893 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.284011 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.333441 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2217) took 1712 ms (client timeout 1868 ms). Trace:
I20260709 13:07:20.281358 23657 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.424284 21293 pending_rounds.cc:107] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:20.430749 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:20.425166 21143 rpcz_store.cc:276] 0709 13:07:19.121700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.061811 (+940111us) service_pool.cc:224] Handling call
0709 13:07:20.062374 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.303987 (+241613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.304017 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.304053 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.304088 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.304144 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.304240 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241021,"raft.queue_time_us":243776,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80}
I20260709 13:07:20.422994 23731 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:20.437369 21293 raft_consensus.cc:2889] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.400840 23706 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:20.439294 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 356541us
I20260709 13:07:20.413412 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:20.430562 21298 rpcz_store.cc:269] 0709 13:07:18.621087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.743742 (+122655us) service_pool.cc:224] Handling call
0709 13:07:20.333013 (+1589271us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540022ddd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.333231 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498222464}
I20260709 13:07:20.442265 21151 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:20.442965 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.429539 21224 rpcz_store.cc:276] 0709 13:07:17.448268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.122005 (+673737us) service_pool.cc:224] Handling call
0709 13:07:18.122282 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.197899 (+ 75617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.197951 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.198010 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.198059 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.333928 (+2135869us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b540039b7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.334022 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.357645 (+ 23623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173281920}
I20260709 13:07:20.446244 21293 pending_rounds.cc:107] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:20.446542 21293 raft_consensus.cc:2889] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:20.445420 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.007s
I20260709 13:07:20.449182 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2229) took 1631 ms. Trace:
I20260709 13:07:20.449774 21296 rpcz_store.cc:276] 0709 13:07:18.817364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.329072 (+1511708us) service_pool.cc:224] Handling call
0709 13:07:20.444623 (+115551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.448639 (+  4016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.448677 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.448743 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.448800 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.448897 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.449075 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.423458 21807 rpcz_store.cc:276] 0709 13:07:18.911096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.959833 (+1048737us) service_pool.cc:224] Handling call
0709 13:07:20.087580 (+127747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.231089 (+143509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.252123 (+ 21034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.455192 21299 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.456063 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2230) took 1637 ms. Trace:
I20260709 13:07:20.455833 23270 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:20.456521 21221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1318) took 1987 ms (client timeout 2068 ms). Trace:
W20260709 13:07:20.457118 21221 rpcz_store.cc:269] 0709 13:07:18.469325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.733370 (+264045us) service_pool.cc:224] Handling call
0709 13:07:20.456075 (+1722705us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540010e854. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.456358 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362728832}
I20260709 13:07:20.457932 23270 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:20.459779 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62471.4us
I20260709 13:07:20.460284 21217 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.461014 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1334) took 1787 ms. Trace:
I20260709 13:07:20.461385 21217 rpcz_store.cc:276] 0709 13:07:18.673638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.432029 (+1758391us) service_pool.cc:224] Handling call
0709 13:07:20.459778 (+ 27749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.460684 (+   906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.460935 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.457959 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:20.463275 21219 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.456513 21299 rpcz_store.cc:276] 0709 13:07:18.818370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.428239 (+1609869us) service_pool.cc:224] Handling call
0709 13:07:20.447658 (+ 19419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.455774 (+  8116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.455982 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.449396 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:20.468148 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.007s
I20260709 13:07:20.426784 23759 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.471737 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1313) took 2080 ms. Trace:
I20260709 13:07:20.476084 21226 rpcz_store.cc:276] 0709 13:07:18.391739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.448947 (+2057208us) service_pool.cc:224] Handling call
0709 13:07:20.471657 (+ 22710us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.477623 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.468832 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 167241us
I20260709 13:07:20.422698 21223 rpcz_store.cc:276] 0709 13:07:17.656991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.281518 (+2624527us) service_pool.cc:224] Handling call
0709 13:07:20.282032 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.282498 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.282525 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.282580 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.282628 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.282692 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.282816 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.480677 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 821032us
I20260709 13:07:20.471801 23695 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:20.508754 23695 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.476605 23722 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.511605 23722 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.512063 23722 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.512583 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:20.514006 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:20.515861 23760 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.516314 23760 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:20.516726 23760 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.517227 23657 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:20.517938 23657 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.518424 23657 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.519682 23764 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.520342 23764 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.520941 23759 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:20.521621 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1315) took 2051 ms. Trace:
I20260709 13:07:20.503981 23731 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.505376 23635 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:20.506531 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1690) took 1679 ms. Trace:
I20260709 13:07:20.507162 23712 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.469857 23715 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:20.531344 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 461) took 1799 ms. Trace:
I20260709 13:07:20.532021 21293 rpcz_store.cc:276] 0709 13:07:18.727619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.281802 (+1554183us) service_pool.cc:224] Handling call
0709 13:07:20.282211 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.501091 (+218880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.526574 (+ 25483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.499854 23739 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:20.501991 23701 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.016s
W20260709 13:07:20.505409 23788 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:07:20.548995 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72308.8us
I20260709 13:07:20.521505 23764 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.540259 23635 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.539383 23739 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:20.554694 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 237702us
I20260709 13:07:20.529403 21218 rpcz_store.cc:276] 0709 13:07:18.451473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.401794 (+1950321us) service_pool.cc:224] Handling call
0709 13:07:20.502287 (+100493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.529600 21149 rpcz_store.cc:276] 0709 13:07:18.826525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.970546 (+144021us) service_pool.cc:224] Handling call
0709 13:07:18.970874 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.971277 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.971308 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.979781 (+  8473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.057731 (+1077950us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b1800289ba0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:20.432520 (+374789us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.479346 (+ 46826us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.500868 (+ 21522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.505912 (+  5044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.505967 (+    55us) raft_consensus.cc:1685] finished
0709 13:07:20.506105 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.506314 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3348,"prepare.queue_time_us":34098,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":26472,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":15835,"spinlock_wait_cycles":15193856,"thread_start_us":197524,"threads_started":1,"wal-append.queue_time_us":1519582}
W20260709 13:07:20.553737 23527 consensus_meta.cc:287] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.008s
I20260709 13:07:20.560539 21811 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:20.560253 23527 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.562124 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:20.564057 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:07:20.564843 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 62036.6us
I20260709 13:07:20.565373 23527 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.565567 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:20.566113 23527 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.566502 23527 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.566630 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:20.566905 23527 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.567549 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:20.567813 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 88946.4us
I20260709 13:07:20.568701 21189 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:20.569046 23731 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.570782 23779 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.571290 23779 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.571693 23779 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.571465 23771 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:20.573447 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.6086e+06us
I20260709 13:07:20.574251 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 843) took 1959 ms. Trace:
I20260709 13:07:20.574697 21813 rpcz_store.cc:276] 0709 13:07:18.614406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.615102 (+   696us) service_pool.cc:224] Handling call
0709 13:07:20.549939 (+1934837us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:20.573381 (+ 23442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.573706 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.573734 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.573795 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.573848 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.573912 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.574050 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8478592}
I20260709 13:07:20.575351 23711 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.576329 23622 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.576534 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:20.577371 21148 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.579710 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:20.580643 21143 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:20.582821 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:20.583367 23723 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.583972 23723 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.584671 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:20.586865 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:20.550391 23701 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.587718 21810 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:20.587324 23715 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:20.588194 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 844) took 1973 ms (client timeout 1714 ms). Trace:
W20260709 13:07:20.588552 21810 rpcz_store.cc:269] 0709 13:07:18.614749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.614908 (+   159us) service_pool.cc:224] Handling call
0709 13:07:20.586583 (+1971675us) spinlock_profiling.cc:243] Waited 877 us on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:20.588127 (+  1544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017536}
I20260709 13:07:20.589458 23715 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.589530 23701 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.590056 23625 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:20.590399 21294 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:20.590978 23695 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.591838 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1823) took 1969 ms. Trace:
I20260709 13:07:20.592253 21294 rpcz_store.cc:276] 0709 13:07:18.622004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.242757 (+1620753us) service_pool.cc:224] Handling call
0709 13:07:20.256269 (+ 13512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.590840 (+334571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.591495 (+   655us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540022c9d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.591743 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760717696}
I20260709 13:07:20.570225 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:20.576041 23711 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.597779 21151 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:20.557571 23739 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.601800 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 348) took 3151 ms. Trace:
I20260709 13:07:20.602614 21222 rpcz_store.cc:276] 0709 13:07:17.450385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.358773 (+908388us) service_pool.cc:224] Handling call
0709 13:07:20.078264 (+1719491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.222345 (+144081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.578631 (+356286us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540035b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.594169 (+ 15538us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540035b450. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.601749 (+  7580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4018095744}
I20260709 13:07:20.606087 23712 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.610690 23359 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:20.611347 23359 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:20.612567 23712 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.612335 23359 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.613256 23712 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.614511 23523 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.615125 23523 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.617129 21809 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:20.617444 23523 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.587064 23723 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.615530 23708 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.623219 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:20.627913 21813 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.634402 23760 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.634965 23781 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:20.635444 23781 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:20.635807 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 65750.5us
I20260709 13:07:20.636564 23760 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.636381 23781 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.637925 23781 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.638761 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:20.639904 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 705) took 1831 ms. Trace:
I20260709 13:07:20.640308 21805 rpcz_store.cc:276] 0709 13:07:18.808483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.848341 (+1039858us) service_pool.cc:224] Handling call
0709 13:07:20.639704 (+791363us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54004a3654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.639824 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112665856}
I20260709 13:07:20.642784 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 507) took 1669 ms. Trace:
I20260709 13:07:20.625100 23701 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:20.647480 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 852) took 2025 ms. Trace:
I20260709 13:07:20.653963 21299 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:20.655848 21299 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:20.647826 21811 rpcz_store.cc:276] 0709 13:07:18.622629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.716703 (+ 94074us) service_pool.cc:224] Handling call
0709 13:07:18.717100 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.560991 (+1843891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.625471 (+ 64480us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:20.647424 (+ 21953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4235482368}
I20260709 13:07:20.628861 23625 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.660597 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:20.664372 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.664618 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.626323 23706 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.651746 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:20.668715 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62527.5us
W20260709 13:07:20.665882 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.661832 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.646513 23698 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:20.628988 23708 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:20.643153 21144 rpcz_store.cc:276] 0709 13:07:18.973666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.890740 (+917074us) service_pool.cc:224] Handling call
0709 13:07:19.891079 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.301885 (+410806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.301949 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.302778 (+   829us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.436690 (+133912us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.436732 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.439482 (+  2750us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.642465 (+202983us) raft_consensus.cc:1685] finished
0709 13:07:20.642484 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.642606 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249947,"raft.queue_time_us":254531,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":207,"thread_start_us":133484,"threads_started":1,"wal-append.queue_time_us":252826}
I20260709 13:07:20.672883 21296 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:20.670359 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 141406us
I20260709 13:07:20.665269 21297 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:20.646595 23701 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.642194 23722 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:20.698820 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60199.8us
I20260709 13:07:20.665741 23757 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.704313 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2228) took 1965 ms. Trace:
I20260709 13:07:20.711719 23701 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:20.673158 23625 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.668326 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:20.709487 21263 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 2.139s (SENT)
I20260709 13:07:20.719776 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.697996 23657 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:20.747658 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.674446 23708 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.723652 21296 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:20.724210 21298 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.724561 23699 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:20.724880 23764 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:20.727470 21190 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:20.729723 21219 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:20.730212 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:20.735692 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:20.737515 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.739295 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.740751 23711 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.764367 23764 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.764927 23764 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:20.765069 21294 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.765355 23764 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.765867 21148 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:20.754457 23699 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:20.770895 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 131217us
W20260709 13:07:20.771373 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.771737 21776 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.541s (SENT) [suppressed 30 similar messages]
I20260709 13:07:20.754899 23622 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.772528 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.772722 21116 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:20.773341 21299 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.772541 23779 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.774111 23715 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.774668 23715 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.775445 23779 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.777269 23693 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:20.778277 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:20.743173 23635 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.709225 21292 rpcz_store.cc:276] 0709 13:07:18.738445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.286411 (+1547966us) service_pool.cc:224] Handling call
0709 13:07:20.334383 (+ 47972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.431667 (+ 97284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:20.552146 (+120479us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.703963 (+151817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.704014 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.704063 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.704125 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.704259 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166207,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":28422,"thread_start_us":137569,"threads_started":2,"wal-append.queue_time_us":102880}
I20260709 13:07:20.722232 23706 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.709194 23757 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.749308 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 704) took 1755 ms. Trace:
W20260709 13:07:20.749992 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 146116us
I20260709 13:07:20.757553 21297 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:20.806998 23794 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.130s	user 0.003s	sys 0.001s
I20260709 13:07:20.807659 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.758168 23379 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:20.809670 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.758888 23608 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.811041 23698 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.811764 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:20.812341 23796 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:20.805886 21812 rpcz_store.cc:276] 0709 13:07:18.808181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.908046 (+1099865us) service_pool.cc:224] Handling call
0709 13:07:19.908466 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.908943 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.908982 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.909621 (+   639us) log.cc:844] Serialized 52 byte log entry
0709 13:07:20.423798 (+514177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.541375 (+117577us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.556653 (+ 15278us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.556890 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.557013 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.563683 (+  6670us) raft_consensus.cc:1685] finished
0709 13:07:20.563696 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.563820 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1263,"prepare.queue_time_us":306623,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":22334,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":10791,"thread_start_us":430566,"threads_started":2,"wal-append.queue_time_us":347480}
I20260709 13:07:20.812980 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.783324 21299 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:20.785250 21298 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:20.813555 21292 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.814059 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:20.779574 23699 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.824991 21293 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:20.826252 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 157311us
W20260709 13:07:20.826454 21295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2222) took 2204 ms (client timeout 1948 ms). Trace:
I20260709 13:07:20.784895 23695 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:20.827041 21263 leader_election.cc:336] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 2.145s (SENT)
I20260709 13:07:20.835920 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:20.836066 23723 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.836534 23723 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.836930 23723 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.813913 23379 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:20.843429 23657 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:20.786506 21219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1306) took 2740 ms (client timeout 1591 ms). Trace:
W20260709 13:07:20.844367 21219 rpcz_store.cc:269] 0709 13:07:18.039991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.054900 (+ 14909us) service_pool.cc:224] Handling call
0709 13:07:20.457569 (+2402669us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:20.757857 (+300288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8323968}
I20260709 13:07:20.846963 23723 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:20.850621 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:20.851917 23723 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.853205 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:20.854269 21812 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:20.855475 23715 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.827040 23635 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:20.856230 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:20.776126 23779 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:07:20.770995 23527 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.860337 23711 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.861244 23656 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.861977 23527 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.869156 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.870975 23656 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:20.821889 23771 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:20.872733 23771 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.873600 23771 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.885908 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:20.887387 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 69530.7us
I20260709 13:07:20.887527 23698 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.888664 23698 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:20.889050 23698 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.889997 23698 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.891556 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:20.892577 23657 raft_consensus.cc:2764] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:20.892808 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 60560us
I20260709 13:07:20.893715 21807 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:20.894697 23656 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.895216 23656 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.895741 23656 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.896076 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:20.896919 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.897787 21291 raft_consensus.cc:2368] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
I20260709 13:07:20.897969 23635 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.898458 23635 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:20.898792 23779 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.899212 23779 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:20.899436 23635 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.900303 23779 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.901728 23779 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.902367 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.903085 21219 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:20.903334 21218 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:20.903733 21222 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:20.904560 23722 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:20.904812 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.905134 23722 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.905596 21223 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:20.905833 23722 consensus_queue.cc:1243] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:20.907912 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.908166 21218 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:20.909228 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.910012 21223 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:20.910763 23656 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.912956 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.814944 23757 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:20.826944 21295 rpcz_store.cc:269] 0709 13:07:18.622366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.749052 (+126686us) service_pool.cc:224] Handling call
0709 13:07:20.826069 (+2077017us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54004001d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:20.826263 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4437076224}
I20260709 13:07:20.921084 21813 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:20.928200 21811 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.930385 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:20.875160 23771 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:20.932204 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.824234 23359 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:20.933481 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 77125.3us
I20260709 13:07:20.937404 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:20.923316 23523 raft_consensus.cc:2764] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:20.923631 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.948050 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.937742 23359 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.954932 21813 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:20.957373 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 106881us
I20260709 13:07:20.923463 23723 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:20.963099 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2227) took 2225 ms. Trace:
I20260709 13:07:20.959376 23359 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.963496 21300 rpcz_store.cc:276] 0709 13:07:18.738054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.285171 (+1547117us) service_pool.cc:224] Handling call
0709 13:07:20.287710 (+  2539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.426550 (+138840us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:20.426584 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.434925 (+  8341us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.545421 (+110496us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.548191 (+  2770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.548287 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.962942 (+414655us) raft_consensus.cc:1685] finished
0709 13:07:20.962955 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.963053 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76499,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"thread_start_us":73590,"threads_started":1,"wal-append.queue_time_us":215312}
I20260709 13:07:20.949764 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:20.973201 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:20.973268 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.970821 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:20.976895 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:20.979413 23731 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.966707 23729 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.983702 21812 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.990833 21295 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:20.995103 21142 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:07:20.975329 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:21.023663 21291 raft_consensus.cc:2410] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:21.024609 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.025806 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:20.995873 21142 pending_rounds.cc:85] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 4
I20260709 13:07:21.004549 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.027458 21142 pending_rounds.cc:107] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:07:21.027782 21142 raft_consensus.cc:2889] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.005231 23706 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:21.009140 23804 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.029042 23804 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.009658 23695 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:21.011394 23729 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:21.033275 23729 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.033977 23739 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:20.995445 21294 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:21.036788 21294 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:21.012559 23625 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:20.996011 21116 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:21.038702 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63037.1us
I20260709 13:07:21.013810 21297 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:20.997556 21218 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 2.
I20260709 13:07:20.988670 23731 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:21.018029 21298 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.018814 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.019593 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.002897 21114 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.031558 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.035094 23698 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.039238 21292 raft_consensus.cc:2410] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:21.027184 21291 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:21.043246 23527 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.043027 23523 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.053475 23523 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:21.040741 23731 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:21.054613 23523 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.054903 23731 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.055930 23523 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.056747 23731 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:21.058496 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.039670 23695 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:21.059405 23527 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.059463 23695 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.045248 23656 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.060714 23695 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.043442 21295 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:21.055572 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.064977 21811 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:21.045006 23804 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:21.000187 21263 connection.cc:256] RPC call timeout handler was delayed by -1.1368577379998897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4883s for a response
W20260709 13:07:21.066241 21263 connection.cc:256] RPC call timeout handler was delayed by -1.1260332919999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:07:21.066586 21263 connection.cc:256] RPC call timeout handler was delayed by -1.0938022479999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:07:21.069550 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.071310 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:07:21.076720 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.076982 23656 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.077984 23656 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:21.080153 23656 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.080665 23764 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.083303 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.084226 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.085500 23527 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.085901 23527 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.086225 23527 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.086913 21116 leader_election.cc:400] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
I20260709 13:07:21.087414 21116 leader_election.cc:403] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.088178 23715 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.088487 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.089581 23723 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:21.049261 21812 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:21.100447 21142 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:21.100970 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.102465 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.102095 21048 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.103807 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.104609 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:21.105593 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.106365 21142 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:21.107554 23699 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.108074 23757 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.109835 23699 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:21.111581 21048 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 4, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:21.114097 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:21.115553 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48380.2us
I20260709 13:07:21.117079 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.117259 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.117542 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.148204 21223 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:21.148538 23708 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.150753 23708 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:21.151333 23739 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.151670 21300 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.153330 21263 leader_election.cc:336] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.599s (SENT)
I20260709 13:07:21.153760 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.118207 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.154989 21226 raft_consensus.cc:2410] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:21.154557 23359 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.155965 21225 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:21.119554 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:21.156998 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56250.8us
I20260709 13:07:21.157269 21217 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:21.157537 23359 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:21.119761 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.120620 21224 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:21.121980 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50805.9us
I20260709 13:07:21.123034 21220 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:21.125128 21807 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:21.125710 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 67551.1us
I20260709 13:07:21.128491 23722 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:21.140504 21299 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.167707 21219 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.199193 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 242759us
I20260709 13:07:21.161181 23759 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.165485 23731 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.218165 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.218868 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.219240 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.219769 21299 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.219550 21291 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:21.214943 21148 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:21.202543 23764 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:21.230433 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 77131.2us
I20260709 13:07:21.217387 21048 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:21.230916 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69388us
I20260709 13:07:21.230229 21049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 373) took 10298 ms. Trace:
I20260709 13:07:21.230294 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.215415 23757 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.263466 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:21.265898 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.257197 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.235482 21296 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:21.264009 21116 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.268157 21300 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:21.220188 23715 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
I20260709 13:07:21.272341 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.276377 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.273247 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.279371 21300 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:21.221073 23708 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:21.231400 23625 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.280279 23708 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.277935 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.293059 21292 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.295058 21296 raft_consensus.cc:2410] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:21.224980 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:21.297020 21224 raft_consensus.cc:606] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.298372 23527 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:21.305223 21807 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:21.306114 21263 leader_election.cc:336] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.731s (SENT)
I20260709 13:07:21.306542 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.267316 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.307741 21294 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:21.308928 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.309492 21294 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.310938 21143 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.311682 21142 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:21.283707 23699 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.310938 21144 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.316789 23699 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.318563 23759 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.318867 23699 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.319586 23625 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:21.320068 23625 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.320325 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:21.321460 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:21.322105 21811 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:21.322888 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.323536 21811 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:21.323693 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:21.324205 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.324765 21811 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.326056 21809 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:07:21.327488 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59619.6us
I20260709 13:07:21.327610 21810 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:21.327920 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.328308 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.329955 23359 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.330385 23359 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.327617 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.331496 21221 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:21.332746 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:21.285065 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51728us
I20260709 13:07:21.265564 23781 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:07:21.220810 23739 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:21.272320 23731 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:21.330709 23359 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.339056 21299 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:21.339651 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.284266 23711 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.344656 21142 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:21.337371 23729 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.341589 21294 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:21.356637 23538 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:21.357945 21814 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.359622 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:21.360486 21807 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:21.337227 21219 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:21.384581 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.363452 23527 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.364061 21811 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:21.340879 23731 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.361119 21812 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:21.330826 23695 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.390978 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:21.344666 23699 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.374670 21048 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:21.377411 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:21.393368 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 163140us
I20260709 13:07:21.398798 21810 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:21.340287 23722 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:21.377509 23698 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:21.366845 23711 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.410079 23711 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.394435 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.411376 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.411597 21299 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.411911 21219 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.412369 23708 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.264333 21049 rpcz_store.cc:276] 0709 13:07:10.829139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.830668 (+  1529us) service_pool.cc:224] Handling call
0709 13:07:21.127106 (+10296438us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.590883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.591589 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.591636 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:07:18.591658 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:18.644889 (+ 53231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.645021 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.645062 (+    41us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:07:18.647021 (+  1959us) tablet.cc:701] Row locks acquired
0709 13:07:18.647083 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:07:18.732666 (+ 85583us) write_op.cc:270] Start()
0709 13:07:18.772626 (+ 39960us) write_op.cc:276] Timestamp: P: 1783602438647221 usec, L: 0
0709 13:07:18.777732 (+  5106us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.926296 (+148564us) log.cc:844] Serialized 7129 byte log entry
0709 13:07:20.220631 (+1294335us) op_driver.cc:464] REPLICATION: finished
0709 13:07:20.541836 (+321205us) write_op.cc:301] APPLY: starting
0709 13:07:20.557837 (+ 16001us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:20.642872 (+ 85035us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:20.642995 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:20.747085 (+104090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.747692 (+   607us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:07:20.747736 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:20.748319 (+   583us) log.cc:844] Serialized 125 byte log entry
0709 13:07:20.749907 (+  1588us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.753329 (+  3422us) write_op.cc:454] Released schema lock
0709 13:07:20.757809 (+  4480us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:20.859376 (+101567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.859405 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":255616,"apply.run_cpu_time_us":10855,"apply.run_wall_time_us":323528,"num_ops":18,"prepare.queue_time_us":494216,"prepare.run_cpu_time_us":35972,"prepare.run_wall_time_us":668456,"raft.queue_time_us":306604,"raft.run_cpu_time_us":6279,"raft.run_wall_time_us":93254,"replication_time_us":1442524,"spinlock_wait_cycles":6144,"thread_start_us":800432,"threads_started":4,"wal-append.queue_time_us":705194}]]}
I20260709 13:07:21.414464 23741 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.415221 23741 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:21.394742 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.392338 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:21.346675 23757 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.369897 23712 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.400696 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.400614 21142 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:21.397831 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.421670 21151 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:21.422550 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.423578 21150 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:21.425630 21292 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:21.427181 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.427191 21299 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:21.423662 23808 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:21.431308 23359 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.433445 23359 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.434090 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.434823 21295 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:21.435639 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.406800 23625 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.391088 23764 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:07:21.399530 23779 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:07:21.435950 21295 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:21.470528 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.718919 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.719502 23711 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:21.719923 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:21.720232 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 249793us
I20260709 13:07:21.656762 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.720952 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:21.721694 23819 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:21.721486 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.722375 23819 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:21.722693 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.722941 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.723670 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.723443 23819 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.724040 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.724547 21220 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.724705 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.725756 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.726709 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.451839 21292 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:21.560068 21265 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.19.145.62:44287, user_credentials={real_user=slave}} blocked reactor thread for 62814.4us
I20260709 13:07:21.641731 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.463915 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.529362 21299 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:21.545050 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.527720 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 157441us
I20260709 13:07:21.451522 21149 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:21.720003 21221 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:21.398767 23731 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.436959 21048 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 3 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 4 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.746708 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:21.466532 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 68798.4us
I20260709 13:07:21.400378 23699 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:21.541033 21263 leader_election.cc:336] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.660s (SENT)
I20260709 13:07:21.751464 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:21.752403 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 288563us
I20260709 13:07:21.748588 21190 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:21.747303 21291 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:21.559799 23760 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.626731 23729 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.754235 23715 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:21.757195 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:21.757735 23824 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:07:21.757416 23715 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.759895 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.609048 23741 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.760954 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.761557 21219 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:21.539884 23519 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.762745 23519 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:21.763473 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.763795 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.763664 23519 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.719925 23711 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.749790 23270 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.764523 21225 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:21.764807 23270 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:21.765736 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.765918 23270 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.764571 23711 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.758436 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.767498 21221 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:21.773610 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.774003 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.774652 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.423421 23757 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.423360 23712 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.777179 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.759312 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:21.477026 23708 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.557365 23722 consensus_queue.cc:1243] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:21.581502 23695 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.761590 21223 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:21.785923 21298 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:21.786175 21225 raft_consensus.cc:2410] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:21.466902 23808 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.788261 21295 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:21.793422 21048 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 3 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 4 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:21.796113 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43524.8us
W20260709 13:07:21.797863 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 49363.3us
I20260709 13:07:21.800591 21221 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:21.784711 23270 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.791870 21223 pending_rounds.cc:85] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 6
I20260709 13:07:21.788452 23712 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.788196 23757 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.815207 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.760882 23741 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.816562 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:21.812436 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:21.820299 21217 raft_consensus.cc:606] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.820684 21217 raft_consensus.cc:614] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.825212 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.826272 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:21.827832 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.829449 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:07:21.829365 23379 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.831655 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:21.832186 23821 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.832675 21218 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:21.821275 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.808056 23708 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:21.840193 23708 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:21.842423 23625 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:21.809049 23759 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.845391 21148 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.811468 23722 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:21.846553 23722 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.846865 21151 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:21.847004 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.814286 21223 pending_rounds.cc:107] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:21.847882 21143 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 2.
I20260709 13:07:21.848294 21223 raft_consensus.cc:2889] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.848393 21150 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.848007 23699 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:21.849244 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.846894 23722 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.850692 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.852978 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.854074 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:21.855479 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.855823 23820 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.849452 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.856307 23820 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.856709 23820 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.856093 21151 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:21.910475 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 96252.4us
W20260709 13:07:21.911243 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 87208.1us
I20260709 13:07:21.813993 23695 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:21.915239 21143 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:21.814818 23808 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:21.938629 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 112457us
I20260709 13:07:21.942926 23625 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.946276 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:21.947290 21143 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:21.949188 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:21.974613 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:21.819597 23693 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 13:07:21.954027 21048 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:21.937366 23779 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:21.937688 23698 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:07:21.935928 23722 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:22.133594 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 592565us
I20260709 13:07:22.012511 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.030395 21220 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:21.938942 23759 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:21.996163 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.034368 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.019552 21048 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:22.154206 21149 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:21.987015 21225 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:22.154732 21225 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:22.124011 23826 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:07:21.979024 23527 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.163935 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.174058 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:21.985455 23715 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.164479 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:22.126042 23764 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.184072 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.094444 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:22.065390 23829 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:22.176576 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.090061 23379 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.177585 21151 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.180691 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.181627 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.186255 21143 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:22.030746 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.012984 23781 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:22.187899 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.188222 21149 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.189038 21142 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:22.195444 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 371882us
W20260709 13:07:22.196998 21776 connection.cc:256] RPC call timeout handler was delayed by -1.1738668570000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2276s for a response
I20260709 13:07:22.198298 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.198796 21217 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:22.186663 21147 raft_consensus.cc:2376] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6. Re-sending same reply.
I20260709 13:07:21.978542 23695 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.200438 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.201072 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.193291 23821 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:22.202298 23821 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:22.156792 23712 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.206104 21146 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.204107 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:22.178959 23359 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.208832 21263 leader_election.cc:336] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.789s (SENT)
I20260709 13:07:22.209475 21145 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:22.210712 21217 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:22.210999 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.205499 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.212035 21149 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:22.205339 21225 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.213356 21225 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.215454 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:22.216707 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.220738 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:22.221524 21220 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:22.221650 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.223182 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:22.200105 23759 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:22.228217 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.225409 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.217799 21218 raft_consensus.cc:2368] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:22.234087 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:22.235651 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.236049 21224 raft_consensus.cc:606] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:22.236356 21149 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.203127 21223 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:22.236374 21224 raft_consensus.cc:614] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:22.193084 23764 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.243418 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.244424 21226 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:22.245281 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.221797 23270 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.205910 23781 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.249996 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:22.105868 23808 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.252236 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.253002 21220 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:22.254293 23837 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.254341 23741 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.219029 23359 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.254786 23270 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:22.255715 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51408.3us
I20260709 13:07:22.267693 21143 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:22.261056 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.270635 21142 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
W20260709 13:07:22.340986 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 148150us
I20260709 13:07:22.274706 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.273011 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:22.378387 21225 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.272275 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:07:22.387240 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 176492us
W20260709 13:07:22.260118 23833 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:07:22.389806 21263 leader_election.cc:336] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.892s (SENT)
I20260709 13:07:22.390166 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:22.272046 23838 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:07:22.267477 23706 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.264297 23712 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:22.306938 23764 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.343601 23741 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:22.394663 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:22.394958 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 445852us
I20260709 13:07:22.259148 23836 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.402761 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:22.391029 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:22.260648 21219 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.270756 23270 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.264976 23695 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.260687 23837 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:22.269179 23722 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.267457 23359 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.265422 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:22.392803 23608 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:22.271952 23731 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.389341 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:22.418608 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 168664us
I20260709 13:07:22.268005 23657 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:07:22.422096 21226 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:22.410567 23706 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:22.422745 23835 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:07:22.427457 21225 raft_consensus.cc:2410] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:22.428813 21190 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
W20260709 13:07:22.456233 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.456538 21190 leader_election.cc:403] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.262049 23711 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.433171 23657 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.467684 23657 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:22.468524 23657 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.469632 23657 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.388586 23538 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:22.473398 23538 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.474205 23538 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.474556 23538 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:22.420665 23757 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.003s
I20260709 13:07:22.475525 23757 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.477509 23757 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:22.426235 23837 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.265892 23759 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:22.459601 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69865.2us
I20260709 13:07:22.431102 23519 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.486297 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:22.462646 23711 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:22.463208 21218 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:22.463471 23739 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.454025 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:22.479020 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:22.480137 21150 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.492417 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:22.492866 21299 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:22.493000 21298 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:22.480957 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 52318.3us
I20260709 13:07:22.461153 23635 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:22.420186 23741 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:22.500801 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 65710.8us
I20260709 13:07:22.489557 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:22.485816 23379 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.496474 21144 raft_consensus.cc:606] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Received request to transfer leadership
I20260709 13:07:22.434397 23270 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:22.498572 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:22.502590 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:22.517810 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:22.495605 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:22.506770 21263 leader_election.cc:336] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.927s (SENT)
I20260709 13:07:22.518946 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.507390 23712 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:22.508225 23622 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:22.509008 23848 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.509847 23635 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.521245 21292 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:22.497252 23760 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.534278 21299 raft_consensus.cc:1217] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:07:22.524304 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:22.537423 21299 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:22.537683 21296 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:22.535878 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.022s
I20260709 13:07:22.539790 21145 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:22.565117 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.013s	sys 0.022s
I20260709 13:07:22.540299 21291 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
W20260709 13:07:22.591244 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 92725.1us
I20260709 13:07:22.524984 23359 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.525115 23711 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:07:22.520303 23519 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:07:22.535112 23804 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.494477 23698 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:22.592566 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:22.591349 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 615243us
I20260709 13:07:22.621474 21296 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.604065 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.604710 21299 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:22.533504 23848 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:22.603658 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 82201.1us
I20260709 13:07:22.536303 23635 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:22.497001 23693 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:07:22.483578 23538 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.606302 23519 consensus_queue.cc:1243] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:22.603437 23359 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.624975 23781 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:22.603545 23757 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.606619 23855 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.637877 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.642437 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.638767 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 143204us
I20260709 13:07:22.643618 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.649650 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:22.651829 21189 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:22.654785 23847 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.657917 23836 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.661655 23760 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.664529 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:22.664896 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:22.665364 21147 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.632046 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1854) took 1197 ms. Trace:
I20260709 13:07:22.696261 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:22.697127 21813 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.686111 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.640879 23359 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.699730 23635 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.702531 23635 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.622146 23712 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:22.603893 23764 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:22.707808 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:22.686971 23781 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.648681 23695 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.712287 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 175941us
I20260709 13:07:22.714876 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.687970 23527 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.689321 23538 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:22.717299 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 220662us
I20260709 13:07:22.724197 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:22.685626 23779 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:22.739317 23804 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:22.739892 23853 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
W20260709 13:07:22.740769 23820 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.000s
I20260709 13:07:22.740940 23845 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.741245 23820 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.742389 23519 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.742830 23519 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:22.647794 23715 consensus_queue.cc:1175] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 5 index: 5 } }
I20260709 13:07:22.743739 23519 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.745517 23858 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.746287 23858 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:22.747584 23858 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.749292 23359 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.686214 23270 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:22.752398 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:22.755081 21263 leader_election.cc:336] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 2.068s (SENT)
W20260709 13:07:22.755842 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 106747us
I20260709 13:07:22.758401 21114 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.756212 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.760460 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.733210 23698 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:22.740790 23862 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:07:22.735517 23731 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.733623 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:22.775766 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.685263 23706 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.665807 23855 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.757050 23821 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.781096 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:22.725107 23695 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.714172 23856 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:07:22.770076 23527 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.788539 21813 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:22.768013 23698 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:22.800076 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:22.802783 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 66477.3us
I20260709 13:07:22.778335 23711 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.784286 23845 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.812165 21114 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:22.786442 21807 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:22.817860 21143 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.811092 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:22.819977 21299 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:22.822190 21263 leader_election.cc:336] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 2.098s (SENT)
I20260709 13:07:22.818645 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:22.823743 21147 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 3: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:22.824738 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:22.800004 23379 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5.
I20260709 13:07:22.851058 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35736 (request call id 86) took 1022 ms. Trace:
I20260709 13:07:22.828004 23527 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.872471 21143 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.827405 23359 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:22.828162 23860 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:22.869482 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 208103us
I20260709 13:07:22.831871 23731 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:22.880065 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53467.5us
I20260709 13:07:22.866811 21144 rpcz_store.cc:276] 0709 13:07:21.823536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.829267 (+  5731us) service_pool.cc:224] Handling call
0709 13:07:22.835086 (+1005819us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540040c754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:22.835197 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532370688}
I20260709 13:07:22.886418 23698 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:22.887951 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:22.878917 21299 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:22.898187 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72525.8us
W20260709 13:07:22.906666 23865 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:22.869031 23622 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:22.907356 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:22.832393 23856 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:07:22.907776 23622 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.879978 23527 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:22.909900 23527 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.886440 23731 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.930262 23731 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.705734 21294 rpcz_store.cc:276] 0709 13:07:21.434122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.451646 (+ 17524us) service_pool.cc:224] Handling call
0709 13:07:21.609685 (+158039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.652737 (+ 43052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.653348 (+   611us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.762502 (+109154us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.936234 (+173732us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:21.940749 (+  4515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.971584 (+ 30835us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.621010 (+649426us) raft_consensus.cc:1685] finished
0709 13:07:22.622010 (+  1000us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.628166 (+  6156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":324,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2090,"thread_start_us":96834,"threads_started":1,"wal-append.queue_time_us":385318}
I20260709 13:07:22.898397 23723 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:07:22.977761 23808 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.992038 23808 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:22.995440 23873 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:22.996057 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.998092 23860 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.031762 23860 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:23.050248 23657 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.000s
W20260709 13:07:23.059015 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.978355 23871 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.891574 23837 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:23.085990 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.097705 23879 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.098410 23879 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.101387 23879 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.102205 21299 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:23.103713 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 281552us
W20260709 13:07:23.104130 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 216807us
I20260709 13:07:23.105188 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:23.105566 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 217694us
I20260709 13:07:23.106081 23359 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.106321 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.106462 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.107880 21292 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:23.107977 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:23.109187 23860 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.110208 23359 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.110671 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1383) took 1258 ms. Trace:
I20260709 13:07:23.111091 21150 rpcz_store.cc:276] 0709 13:07:21.852675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.852777 (+   102us) service_pool.cc:224] Handling call
0709 13:07:23.110480 (+1257703us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400180bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:23.110617 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440526720}
I20260709 13:07:23.113370 21149 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:07:23.113536 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 285914us
I20260709 13:07:23.114543 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.117514 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.118851 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.103391 23837 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.120568 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.121361 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.122829 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.119364 21217 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:23.111662 23635 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.124964 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.107331 23855 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.112468 23808 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.131633 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.117564 23873 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.119835 23731 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.133178 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:23.133026 23873 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.125504 23711 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:23.135214 23731 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.135473 23873 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.135885 23731 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.136289 23731 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.136638 23731 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.137182 23831 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:23.137583 23831 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.120033 23359 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:07:23.138592 23359 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:23.138988 23359 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:23.122735 23538 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.139557 23538 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.139842 23359 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.141379 23359 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.141741 23538 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.125602 23723 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.143697 23723 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.144114 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.145744 23723 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.147454 23845 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:23.148183 23857 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.669s	user 0.003s	sys 0.001s
I20260709 13:07:23.125881 23860 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.150156 23880 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.150482 23722 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:23.151288 21226 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:23.153497 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.155020 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.156255 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:23.156960 21807 raft_consensus.cc:2368] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
I20260709 13:07:23.157867 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.158105 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.159022 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.155534 23527 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.161572 23527 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.162014 23635 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.163662 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.151202 23819 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.167603 23879 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.179908 23819 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:23.180533 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.181102 23819 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.184898 21295 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:23.185622 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:23.132246 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.174758 23695 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.125332 23625 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:23.174968 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1379) took 1328 ms. Trace:
I20260709 13:07:23.175732 23741 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.150995 23722 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:23.232506 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.191439 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:23.204128 23879 raft_consensus.cc:2764] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:23.193147 21147 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.193760 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:23.194731 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:23.194881 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:23.196216 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.234526 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.235606 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:23.196475 23876 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.372s	user 0.010s	sys 0.000s
W20260709 13:07:23.196873 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71940us
I20260709 13:07:23.237725 21189 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.197546 23855 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.198158 23608 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:23.126045 23706 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.198958 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.247833 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1359) took 1177 ms. Trace:
I20260709 13:07:23.248309 21221 rpcz_store.cc:276] 0709 13:07:22.086543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.090436 (+  3893us) service_pool.cc:224] Handling call
0709 13:07:23.198829 (+1108393us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:23.247751 (+ 48922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8912640}
I20260709 13:07:23.249955 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.138460 23831 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:23.200090 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:23.253340 21812 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6. Re-sending same reply.
I20260709 13:07:23.201365 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:23.201843 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56328us
W20260709 13:07:23.228986 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 100887us
W20260709 13:07:23.187007 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54816.5us
I20260709 13:07:23.223688 23837 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:23.193881 21144 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:23.203858 21223 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:23.255003 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:23.233507 21143 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:23.241972 23781 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.245390 23847 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:23.279145 23781 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.279870 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.255185 23706 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.334678 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:23.280560 21812 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:23.335778 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.299553 21225 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:23.245718 23608 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.255506 23622 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.279332 23881 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.279168 23882 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:07:23.332152 23527 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:23.356410 23886 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:07:23.349243 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:23.359427 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:23.411855 21144 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.355412 21808 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:23.360210 23858 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:23.360759 23843 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:07:23.362982 23699 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.364926 21145 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:23.365087 23722 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.366087 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.371423 23831 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.360797 23741 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.373462 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.376463 23731 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.379154 23820 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.380132 23635 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:23.380997 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.266541 23837 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.382582 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.382701 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:23.349328 23759 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.467428 21812 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:23.392614 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:23.394038 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53665.8us
I20260709 13:07:23.395460 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:23.395848 21776 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.396169 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.397744 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.398355 21294 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:23.247234 23856 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
W20260709 13:07:23.398710 23875 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.514s	user 0.003s	sys 0.010s
W20260709 13:07:23.399389 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.400971 21149 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:23.401597 23832 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:23.355126 23706 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.280560 23695 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.403023 23779 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:23.405390 23698 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.407341 21142 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:23.266579 23879 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.409724 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 163452us
I20260709 13:07:23.414372 21813 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:23.431391 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 96799.1us
I20260709 13:07:23.430909 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1373) took 1178 ms. Trace:
I20260709 13:07:23.434597 21145 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:23.419898 23527 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.436934 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.436877 23379 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.434495 23741 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.445801 21224 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.452625 21143 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.413844 23881 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.455839 23884 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.456485 23878 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.574s	user 0.000s	sys 0.010s
I20260709 13:07:23.456333 21223 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:23.457602 23722 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.223752 21148 rpcz_store.cc:276] 0709 13:07:21.846327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.855366 (+  9039us) service_pool.cc:224] Handling call
0709 13:07:21.855705 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.976777 (+121072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.976830 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.012423 (+ 35593us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.386044 (+373621us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:22.391606 (+  5562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.408891 (+ 17285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.147477 (+738586us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:23.168069 (+ 20592us) raft_consensus.cc:1685] finished
0709 13:07:23.168094 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.174903 (+  6809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88528,"raft.queue_time_us":128908,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":20006,"spinlock_wait_cycles":63111680,"thread_start_us":363718,"threads_started":1,"wal-append.queue_time_us":389586}
I20260709 13:07:23.458820 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:23.384958 23848 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.471873 21814 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:23.430197 23858 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.505903 23888 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.579628 23270 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.565953 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.580669 23848 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.580227 23270 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.580328 23881 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.581357 23359 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.579624 21806 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.581753 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.582293 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.570358 21812 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:23.563823 21805 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:23.563838 23893 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:07:23.580008 23888 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.583941 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.584621 21223 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.585238 23888 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.586374 21812 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.472246 23759 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.591136 21222 rpcz_store.cc:276] 0709 13:07:22.254887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.388355 (+133468us) service_pool.cc:224] Handling call
0709 13:07:23.365941 (+977586us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:23.430855 (+ 64914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645888}
I20260709 13:07:23.591542 23879 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.592201 21812 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:23.593683 21263 leader_election.cc:400] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:23.603143 21263 leader_election.cc:403] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:23.607661 21808 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:23.594156 21293 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:23.610244 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 137209us
I20260709 13:07:23.611310 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:23.592401 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.612007 21222 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.613492 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:23.590521 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.592761 23759 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.592859 23741 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.474776 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 78979.9us
I20260709 13:07:23.533751 23523 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.590071 21806 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:23.499380 23712 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.631393 23712 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:23.631893 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.632189 23712 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.635442 23871 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:23.636149 23871 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.636597 23871 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.638909 23871 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.565341 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.639802 21219 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.643088 23880 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:23.603329 23832 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.643504 23880 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.644526 23527 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.644344 23832 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:23.473093 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 77725.2us
I20260709 13:07:23.645537 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.646209 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:23.648823 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.564641 23837 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:23.649205 23821 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.649652 23821 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.650018 23821 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.650370 21217 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:23.624271 23379 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.652084 23379 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.653509 21810 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:23.654274 21222 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:23.566912 23731 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:23.656512 23731 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:23.627507 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.657037 23731 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.657328 23608 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.658156 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.658386 23608 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.657053 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:23.659611 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.659919 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.660867 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.661242 21263 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.661484 21298 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:23.662602 23837 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.663842 21292 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:23.664062 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.665102 23831 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.624668 23888 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.665552 23699 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:23.666049 23888 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.666476 23888 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.667773 23832 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.648944 23858 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:23.669600 23858 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.670217 23858 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:23.671540 23858 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.672116 23858 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.673018 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.676091 23804 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:23.644344 23880 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.678287 23519 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.679585 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.667083 23270 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.678855 23880 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.624055 23695 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.593519 23879 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:23.614720 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.687328 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:23.596490 23779 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:23.673614 23837 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.705164 21810 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.648844 21144 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:23.468452 23771 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.690052 21222 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:23.725044 21222 pending_rounds.cc:85] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 3
I20260709 13:07:23.725397 21222 pending_rounds.cc:107] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:23.725656 21222 raft_consensus.cc:2889] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.695675 21293 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:23.696569 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71779us
I20260709 13:07:23.726804 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.499528 23635 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.688987 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:23.699126 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.698952 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:23.701503 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.702404 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.703715 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.731962 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:23.676340 23741 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.689308 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.730568 21813 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:23.697153 23820 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.695122 23731 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.747355 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:23.748551 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:23.760268 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1865) took 1247 ms. Trace:
W20260709 13:07:23.750413 23861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.011s	sys 0.029s
I20260709 13:07:23.760787 21297 rpcz_store.cc:276] 0709 13:07:22.512765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.515396 (+  2631us) service_pool.cc:224] Handling call
0709 13:07:22.522177 (+  6781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.627888 (+105711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.627944 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.638236 (+ 10292us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.701359 (+ 63123us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:22.701416 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.701511 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.398156 (+696645us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:23.751771 (+353615us) raft_consensus.cc:1685] finished
0709 13:07:23.751802 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.760193 (+  8391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135080,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":5278080,"thread_start_us":120863,"threads_started":2,"wal-append.queue_time_us":226830}
I20260709 13:07:23.696770 23882 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:23.750483 23723 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.771931 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.697321 23523 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:23.594003 23884 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.704903 23821 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.763895 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.783691 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:23.787245 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:23.773397 23861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.011s	sys 0.029s
I20260709 13:07:23.758903 23625 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:23.771440 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 82196.9us
W20260709 13:07:23.802004 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 140831us
I20260709 13:07:23.804172 21151 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:23.796520 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:23.805349 21810 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:23.771736 23622 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.776626 23731 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.809257 21813 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:23.750823 23771 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.764093 23729 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:23.791581 23699 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.755314 23820 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.791054 23379 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.774009 23804 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:23.798722 21805 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:23.840008 21222 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.798864 23898 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.816788 23699 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.774843 23779 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:23.815061 23622 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:23.811247 23723 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:23.817677 23731 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:23.856382 21812 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:07:23.860769 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:23.861409 21224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1370) took 1609 ms (client timeout 1564 ms). Trace:
I20260709 13:07:23.849619 23898 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.870278 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:23.888922 21295 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:23.876883 21224 rpcz_store.cc:269] 0709 13:07:22.252139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.257256 (+  5117us) service_pool.cc:224] Handling call
0709 13:07:23.853872 (+1596616us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540039b2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:23.861342 (+  7470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448784128}
W20260709 13:07:23.866796 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53902.9us
I20260709 13:07:23.814455 23837 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:23.852552 23879 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:23.894961 23881 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.845110 23379 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:23.910346 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 153015us
I20260709 13:07:23.852339 21219 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:23.957963 21224 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:23.857093 23699 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:23.966491 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 165263us
I20260709 13:07:23.966902 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.968425 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:23.969655 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:23.898907 23856 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.886241 23898 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.971992 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 80889.7us
I20260709 13:07:23.952749 23715 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.956591 23781 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:23.979219 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 109025us
I20260709 13:07:23.953059 23881 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.952885 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:23.997296 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 195455us
I20260709 13:07:23.898149 21218 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:24.012166 21115 leader_election.cc:336] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.620s (SENT)
I20260709 13:07:24.033919 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:23.897825 23712 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:07:23.965649 23695 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.015388 23741 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:23.976583 23856 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.980437 23359 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.035645 21151 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:23.964227 23625 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:23.980908 23915 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.053751 23855 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:23.960491 23879 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:24.057687 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 94832.3us
I20260709 13:07:24.068771 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.026783 23881 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:24.070808 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48437.2us
I20260709 13:07:24.055393 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.069826 23695 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:24.046552 23622 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.086480 23915 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.092203 23821 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:24.093075 23906 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:07:24.093761 23901 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:24.073200 23856 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.094455 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:24.098204 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 126339us
W20260709 13:07:24.152968 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44699us
I20260709 13:07:24.167070 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:24.035518 23731 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.167420 21293 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:24.172245 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 153676us
I20260709 13:07:24.168776 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:24.175041 21299 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:24.079144 23359 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.105988 21219 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:24.106153 23884 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.127452 23820 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.185678 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.086206 23912 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:07:24.193668 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:24.193207 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 181075us
I20260709 13:07:24.097074 23914 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:07:24.105392 23695 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.175182 23523 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:24.202750 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.174188 23771 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.153537 23888 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.107626 23907 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:07:24.214654 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.216013 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.188457 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.217144 21300 raft_consensus.cc:2410] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:24.193608 23913 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.217464 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.222088 21299 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:24.193775 23917 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:24.217967 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.220137 23900 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:07:24.176944 23920 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:24.171023 23871 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:24.201530 23741 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:24.227454 23905 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:07:24.227829 23930 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.228538 21294 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:24.228633 23695 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.229897 23888 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.268435 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.224141 23771 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.230340 23907 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.231611 23879 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.232183 23759 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:24.233189 21291 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.234295 23908 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:24.235713 23909 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:07:24.236091 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.236527 23915 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:24.237012 23916 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:07:24.263271 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:24.226492 23832 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.558s	user 0.000s	sys 0.010s
W20260709 13:07:24.236106 23722 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.003s
I20260709 13:07:24.267160 23379 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.272894 21219 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.224373 23913 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.277878 21299 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:24.281286 21291 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:24.271231 23871 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:24.293411 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 66830.9us
I20260709 13:07:24.280133 23879 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.277354 23908 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:24.302824 21225 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:24.378423 21225 pending_rounds.cc:85] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 5
I20260709 13:07:24.378674 21225 pending_rounds.cc:107] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:24.378911 21225 raft_consensus.cc:2889] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.275795 23759 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:24.389489 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 86025us
W20260709 13:07:24.334064 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.391016 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.391674 21147 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:24.290083 23930 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.276608 23771 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:24.378039 23698 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.007s
I20260709 13:07:24.399503 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:24.391825 23879 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.406628 23759 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.398778 23920 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.407709 23920 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:24.408851 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 113850us
I20260709 13:07:24.407979 23759 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:24.408105 23706 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.003s
I20260709 13:07:24.403214 23722 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.400902 23936 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.409467 23625 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.438766 21300 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:24.437258 23722 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.390401 23871 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.416085 23359 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.426576 23884 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.451337 23936 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.451653 23884 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:24.450459 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:24.462810 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 255917us
W20260709 13:07:24.464959 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 250371us
I20260709 13:07:24.468423 23379 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.468987 23379 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.471720 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:24.472113 21219 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:24.472586 23929 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.472949 23771 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.473135 23929 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.433475 23706 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.474689 23722 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.475415 23896 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.438866 23729 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:24.476079 23706 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:24.475932 23896 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.446038 23908 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.477487 23908 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:24.480206 23934 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:07:24.485725 21223 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.900s	user 0.007s	sys 0.002s
I20260709 13:07:24.486159 21223 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:24.488201 23699 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.004s
I20260709 13:07:24.488627 23699 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.490878 23699 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.492266 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2313) took 1234 ms. Trace:
I20260709 13:07:24.492669 21220 rpcz_store.cc:276] 0709 13:07:23.257913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.380608 (+122695us) service_pool.cc:224] Handling call
0709 13:07:24.492126 (+1111518us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540038b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:24.492222 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993611008}
I20260709 13:07:24.494185 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.494815 21151 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:24.496716 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.498287 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:24.498463 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.460376 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:24.511214 23898 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.499163 21147 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:24.439605 23941 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:07:24.516595 23928 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:24.516927 23608 consensus_meta.cc:287] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.858s	user 0.005s	sys 0.006s
I20260709 13:07:24.516798 23943 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:24.517145 23928 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.517627 23928 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.454027 23698 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:07:24.524047 21293 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:24.526177 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:24.526458 23379 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.463156 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:24.453521 23625 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.496368 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 388) took 1346 ms. Trace:
I20260709 13:07:24.527070 23942 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:24.500694 23847 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.530661 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:24.600647 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 70090.6us
W20260709 13:07:24.536392 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 369425us
I20260709 13:07:24.607816 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:24.610450 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 113948us
I20260709 13:07:24.610532 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:24.611462 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:24.608649 23712 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:24.561493 21150 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:24.535461 23523 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.614050 21114 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:24.572372 21294 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.656280 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:24.615694 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:24.593668 23871 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:24.569264 23936 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.596326 23781 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:24.691743 23781 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.535673 23929 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.607807 23914 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.605154 23757 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:24.591831 23920 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.592434 23884 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.529067 23706 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.594134 23913 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.562403 23622 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.609041 23379 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:24.651836 23881 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.004s
W20260709 13:07:24.726953 23880 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.045s	user 0.012s	sys 0.000s
I20260709 13:07:24.594990 23848 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:24.683239 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67650.8us
I20260709 13:07:24.777802 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:24.603973 21218 rpcz_store.cc:276] 0709 13:07:23.145282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.646489 (+501207us) service_pool.cc:224] Handling call
0709 13:07:23.646788 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.033778 (+386990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.491028 (+457250us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540038c054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:24.491229 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472176896}
I20260709 13:07:24.745683 23379 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.677999 23821 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.688656 23527 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.690539 23359 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.820658 23359 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.821337 23359 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.609926 23760 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.823426 23760 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:24.824292 23760 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.825599 23760 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.784930 23942 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.640146 23695 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.703173 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.646688 23915 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:24.651501 23837 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:24.705871 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49667.3us
I20260709 13:07:24.831246 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:24.711807 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.609354 23847 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:24.730770 23944 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:07:24.731403 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 119977us
W20260709 13:07:24.819918 23907 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 13:07:24.838454 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:24.651384 23904 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:07:24.528097 21807 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 2.
I20260709 13:07:24.651122 23928 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.763151 21226 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:24.706271 23757 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:24.843850 23757 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.844986 23757 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.726879 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 396) took 1017 ms. Trace:
I20260709 13:07:24.613037 23712 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.847394 21219 rpcz_store.cc:276] 0709 13:07:23.709760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.472999 (+763239us) service_pool.cc:224] Handling call
0709 13:07:24.473324 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.473562 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.473589 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.474061 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.612276 (+138215us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:24.612344 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.612426 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.702745 (+ 90319us) raft_consensus.cc:1685] finished
0709 13:07:24.702762 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.726802 (+ 24040us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":114915,"threads_started":1,"wal-append.queue_time_us":210145}
I20260709 13:07:24.848902 23712 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.732344 23898 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.735499 23706 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:24.849294 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.849665 23706 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.850502 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.683758 23941 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.736933 23622 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:24.764211 23523 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:24.762411 23881 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.820537 23871 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.859862 23871 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.861797 23871 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:24.653153 23943 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.862644 23622 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.596978 23856 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.863831 23622 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.865182 23856 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.867843 23523 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.827461 23781 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.570276 23693 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:24.810858 23625 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:24.830117 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.832564 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.833017 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 399) took 1107 ms. Trace:
I20260709 13:07:24.873642 21220 rpcz_store.cc:276] 0709 13:07:23.725992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.493453 (+767461us) service_pool.cc:224] Handling call
0709 13:07:24.493719 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.493903 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:24.494116 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.832679 (+338563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.832730 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:24.832771 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.832833 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.832957 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":13761,"raft.queue_time_us":103,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4244,"thread_start_us":338236,"threads_started":1,"wal-append.queue_time_us":348840}
I20260709 13:07:24.875450 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.876485 21220 raft_consensus.cc:2410] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:24.876955 23911 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.782s	user 0.002s	sys 0.000s
I20260709 13:07:24.877759 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.879187 23821 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:24.880158 23821 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.880942 23928 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.852345 23731 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.881690 23731 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:24.882360 23903 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.828s	user 0.000s	sys 0.012s
I20260709 13:07:24.882507 23731 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.878809 21220 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:24.829722 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52002.1us
I20260709 13:07:24.777387 23848 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:24.884949 23962 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.885886 23962 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.836589 23924 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:24.818606 23379 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.841240 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.886888 23924 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:24.889227 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48061.8us
I20260709 13:07:24.890405 23924 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:24.736930 23914 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.851075 21219 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:24.838398 23915 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.847352 23847 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.857661 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:24.830798 23527 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:24.835981 23695 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.841207 23908 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.840826 23907 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.894618 23924 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:24.885535 23848 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.901587 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.840816 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.902081 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2310) took 1777 ms. Trace:
W20260709 13:07:24.902748 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 61967.7us
I20260709 13:07:24.902482 21221 rpcz_store.cc:276] 0709 13:07:23.120685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.249546 (+128861us) service_pool.cc:224] Handling call
0709 13:07:23.250045 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.623895 (+373850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.623926 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.626130 (+  2204us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.910910 (+284780us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.910979 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.911076 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.875983 (+964907us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:24.894813 (+ 18830us) raft_consensus.cc:1685] finished
0709 13:07:24.894835 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.898369 (+  3534us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33488,"raft.queue_time_us":17645,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":45026,"spinlock_wait_cycles":18519296,"thread_start_us":501811,"threads_started":2,"wal-append.queue_time_us":313390}
I20260709 13:07:24.903612 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:24.898542 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.899291 21150 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:24.906006 21147 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:24.907717 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:24.901954 23848 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.901832 23924 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.892812 23625 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:07:24.920536 21115 leader_election.cc:336] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.598s (SENT)
I20260709 13:07:24.915959 23907 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.922813 23958 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.923983 23915 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.913486 23957 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.913995 23871 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.899895 23913 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:24.916342 23924 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:24.936991 21220 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:24.943179 21115 leader_election.cc:336] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.561s (SENT)
I20260709 13:07:24.943782 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.947862 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.945036 23712 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:24.948447 21151 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
W20260709 13:07:24.951069 21776 connection.cc:256] RPC call timeout handler was delayed by -1.68599228700009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:07:24.951650 21776 connection.cc:256] RPC call timeout handler was delayed by -1.5428922870000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:07:24.945209 23915 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:07:24.952042 21776 connection.cc:256] RPC call timeout handler was delayed by -1.5212922870000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:07:24.952618 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4915922870000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:07:24.952754 21147 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:07:24.952956 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4222922870000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:07:24.953301 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4042922870000893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:07:24.954222 21143 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:24.953677 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4033922870000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:07:24.956405 21776 connection.cc:256] RPC call timeout handler was delayed by -1.4033922870000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:07:24.958320 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.958300 21151 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:24.959194 21776 connection.cc:256] RPC call timeout handler was delayed by -1.2161922870000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:07:24.962790 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.949563 23523 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.950271 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 398) took 1221 ms. Trace:
I20260709 13:07:24.965461 21151 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:24.960858 23845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.011s	sys 0.011s
I20260709 13:07:24.969601 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:24.955366 23962 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:24.969342 23960 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:07:24.970053 23845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.012s	sys 0.011s
I20260709 13:07:24.967898 23943 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.983526 23359 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.984992 23379 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.985594 23359 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.986292 23907 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.986941 23379 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.965811 23924 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:24.973896 23881 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.981038 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:24.978202 23781 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.976012 23914 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:24.999365 23879 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:24.996896 23943 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.009311 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.023031 23930 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.011624 23924 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.020457 23757 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.968173 21223 rpcz_store.cc:276] 0709 13:07:23.725677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.486941 (+761264us) service_pool.cc:224] Handling call
0709 13:07:24.496234 (+  9293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.562703 (+ 66469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.562732 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.613222 (+ 50490us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.810244 (+197022us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.810626 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.810891 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.810993 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.939005 (+128012us) raft_consensus.cc:1685] finished
0709 13:07:24.939037 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.947344 (+  8307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13593,"prepare.queue_time_us":8011,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":36638,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":1429,"thread_start_us":169961,"threads_started":1,"wal-append.queue_time_us":240018}
W20260709 13:07:25.044560 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.049078 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.049182 23879 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:25.050130 21292 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:25.050294 23879 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:25.051196 23908 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.051819 23908 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:25.047807 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.051307 23879 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:25.054311 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.055016 21292 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:25.058563 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49351.4us
I20260709 13:07:25.059940 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.060889 23527 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:25.055624 23879 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:25.063447 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2316) took 1630 ms. Trace:
I20260709 13:07:25.064062 23879 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.065339 23879 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.065606 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.055421 23908 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.068128 23908 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.070206 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.070788 21293 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:25.072857 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.078339 21292 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:25.083003 23896 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:25.063963 21217 rpcz_store.cc:276] 0709 13:07:23.432928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.651182 (+218254us) service_pool.cc:224] Handling call
0709 13:07:23.681408 (+ 30226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.810957 (+129549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.811001 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.816331 (+  5330us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.011230 (+194899us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:24.011293 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.062945 (+1051652us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002373d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:25.063005 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.063065 (+    60us) raft_consensus.cc:1685] finished
0709 13:07:25.063085 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.063363 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9547,"raft.queue_time_us":1041,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":32511,"spinlock_wait_cycles":296100608,"thread_start_us":140844,"threads_started":1,"wal-append.queue_time_us":252277}
I20260709 13:07:25.084879 23779 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.089514 21291 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:25.091343 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.092118 21298 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:25.057641 23964 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:25.094357 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.082639 23706 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.099112 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.099771 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.099776 21291 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.102273 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.102840 21217 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:07:25.103027 21220 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:25.104121 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.104571 21220 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:25.105365 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.053795 23757 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.111845 21296 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.115809 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.115969 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.099165 23715 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:25.119232 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.106045 23881 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.106683 23930 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.106824 23379 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.120005 23760 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:25.121994 23847 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:25.121881 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.121284 23715 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.125664 21292 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:25.123903 23760 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.123864 23379 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.128705 23760 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.130484 23379 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:25.125293 23881 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.132367 23881 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:25.127959 23847 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:25.133415 23847 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.134719 23760 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:25.135640 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.136971 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:25.138962 21297 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:25.140030 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.143378 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 505) took 1048 ms. Trace:
I20260709 13:07:25.143901 21294 rpcz_store.cc:276] 0709 13:07:24.095353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.301867 (+206514us) service_pool.cc:224] Handling call
0709 13:07:24.529261 (+227394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.678170 (+148909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.143127 (+464957us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001b1a50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:25.143305 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299265920}
I20260709 13:07:25.148826 23757 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:25.149675 23968 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:25.149767 21295 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.150625 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1884) took 1262 ms. Trace:
I20260709 13:07:25.152594 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1733) took 1466 ms. Trace:
I20260709 13:07:25.152976 21148 rpcz_store.cc:276] 0709 13:07:23.686493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.695346 (+  8853us) service_pool.cc:224] Handling call
0709 13:07:23.769507 (+ 74161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.024776 (+255269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.024865 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.489325 (+464460us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:24.489883 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.640096 (+150213us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:24.654728 (+ 14632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.152281 (+497553us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5400065754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:25.152332 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.152380 (+    48us) raft_consensus.cc:1685] finished
0709 13:07:25.152393 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.152539 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136164,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6716,"spinlock_wait_cycles":109671936,"thread_start_us":281747,"threads_started":2,"wal-append.queue_time_us":249535}
W20260709 13:07:25.155417 23927 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.760s	user 0.003s	sys 0.001s
I20260709 13:07:25.158365 23958 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.151000 21295 rpcz_store.cc:276] 0709 13:07:23.891399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.891657 (+   258us) service_pool.cc:224] Handling call
0709 13:07:25.149312 (+1257655us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:25.149545 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.150337 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.150559 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17229056}
I20260709 13:07:25.161495 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.164950 21812 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:25.164963 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 105331us
I20260709 13:07:25.165844 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.166108 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.163414 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.124017 23871 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.162990 23940 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.163201 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.167837 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.168569 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.170919 21294 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:25.188730 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.189278 21810 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.174849 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2323) took 1162 ms. Trace:
I20260709 13:07:25.175751 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:25.170872 23760 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:25.176798 23706 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:25.189771 21291 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:25.190372 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:25.190833 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.188453 23781 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:25.188910 23622 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:25.243924 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 64649.3us
I20260709 13:07:25.245071 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.228170 23781 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.247066 23781 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.247643 23930 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.248382 23930 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.249197 23759 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:25.249719 23759 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.252084 23759 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:25.192907 21807 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:25.199605 21809 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:25.213342 23855 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.180426 23958 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.254072 23958 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:25.254410 23715 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:25.220639 21805 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:25.222936 21292 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.257898 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:25.252008 23972 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:25.260378 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.260962 21813 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.261118 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.224274 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.261696 21221 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:25.231547 21300 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:25.233084 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.233517 21810 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:25.252929 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.212919 23695 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:25.258424 21220 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.214658 23270 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.265538 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.264029 23708 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.267812 21805 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.267964 23708 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.268355 23708 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.272843 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.273475 21295 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:25.274365 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.274884 21295 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:25.276923 23942 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.277604 23942 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.277909 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.278666 21295 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:25.278908 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.279419 23941 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.280666 23941 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:25.282390 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 387) took 2137 ms. Trace:
I20260709 13:07:25.282670 21292 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:25.283293 23729 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.282900 21225 rpcz_store.cc:276] 0709 13:07:23.144836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.632836 (+488000us) service_pool.cc:224] Handling call
0709 13:07:23.633081 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.392772 (+759691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.282136 (+889364us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54000ed8d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:25.282324 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539379968}
I20260709 13:07:25.283928 23729 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:25.284847 23729 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:25.285979 23729 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.286078 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 393) took 1585 ms. Trace:
I20260709 13:07:25.286602 21224 rpcz_store.cc:276] 0709 13:07:23.700564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.902721 (+202157us) service_pool.cc:224] Handling call
0709 13:07:23.957750 (+ 55029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.958350 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.285856 (+1327506us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54000ec4d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:25.286013 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125689600}
I20260709 13:07:25.289278 23819 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.290484 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.291554 23930 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:25.292038 23930 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.292354 23930 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.263988 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.294049 21809 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.295929 21776 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:07:25.296545 21776 leader_election.cc:403] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:25.265985 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.296408 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.266729 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.299928 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.300238 21217 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:25.297302 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.297237 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.297953 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:25.298661 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.301918 21296 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:25.300668 21292 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:25.303958 21220 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:25.304620 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:25.305570 21298 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:25.306042 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 397) took 1580 ms (client timeout 1662 ms). Trace:
W20260709 13:07:25.306417 21226 rpcz_store.cc:269] 0709 13:07:23.725320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.763568 (+ 38248us) service_pool.cc:224] Handling call
0709 13:07:25.305886 (+1542318us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540038b154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:25.305989 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229671680}
W20260709 13:07:25.308936 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 114091us
I20260709 13:07:25.309808 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:25.310348 21115 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.798s (SENT)
I20260709 13:07:25.312510 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.324350 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:25.327623 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.328068 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.329071 21813 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:25.329504 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:25.329965 21224 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:25.331405 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.337175 21221 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:25.345752 21115 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.957s (SENT)
I20260709 13:07:25.336154 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:25.346312 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:25.340740 21114 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.348482 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.349274 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.349541 21224 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:25.350221 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.350585 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.350771 21150 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:25.351163 21144 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:25.355865 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.357963 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.358083 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.191601 21219 rpcz_store.cc:276] 0709 13:07:24.011977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.914083 (+902106us) service_pool.cc:224] Handling call
0709 13:07:24.930168 (+ 16085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.955365 (+ 25197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.955397 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.978732 (+ 23335us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.037635 (+ 58903us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:25.053690 (+ 16055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.056067 (+  2377us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.174595 (+118528us) raft_consensus.cc:1685] finished
0709 13:07:25.174617 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.174780 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1629,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5376,"thread_start_us":46992,"threads_started":1,"wal-append.queue_time_us":118832}
I20260709 13:07:25.359570 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.352079 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:25.360239 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.360980 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:25.361562 21221 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.384816 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.336336 23918 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:25.386260 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:25.386667 21115 leader_election.cc:336] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.005s (SENT)
I20260709 13:07:25.387181 21292 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:25.387109 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:25.387816 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 164290us
I20260709 13:07:25.363611 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:25.364215 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 140027us
I20260709 13:07:25.391242 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.336714 23888 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.366029 23845 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.366329 23804 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:25.386906 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:25.366894 23924 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:25.367189 21226 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:25.394553 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.407369 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.311386 23625 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:25.347463 23882 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.381646 23914 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:25.369822 23708 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:25.358263 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:25.371521 23270 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:25.371680 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 61987.5us
I20260709 13:07:25.372037 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.372884 21151 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:25.373097 21218 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.373307 21219 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:25.373636 23958 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:25.376488 23879 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:25.377743 21225 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:25.373668 21805 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:25.347095 23527 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.357997 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:25.446861 21147 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.444795 21221 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:25.404356 23695 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.384114 21146 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:07:25.311882 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.353108 23847 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.410905 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.420630 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:25.422489 21143 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:25.442221 21115 leader_election.cc:336] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.036s (SENT)
I20260709 13:07:25.393997 23779 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.382839 21217 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:25.445569 23942 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:07:25.427838 23757 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.428686 23804 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:25.404826 23760 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:25.414209 23882 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.406013 23715 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:25.400525 23855 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:07:25.428062 23759 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:07:25.448668 21224 raft_consensus.cc:2368] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7.
I20260709 13:07:25.394060 23917 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.824997 21147 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:26.000500 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.001075 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.832984 21776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.037s
W20260709 13:07:25.498889 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 191785us
W20260709 13:07:26.002038 21776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.011s	sys 0.041s
W20260709 13:07:26.002435 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 706585us
I20260709 13:07:25.629631 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:25.499975 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:26.003433 21292 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
W20260709 13:07:25.990051 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.571213 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:25.414166 23871 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.421963 23914 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.997198 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 554992us
W20260709 13:07:26.008253 21115 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.127s (SENT) [suppressed 40 similar messages]
W20260709 13:07:26.004482 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.427485 23270 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:26.005380 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.013491 21813 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:26.005502 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.006060 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:25.488940 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.943482 23930 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:07:26.011634 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.011739 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.021709 21808 raft_consensus.cc:2410] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:26.011982 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.012414 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:25.754884 23781 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:07:26.004423 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.017343 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:26.006992 23976 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 13:07:25.544061 23848 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.521214 23625 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:25.996644 23943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.015s	sys 0.030s
I20260709 13:07:26.001573 23882 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.477636 23881 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:25.958787 23908 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.030974 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.007660 23940 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.034034 21811 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:26.047400 21813 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
I20260709 13:07:26.035940 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.016674 23270 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.014240 23914 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.016122 23708 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.036712 21146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:07:26.071391 21146 raft_consensus.cc:606] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Received request to transfer leadership
I20260709 13:07:26.016726 23983 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.040597 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.073163 21808 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:26.041077 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:25.449257 23879 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.012673 23804 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.048300 21806 raft_consensus.cc:2410] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:26.048480 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.048709 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:26.044888 23943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.015s	sys 0.031s
I20260709 13:07:26.009456 23847 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:26.044013 23622 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.801s	user 0.007s	sys 0.003s
I20260709 13:07:26.038072 23781 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.040021 23625 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:26.037561 23848 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:26.050321 23940 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.024744 23930 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.014791 23779 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.084371 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.085146 23781 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.007452 23695 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.053929 21293 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:26.085516 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.085664 23781 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.054473 23527 consensus_meta.cc:287] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.000s
I20260709 13:07:26.086194 21806 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:26.086599 23527 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.055187 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.038872 23715 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.010143 23757 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.056496 23698 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.056520 23855 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.087587 21142 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:26.016721 23871 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.066504 21805 raft_consensus.cc:2368] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
W20260709 13:07:26.081197 21149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.025s	sys 0.048s
I20260709 13:07:26.087318 21144 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:26.091562 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.101199 21811 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:26.087082 21222 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:26.057400 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.101799 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:26.102344 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45028us
I20260709 13:07:26.093087 21146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:07:26.103240 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.103551 21146 raft_consensus.cc:606] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Received request to transfer leadership
W20260709 13:07:26.107860 21149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.025s	sys 0.048s
I20260709 13:07:26.070345 23908 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.069868 23881 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.082485 23622 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.121361 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.087471 23695 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.094215 23698 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.087129 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.086275 23781 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.125662 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.133694 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.085662 23779 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.125507 23759 consensus_queue.cc:1243] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:07:26.129320 23986 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:26.099802 23855 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.135545 23779 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.135794 23855 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.136015 23779 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.134938 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:26.140159 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 719554us
W20260709 13:07:26.140915 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.141450 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.077859 23983 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.177289 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.178742 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 511) took 1040 ms. Trace:
I20260709 13:07:26.179225 21297 rpcz_store.cc:276] 0709 13:07:25.138086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.140822 (+  2736us) service_pool.cc:224] Handling call
0709 13:07:25.141080 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.141379 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:25.141635 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.384677 (+243042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.385669 (+   992us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.385832 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.385876 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.419124 (+ 33248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.178473 (+759349us) raft_consensus.cc:1685] finished
0709 13:07:26.178498 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.178670 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9796,"prepare.queue_time_us":313,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":367,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13041,"thread_start_us":242533,"threads_started":1,"wal-append.queue_time_us":586454}
I20260709 13:07:26.184201 21808 raft_consensus.cc:2410] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:26.132164 23698 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.192276 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.177917 21806 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:26.131480 21223 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:26.104785 23715 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.198915 21810 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:26.202670 23729 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.916s	user 0.013s	sys 0.000s
I20260709 13:07:26.203543 23871 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:26.204181 23871 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:26.204730 23871 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.208909 23779 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.209640 23779 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:26.210991 23978 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:07:26.212339 21812 raft_consensus.cc:2410] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:26.212694 23881 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.186159 23625 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.219946 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.298703 21808 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:26.300009 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.300680 21808 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.191594 23847 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.221653 23757 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:26.200006 21809 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.905s	user 0.006s	sys 0.006s
I20260709 13:07:26.229449 23695 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.235029 23896 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.341810 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.239985 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.244625 23527 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.245216 23708 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.182395 23759 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.354722 23896 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:26.354894 23759 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:26.355276 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.355887 21145 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.355790 23896 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.356025 23759 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:26.259320 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 251084us
I20260709 13:07:26.230841 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.359884 21143 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:26.263929 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:26.360247 21115 leader_election.cc:336] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.131s (SENT)
W20260709 13:07:26.360731 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 96896us
W20260709 13:07:26.361042 21115 leader_election.cc:336] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.173s (SENT)
I20260709 13:07:26.265652 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.362142 21144 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:26.267668 21298 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.272141 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:26.363293 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 295975us
I20260709 13:07:26.296260 21150 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:26.363997 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.297308 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:26.190905 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.207019 23871 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:26.183462 23943 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 13:07:26.342690 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 235229us
I20260709 13:07:26.371822 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.345392 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.372659 21151 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.254711 23270 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.353864 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:26.363425 21293 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.295240 21149 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:26.381402 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.336464 21809 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
W20260709 13:07:26.378492 23978 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:26.346688 23757 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:26.408424 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.351660 23625 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.396546 21293 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:26.376843 23845 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.411104 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 908) took 1147 ms. Trace:
I20260709 13:07:26.413158 21298 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:26.404441 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2286) took 1130 ms. Trace:
I20260709 13:07:26.413777 21296 rpcz_store.cc:276] 0709 13:07:25.273934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.278636 (+  4702us) service_pool.cc:224] Handling call
0709 13:07:26.404275 (+1125639us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b540018c4d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:26.404378 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51156352}
I20260709 13:07:26.400651 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.411595 21809 rpcz_store.cc:276] 0709 13:07:25.258909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.260621 (+  1712us) service_pool.cc:224] Handling call
0709 13:07:26.405933 (+1145312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.350397 23760 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:26.417030 21145 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:26.417879 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.418530 21144 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:26.387353 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.386130 23871 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.427455 21151 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:26.371917 23527 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:26.428709 23979 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:07:26.428550 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.380589 23622 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:26.351239 23695 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.423012 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.449033 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.449621 21145 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.432236 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:26.438648 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:26.412452 23845 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.412513 23879 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.420827 23985 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.376775 23708 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.416204 21805 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:26.447639 23940 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.472901 21144 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:26.474594 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.455862 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:26.454550 23908 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:26.458629 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 370688us
I20260709 13:07:26.455300 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.417774 23984 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:26.457237 21145 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:26.429414 23757 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.453787 23845 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.457726 23819 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.502298 21143 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:26.468695 21147 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:26.445847 23871 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.463488 23985 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.463662 23930 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.461541 23989 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.468672 23881 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:26.520967 23908 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.526018 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:26.531461 21297 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:07:26.518903 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 353586us
W20260709 13:07:26.518488 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 62716us
I20260709 13:07:26.534464 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.534701 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:26.536190 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.536684 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.538856 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.539951 21144 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:26.504348 23847 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.542536 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:26.543563 21144 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:26.545907 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:26.469394 23941 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:26.516963 23983 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.506693 23715 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.469527 23729 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:07:26.624529 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 89896.3us
I20260709 13:07:26.625590 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:26.525460 23985 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.530735 23989 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:26.669323 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.670204 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.671419 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.539611 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.689847 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1901) took 1623 ms. Trace:
I20260709 13:07:26.516772 23882 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.706678 21300 rpcz_store.cc:276] 0709 13:07:25.066891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.066986 (+    95us) service_pool.cc:224] Handling call
0709 13:07:25.067247 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.262696 (+195449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.689522 (+1426826us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540022d3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:26.689767 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305981696}
I20260709 13:07:26.718361 21291 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:26.719362 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2292) took 1415 ms. Trace:
I20260709 13:07:26.719836 21291 rpcz_store.cc:276] 0709 13:07:25.304321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.563897 (+259576us) service_pool.cc:224] Handling call
0709 13:07:26.704658 (+1140761us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:26.704950 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.718997 (+ 14047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.719291 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239134464}
W20260709 13:07:26.721638 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 460197us
I20260709 13:07:26.726399 21808 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:26.728986 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.730544 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.731604 21808 raft_consensus.cc:2410] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:26.732530 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.559820 23990 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:26.737617 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 66338.5us
I20260709 13:07:26.688227 23992 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:26.738790 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 113310us
I20260709 13:07:26.504711 23760 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.746555 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.749797 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.751417 23693 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:26.759649 21223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2333) took 1503 ms (client timeout 1733 ms). Trace:
I20260709 13:07:26.761968 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1410) took 1347 ms. Trace:
I20260709 13:07:26.565150 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.770759 21189 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:26.686520 23989 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.727780 23270 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.735570 23941 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.733353 23881 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:26.736969 24000 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.773728 21808 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:26.774190 23942 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:26.811474 23942 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:26.811910 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.812769 21808 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:26.812482 23942 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.813886 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.814046 23942 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.767172 23879 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.765938 24008 raft_consensus.cc:2764] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:07:26.804705 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 372974us
W20260709 13:07:26.781840 21223 rpcz_store.cc:269] 0709 13:07:25.256702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.256810 (+   108us) service_pool.cc:224] Handling call
0709 13:07:26.759427 (+1502617us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000ebfd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:26.759565 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283810688}
I20260709 13:07:26.801162 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:26.782011 21142 rpcz_store.cc:276] 0709 13:07:25.422361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.423056 (+   695us) service_pool.cc:224] Handling call
0709 13:07:25.961256 (+538200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.090901 (+129645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.761678 (+670777us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540026a7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:26.761899 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289783040}
W20260709 13:07:26.784166 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 402819us
I20260709 13:07:26.809967 21809 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:26.826324 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:26.827598 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.833602 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.827237 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:26.815239 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.826473 21813 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:26.795636 23698 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
W20260709 13:07:26.804654 21033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 366312us
I20260709 13:07:26.834806 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.800300 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:26.842664 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:26.839608 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:26.800316 21806 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:26.821564 23270 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.845664 21809 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:26.810572 23913 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:26.846763 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.824471 23527 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.804566 23759 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.773860 23990 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.858279 23759 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:26.860446 23759 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:26.837105 23695 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:26.861825 21813 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:26.862809 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.863279 23695 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.863756 23695 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:26.863633 23881 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.864311 23695 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.836812 23708 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.832057 23998 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.847527 23820 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.873034 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.852908 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.853528 21808 raft_consensus.cc:2368] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:26.794211 21805 raft_consensus.cc:2376] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:07:26.816180 23941 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.857719 23757 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:26.861171 23759 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.785677 23693 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:26.775432 23993 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:26.848496 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.787034 23940 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:07:26.840746 24008 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:26.850044 23847 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.911551 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:26.845265 23698 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:26.923353 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.954265 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.833002 23879 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.822615 24000 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.962083 21145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35736
W20260709 13:07:26.954975 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.965332 21145 raft_consensus.cc:606] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Received request to transfer leadership
W20260709 13:07:26.965692 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 178997us
I20260709 13:07:26.967912 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:26.969440 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:26.912144 23270 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:26.972339 21809 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:26.913055 24002 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:26.910559 23819 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:26.992177 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:26.869477 23913 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:27.035127 24033 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:27.037082 23527 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.918824 23820 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:26.988984 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:26.995776 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:26.952876 23757 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.918959 23998 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:27.309293 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:26.995249 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:27.111300 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 268390us
I20260709 13:07:27.297623 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:27.321630 21223 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:27.321715 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:27.080265 21097 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:27.322779 21097 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 68ebd645703043ddb9e32ba2d84bbc1e already in progress
W20260709 13:07:27.292974 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 466686us
I20260709 13:07:26.971246 23896 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:27.224925 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 64747.1us
W20260709 13:07:27.323144 21097 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 68ebd645703043ddb9e32ba2d84bbc1e already in progress
W20260709 13:07:27.041989 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 68784us
W20260709 13:07:27.334882 23779 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.125s	user 0.018s	sys 0.001s
W20260709 13:07:26.995680 24005 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.431s	user 0.001s	sys 0.001s
I20260709 13:07:26.979010 23847 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:27.354033 21220 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:27.079494 24011 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:07:27.267223 23936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.004s	sys 0.027s
W20260709 13:07:27.272748 24012 log.cc:927] Time spent T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260709 13:07:27.080063 24003 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:07:27.498679 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:27.499640 21293 raft_consensus.cc:2410] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:26.994587 23940 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.271586 21148 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.824s	user 0.001s	sys 0.009s
I20260709 13:07:27.020251 23270 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:27.224442 24025 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:27.394196 21297 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.862s	user 0.006s	sys 0.002s
I20260709 13:07:27.399075 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:27.319226 23757 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.248772 23881 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:27.079156 23941 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:27.297405 24016 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.319187 24033 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:27.046794 23882 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:27.284772 23992 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:27.454229 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:27.046379 23871 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:27.640431 21220 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.965375 24008 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:27.078217 24037 raft_consensus.cc:2764] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:27.466657 21222 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:27.466717 21225 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:27.466876 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:27.130714 23693 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:27.477110 24032 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:07:27.479728 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:27.481920 23804 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:27.484409 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:27.484627 23820 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:27.408447 23936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.004s	sys 0.028s
I20260709 13:07:27.356753 23993 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:27.380638 23896 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:27.389153 24022 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.281299 24027 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.203s
I20260709 13:07:27.021492 23819 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:27.487701 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:27.378844 23779 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.376694 21806 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:27.448720 24036 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.996869 24013 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.494462 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:27.495268 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 170810us
I20260709 13:07:27.509033 24000 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:27.338786 24002 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:27.490041 23985 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.001s
W20260709 13:07:27.490734 23855 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.353s	user 0.009s	sys 0.009s
W20260709 13:07:27.516866 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 195091us
W20260709 13:07:27.521543 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 525821us
I20260709 13:07:27.541199 21297 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
W20260709 13:07:27.506017 23914 consensus_meta.cc:287] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.429s	user 0.009s	sys 0.004s
I20260709 13:07:27.465866 24029 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.554543 21292 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:27.500321 23943 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.500141 23924 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:27.489856 24028 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.560055 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:27.521800 23698 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:27.562529 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:27.542793 24021 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.557928 23760 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.539844 21148 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:27.553231 23757 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.541019 24025 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:27.487884 23848 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:27.556859 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 261848us
I20260709 13:07:27.561610 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:27.544499 23940 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:27.939190 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 377649us
I20260709 13:07:27.939675 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:27.939708 21298 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:27.940448 21224 raft_consensus.cc:2410] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:27.941591 21300 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:27.942531 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:27.629437 23881 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:27.554672 23847 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:27.944344 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:27.721292 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:27.709596 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:27.708591 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1743) took 1482 ms. Trace:
I20260709 13:07:27.955454 21150 raft_consensus.cc:2376] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4. Re-sending same reply.
I20260709 13:07:27.955498 21147 rpcz_store.cc:276] 0709 13:07:26.226549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.231360 (+  4811us) service_pool.cc:224] Handling call
0709 13:07:26.231727 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.517146 (+285419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.708250 (+1191104us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400214b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:27.708517 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544436480}
I20260709 13:07:27.692826 21220 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:27.947561 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 952310us
I20260709 13:07:27.957904 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:27.553475 24038 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.942414 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 518) took 1439 ms. Trace:
W20260709 13:07:27.956194 21150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1751) took 1582 ms (client timeout 1866 ms). Trace:
W20260709 13:07:27.946399 21190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.028s	sys 0.036s
W20260709 13:07:27.956825 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.959329 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:27.962941 21814 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:27.707033 24030 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:07:27.991572 21263 leader_election.cc:400] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7.
I20260709 13:07:28.002751 21263 leader_election.cc:403] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:27.705651 24023 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:07:27.703318 23917 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.013s	sys 0.022s
I20260709 13:07:27.998549 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 799) took 1948 ms. Trace:
W20260709 13:07:27.997638 21150 rpcz_store.cc:269] 0709 13:07:26.374019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.374350 (+   331us) service_pool.cc:224] Handling call
0709 13:07:27.709404 (+1335054us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:27.956125 (+246721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11699072}
I20260709 13:07:28.004597 24037 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.008560 21808 rpcz_store.cc:276] 0709 13:07:26.050579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.487451 (+1436872us) service_pool.cc:224] Handling call
0709 13:07:27.998488 (+511037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:27.671941 23882 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.290s
W20260709 13:07:27.996891 21190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.028s	sys 0.040s
I20260709 13:07:27.979087 23993 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:28.004145 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:27.951568 23985 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:27.951985 23855 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.007323 24013 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.999115 23635 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:27.951076 23924 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.004698 24008 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:27.979331 24022 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:28.005771 23625 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.589s	user 0.004s	sys 0.008s
I20260709 13:07:27.943548 24017 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.951231 23943 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:28.006382 24040 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:28.006315 21839 heartbeater.cc:646] Failed to heartbeat to 127.19.145.62:44287 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.145.62:44287 timed out after 15.000s (SENT)
W20260709 13:07:28.009999 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 56720.2us
I20260709 13:07:27.675796 23879 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:28.031689 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 72473.7us
W20260709 13:07:28.006938 23989 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.207s	user 0.008s	sys 0.004s
I20260709 13:07:27.998518 21297 rpcz_store.cc:276] 0709 13:07:26.502878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.503029 (+   151us) service_pool.cc:224] Handling call
0709 13:07:27.942360 (+1439331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:27.707723 24014 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:07:28.012472 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:27.947952 23998 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:27.779651 23270 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:27.978227 24036 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:28.045025 23845 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.519s	user 0.006s	sys 0.005s
I20260709 13:07:27.943434 23984 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.938825 23760 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:27.696488 23913 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:27.716534 24026 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.031129 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:28.030401 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:28.203212 23757 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.203531 23845 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:28.206887 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 176555us
I20260709 13:07:28.207369 21143 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:28.204524 21224 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:28.208961 21143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1760) took 1675 ms (client timeout 1861 ms). Trace:
W20260709 13:07:28.209349 21143 rpcz_store.cc:269] 0709 13:07:26.534066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.534220 (+   154us) service_pool.cc:224] Handling call
0709 13:07:28.208785 (+1674565us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540017d754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.208909 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3845655808}
I20260709 13:07:28.173308 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:28.211776 21263 connection.cc:256] RPC call timeout handler was delayed by -1.9344008790000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:07:28.029922 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.023810 21225 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:28.032001 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.031638 21145 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.030066 21813 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:27.677553 23871 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.326s
W20260709 13:07:28.039928 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.941821 24029 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:28.028551 23693 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.030092 24037 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:28.041062 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 781) took 2037 ms. Trace:
I20260709 13:07:28.240293 23896 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.244107 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1914) took 2843 ms. Trace:
I20260709 13:07:28.244504 21295 rpcz_store.cc:276] 0709 13:07:25.400370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.602554 (+202184us) service_pool.cc:224] Handling call
0709 13:07:25.655013 (+ 52459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.458180 (+803167us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:26.458216 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.474817 (+ 16601us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.952478 (+477661us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:26.952516 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.722692 (+770176us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540001b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:27.722754 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.243815 (+521061us) raft_consensus.cc:1685] finished
0709 13:07:28.243837 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.244033 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257794,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":19232,"spinlock_wait_cycles":1076636032,"thread_start_us":780143,"threads_started":2,"wal-append.queue_time_us":789235}
I20260709 13:07:27.960440 23914 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.247853 23914 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.248437 21146 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.248911 23845 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.240314 21807 rpcz_store.cc:276] 0709 13:07:26.003946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.007801 (+  3855us) service_pool.cc:224] Handling call
0709 13:07:26.038498 (+ 30697us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.201222 (+162724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.201281 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:26.202018 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 13:07:26.553222 (+351204us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.734562 (+181340us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.774393 (+ 39831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.475690 (+701297us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b180032b0c0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:27.712187 (+236497us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54004fa1d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:27.712261 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.023913 (+311652us) spinlock_profiling.cc:243] Waited 9.69 ms on lock 0x7b180032b0c0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:28.030034 (+  6121us) raft_consensus.cc:1685] finished
0709 13:07:28.034212 (+  4178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.040999 (+  6787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31854,"prepare.queue_time_us":89169,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":24812,"raft.queue_time_us":42450,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":226,"spinlock_wait_cycles":400648192,"thread_start_us":322969,"threads_started":1,"wal-append.queue_time_us":573519}
I20260709 13:07:28.251122 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 801) took 2200 ms. Trace:
I20260709 13:07:28.251518 21813 rpcz_store.cc:276] 0709 13:07:26.051079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.862555 (+811476us) service_pool.cc:224] Handling call
0709 13:07:28.250935 (+1388380us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54006c02d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.251068 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682476416}
I20260709 13:07:28.251865 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.252451 21807 raft_consensus.cc:2376] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:07:28.252538 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.252921 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 823) took 1244 ms. Trace:
I20260709 13:07:28.253188 21813 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:28.253611 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 826) took 1210 ms. Trace:
I20260709 13:07:28.254606 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.031594 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:27.961723 24020 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.255476 21814 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:28.056963 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.256014 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 224482us
I20260709 13:07:28.064162 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 784) took 2059 ms. Trace:
I20260709 13:07:28.256794 21812 rpcz_store.cc:276] 0709 13:07:26.005141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.005284 (+   143us) service_pool.cc:224] Handling call
0709 13:07:28.063954 (+2058670us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.064091 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455107456}
I20260709 13:07:28.257949 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.258540 21812 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:28.046998 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 554) took 1199 ms. Trace:
W20260709 13:07:28.065680 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1389) took 2676 ms (client timeout 1506 ms). Trace:
W20260709 13:07:28.262262 21226 rpcz_store.cc:269] 0709 13:07:25.388795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.407045 (+ 18250us) service_pool.cc:224] Handling call
0709 13:07:28.065446 (+2658401us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540038cf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.065604 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4859055360}
I20260709 13:07:28.263763 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.265096 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.064903 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1757) took 1621 ms. Trace:
W20260709 13:07:27.706539 24024 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:07:27.963002 21148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1746) took 1674 ms (client timeout 1739 ms). Trace:
W20260709 13:07:28.277909 21148 rpcz_store.cc:269] 0709 13:07:26.278811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.297825 (+ 19014us) service_pool.cc:224] Handling call
0709 13:07:27.952642 (+1654817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.277559 24025 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:28.278988 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:28.279453 21219 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:28.051295 24039 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:28.280136 24039 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.280404 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:28.079033 23695 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.214s	user 0.009s	sys 0.004s
I20260709 13:07:28.281160 23695 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.281701 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:28.024381 24016 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.148756 24017 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.058362 23940 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.283329 21149 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:28.011518 23917 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.543s	user 0.018s	sys 0.052s
W20260709 13:07:28.149662 23980 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 2.174s	user 0.006s	sys 0.001s
I20260709 13:07:28.153218 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.000341 23848 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.291607 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2280) took 3019 ms. Trace:
I20260709 13:07:28.291838 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 550) took 2066 ms. Trace:
I20260709 13:07:28.292240 21146 rpcz_store.cc:276] 0709 13:07:26.225923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.229979 (+  4056us) service_pool.cc:224] Handling call
0709 13:07:26.230343 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.248833 (+2018490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.291560 (+ 42727us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b540031d8d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:28.291784 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4640847616}
I20260709 13:07:28.291960 21294 rpcz_store.cc:276] 0709 13:07:25.272122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.274837 (+  2715us) service_pool.cc:224] Handling call
0709 13:07:25.275106 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.275489 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.275520 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.276005 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.456164 (+180159us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:25.456219 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.456287 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.149087 (+2692800us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:28.291320 (+142233us) raft_consensus.cc:1685] finished
0709 13:07:28.291342 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.291551 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1769,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":250,"spinlock_wait_cycles":81318144,"thread_start_us":178108,"threads_started":1,"wal-append.queue_time_us":699584}
I20260709 13:07:28.157087 21811 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:27.961582 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 819) took 1476 ms. Trace:
I20260709 13:07:28.014849 24053 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.160049 24036 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:28.162575 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.166460 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:28.175964 23990 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.044343 23723 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:28.069041 23994 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:28.177201 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:28.178377 23942 consensus_meta.cc:287] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.364s	user 0.012s	sys 0.002s
I20260709 13:07:28.025226 23993 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.179510 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 552) took 1358 ms. Trace:
I20260709 13:07:28.179804 23819 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.018929 23958 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:07:28.186545 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:28.084601 24047 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.055683 23999 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:28.084919 24027 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7.
I20260709 13:07:28.193948 24022 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.052634 23781 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.028921 23855 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.027791 23881 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.015792 23992 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:28.018987 24002 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:28.069957 23987 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 2.094s	user 0.006s	sys 0.021s
I20260709 13:07:28.026192 23779 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.028362 24013 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:28.047475 23924 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:28.196863 23989 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.197589 21217 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:28.029274 23635 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.178853 23943 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:28.210417 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:28.203966 23760 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.225382 24049 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.225795 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 914) took 2214 ms. Trace:
W20260709 13:07:28.237453 21265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.053s	sys 0.089s
I20260709 13:07:27.718232 24033 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:28.239424 24029 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.235386 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:27.952419 24021 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.007862 24038 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.239861 24037 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.951742 23804 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.144989 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:28.603327 24000 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.266052 21151 rpcz_store.cc:276] 0709 13:07:26.443426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.444110 (+   684us) service_pool.cc:224] Handling call
0709 13:07:26.444536 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.454640 (+ 10104us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:26.787950 (+333310us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.991601 (+203651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.991672 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:26.991740 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.064628 (+1072888us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b5400065754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:28.064682 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.064837 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28220,"prepare.queue_time_us":397290,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":424154,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":51213,"spinlock_wait_cycles":22604032,"thread_start_us":493159,"threads_started":2,"wal-append.queue_time_us":543591}
W20260709 13:07:28.063635 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 790) took 2045 ms (client timeout 1561 ms). Trace:
I20260709 13:07:28.398140 24036 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.603395 23994 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:28.274866 24020 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.276822 23757 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.279604 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 821) took 1275 ms. Trace:
I20260709 13:07:28.280563 24039 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.067234 23908 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.519s	user 0.010s	sys 0.000s
I20260709 13:07:28.624094 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:28.026809 23985 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.259294 21142 rpcz_store.cc:276] 0709 13:07:26.847177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.847614 (+   437us) service_pool.cc:224] Handling call
0709 13:07:26.847931 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.134285 (+286354us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:27.134609 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.277731 (+143122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:27.277802 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:27.277869 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.046738 (+768869us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54001f7554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:28.046793 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.046933 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":487,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":193372,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4769,"spinlock_wait_cycles":657816448,"thread_start_us":142750,"threads_started":1,"wal-append.queue_time_us":421322}
I20260709 13:07:28.616930 21218 raft_consensus.cc:2376] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5. Re-sending same reply.
W20260709 13:07:28.352648 21811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 736) took 2285 ms (client timeout 1662 ms). Trace:
I20260709 13:07:28.294096 23622 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.353803 21048 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 253) took 16943 ms (client timeout 15000 ms). Trace:
I20260709 13:07:28.354110 23723 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.255493 24026 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:28.485700 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.009s
W20260709 13:07:28.701395 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.014s
I20260709 13:07:28.702279 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:28.678102 24049 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.353768 21046 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.253893 21813 rpcz_store.cc:276] 0709 13:07:27.049361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.252311 (+1202950us) service_pool.cc:224] Handling call
0709 13:07:28.253559 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.700628 23622 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.709159 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.355645 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:28.444175 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.713250 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:28.381212 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 418252us
I20260709 13:07:28.604820 21147 raft_consensus.cc:2376] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7. Re-sending same reply.
I20260709 13:07:28.606191 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:28.607010 21291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.044s	sys 0.098s
I20260709 13:07:28.607277 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:28.720041 21291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.045s	sys 0.098s
I20260709 13:07:28.720275 21146 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:28.599819 21144 rpcz_store.cc:276] 0709 13:07:26.820925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.821165 (+   240us) service_pool.cc:224] Handling call
0709 13:07:26.836690 (+ 15525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.837964 (+  1274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.838006 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.843990 (+  5984us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.970601 (+126611us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:26.970658 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.970723 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.179317 (+1208594us) raft_consensus.cc:1685] finished
0709 13:07:28.179337 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.179454 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":895,"raft.queue_time_us":31199,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":49937,"thread_start_us":119292,"threads_started":1,"wal-append.queue_time_us":291200}
I20260709 13:07:28.720774 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 524) took 1160 ms. Trace:
I20260709 13:07:28.590724 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.721881 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.721151 21291 rpcz_store.cc:276] 0709 13:07:27.560031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.560166 (+   135us) service_pool.cc:224] Handling call
0709 13:07:27.560520 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.560776 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:27.786394 (+225618us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.720454 (+934060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.720506 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.720552 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.720614 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.720726 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":682836,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"thread_start_us":1156187,"threads_started":2}
I20260709 13:07:28.612092 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:28.604171 21222 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:28.614008 21809 raft_consensus.cc:2410] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:28.614503 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 255406us
W20260709 13:07:28.723799 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.722498 21219 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:28.615024 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.724764 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.616703 21805 rpcz_store.cc:276] 0709 13:07:26.011229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.978402 (+967173us) service_pool.cc:224] Handling call
0709 13:07:27.778271 (+799869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.953838 (+175567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.963681 (+  9843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:27.981155 (+ 17474us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.007564 (+ 26409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.031122 (+ 23558us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.225625 (+194503us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400359150. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.225745 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479006976}
W20260709 13:07:28.617173 21265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.053s	sys 0.089s
W20260709 13:07:28.620618 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 474591us
I20260709 13:07:28.597566 24025 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.537292 23983 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.736802 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.738480 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.256971 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:28.654302 21810 rpcz_store.cc:269] 0709 13:07:26.018302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.027593 (+  9291us) service_pool.cc:224] Handling call
0709 13:07:28.063448 (+2035855us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54004b28d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.063564 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152772480}
I20260709 13:07:28.275079 23845 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.660775 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:28.662406 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.737635 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.603783 23999 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:28.664152 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 519258us
I20260709 13:07:28.750376 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.751856 21264 leader_election.cc:400] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:28.752205 21264 leader_election.cc:403] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.752847 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:28.675987 21814 rpcz_store.cc:276] 0709 13:07:27.004024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.237024 (+1233000us) service_pool.cc:224] Handling call
0709 13:07:28.279537 (+ 42513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.739446 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.664683 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:28.754798 21296 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:28.620625 23781 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.027097 23759 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:07:28.747016 21297 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:28.757262 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:28.663784 24036 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.352183 24053 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.739753 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.253214 21807 rpcz_store.cc:276] 0709 13:07:27.008225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.251599 (+1243374us) service_pool.cc:224] Handling call
0709 13:07:28.252870 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.758888 21300 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 2.
I20260709 13:07:28.759238 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.756448 21217 raft_consensus.cc:2393] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:28.749511 21223 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.760691 21145 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:28.616226 23998 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:07:28.688539 21811 rpcz_store.cc:269] 0709 13:07:26.063438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.114290 (+ 50852us) service_pool.cc:224] Handling call
0709 13:07:28.349069 (+2234779us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54001f4354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.349244 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4679969664}
I20260709 13:07:28.661482 24022 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.590993 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.770228 21812 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.729611 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:28.730966 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.702840 23695 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:28.731704 23779 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.663513 23924 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:28.733165 21219 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 3: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:28.686602 23908 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.733723 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.730721 21046 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.339628 21806 rpcz_store.cc:276] 0709 13:07:26.475367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.939582 (+464215us) service_pool.cc:224] Handling call
0709 13:07:27.951858 (+1012276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.688733 23855 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.689399 23942 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.663703 24000 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:28.755028 21808 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:28.744815 21151 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:28.749141 21292 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:28.755723 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:28.838328 21296 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.838799 21299 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.749733 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.840167 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 919) took 1336 ms. Trace:
I20260709 13:07:28.840544 21813 rpcz_store.cc:276] 0709 13:07:27.504067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.710224 (+1206157us) service_pool.cc:224] Handling call
0709 13:07:28.840097 (+129873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.756062 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.679488 21226 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:28.738950 21294 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:28.841529 21810 raft_consensus.cc:2393] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:28.842049 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.843133 21294 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:28.844065 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:28.759966 21809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 824) took 1751 ms (client timeout 1590 ms). Trace:
W20260709 13:07:28.845080 21809 rpcz_store.cc:269] 0709 13:07:27.008532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.720976 (+712444us) service_pool.cc:224] Handling call
0709 13:07:28.759779 (+1038803us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54001b5654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:28.759902 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515015040}
I20260709 13:07:28.846040 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.762321 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:28.763975 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.847162 21297 raft_consensus.cc:2410] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:28.847229 21300 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:28.838934 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.848366 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.767931 21295 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:28.758414 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.849606 21814 raft_consensus.cc:2410] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:28.710873 23917 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.732849 23943 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.734555 23757 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:28.869694 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 107444us
I20260709 13:07:28.870800 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:28.781780 21046 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.745719 21148 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:28.699548 21048 rpcz_store.cc:269] 0709 13:07:11.410731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.410979 (+   248us) service_pool.cc:224] Handling call
0709 13:07:28.353713 (+16942734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:22.705641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:22.750513 (+ 44872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:22.750572 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:22.750592 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:22.815676 (+ 65084us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:22.815761 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:22.815792 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:22.816702 (+   910us) tablet.cc:701] Row locks acquired
0709 13:07:22.816753 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:22.816929 (+   176us) write_op.cc:270] Start()
0709 13:07:22.817086 (+   157us) write_op.cc:276] Timestamp: P: 1783602442816860 usec, L: 0
0709 13:07:22.817109 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.823761 (+  6652us) log.cc:844] Serialized 3574 byte log entry
0709 13:07:23.565127 (+741366us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6ac700ac 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b
0709 13:07:24.486942 (+921815us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b1800324e80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:24.843060 (+356118us) op_driver.cc:464] REPLICATION: finished
0709 13:07:24.962428 (+119368us) write_op.cc:301] APPLY: starting
0709 13:07:24.963960 (+  1532us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:24.994299 (+ 30339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:24.994327 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.000714 (+  6387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.000954 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:25.001004 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:25.001258 (+   254us) log.cc:844] Serialized 71 byte log entry
0709 13:07:25.001420 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.001538 (+   118us) write_op.cc:454] Released schema lock
0709 13:07:25.001579 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:25.001965 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.001991 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":385109,"reported_tablets":21,"spinlock_wait_cycles":125824,"child_traces":[["op",{"apply.queue_time_us":117292,"apply.run_cpu_time_us":2785,"apply.run_wall_time_us":39536,"num_ops":9,"prepare.queue_time_us":203383,"prepare.run_cpu_time_us":47246,"prepare.run_wall_time_us":1142634,"raft.queue_time_us":312834,"raft.run_cpu_time_us":42498,"raft.run_wall_time_us":57155,"replication_time_us":2025804,"spinlock_wait_cycles":64779904,"thread_start_us":1189135,"threads_started":4,"wal-append.queue_time_us":989312,"wal-append.run_cpu_time_us":12892,"wal-append.run_wall_time_us":1520295}]]}
I20260709 13:07:28.830740 21298 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:28.780155 23779 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.831795 21812 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:28.786458 23845 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.836009 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.737347 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.760218 24047 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:28.738538 24045 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.734758 24016 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:07:28.859355 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:28.860697 21809 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:28.764284 23985 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.781368 24027 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:28.875873 21296 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:28.707377 24013 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:28.878075 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:28.875691 21814 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEARNER]: Advancing to term 5
I20260709 13:07:28.812444 23847 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.810758 24033 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.746590 23913 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:07:28.883601 21811 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.883956 21293 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:28.873713 21046 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 6, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.893311 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2339) took 1544 ms. Trace:
I20260709 13:07:28.967921 21223 rpcz_store.cc:276] 0709 13:07:27.352671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.352879 (+   208us) service_pool.cc:224] Handling call
0709 13:07:27.407825 (+ 54946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.760864 (+1353039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.893009 (+132145us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540038ca54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:28.893232 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085190400}
I20260709 13:07:28.967821 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:28.967774 21046 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 4, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.882114 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 920) took 1377 ms. Trace:
I20260709 13:07:28.970678 21812 rpcz_store.cc:276] 0709 13:07:27.504351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.259109 (+754758us) service_pool.cc:224] Handling call
0709 13:07:28.882032 (+622923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.908569 21297 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:28.834807 24020 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:28.883777 23819 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:28.912235 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.840929 23855 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.882685 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:28.851531 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.010831 21812 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:29.011565 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 809) took 2958 ms. Trace:
I20260709 13:07:29.011945 21812 rpcz_store.cc:276] 0709 13:07:26.053978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.010306 (+2956328us) service_pool.cc:224] Handling call
0709 13:07:29.010622 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.011302 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.011515 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.916498 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 800) took 2865 ms. Trace:
I20260709 13:07:29.013362 21809 rpcz_store.cc:276] 0709 13:07:26.050851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.860282 (+2809431us) service_pool.cc:224] Handling call
0709 13:07:28.860486 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.916258 (+ 55772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.916446 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.919188 21808 raft_consensus.cc:2410] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:28.812964 23759 consensus_queue.cc:1243] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:29.009977 23819 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:28.868546 23695 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.028381 23695 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.030349 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:28.928223 21299 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:28.877944 23914 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.040611 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.041421 21298 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:29.042462 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.813683 24022 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.811188 24058 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:07:28.878073 24059 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:28.956283 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:29.005463 23845 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.961050 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:28.749809 23983 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.913748 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:28.781610 23781 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.851873 23942 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.017390 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.018114 23723 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.003340 21046 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), now has a pending config: VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:28.916044 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.019699 23819 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.928864 24027 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:29.132699 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.133236 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:29.031029 21813 raft_consensus.cc:2368] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:29.133883 21143 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.134087 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 822) took 2128 ms. Trace:
I20260709 13:07:29.134619 21813 rpcz_store.cc:276] 0709 13:07:27.005370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.860941 (+1855571us) service_pool.cc:224] Handling call
0709 13:07:29.030209 (+169268us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:07:29.134034 (+103825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43379456}
I20260709 13:07:29.045895 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:29.135885 21294 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.137669 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.138538 21148 raft_consensus.cc:2410] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:28.883895 23943 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.746795 23994 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:28.882844 23757 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.163071 23757 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.052673 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:28.959401 21144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:29.164120 21144 raft_consensus.cc:606] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.164460 21144 raft_consensus.cc:614] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.164487 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:29.011368 23989 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.020473 24020 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.070272 21811 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:07:29.056519 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 799556us
I20260709 13:07:29.118297 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.118691 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.180258 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.180356 21150 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:29.179160 21811 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:29.181567 21811 pending_rounds.cc:85] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 5
I20260709 13:07:29.181813 21811 pending_rounds.cc:107] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:29.182024 21811 raft_consensus.cc:2889] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.182857 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 817) took 3124 ms. Trace:
I20260709 13:07:29.071189 21226 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.064312 21219 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.962848 23985 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.051102 23635 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:29.127501 21805 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.127554 21223 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:29.128311 21296 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:29.187618 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.132896 24027 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:29.031695 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 386995us
W20260709 13:07:29.189980 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.133613 24065 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:07:29.139335 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.191792 21147 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:29.140055 21807 raft_consensus.cc:2410] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:29.134146 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.141047 21143 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:29.143430 21294 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:28.967767 23999 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.157546 23994 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.157801 23622 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.158111 24000 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.120842 23804 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.158841 21218 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:29.159322 23848 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.871s	user 0.005s	sys 0.005s
W20260709 13:07:29.219445 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.151219 23914 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.030972 23695 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.063954 23845 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:29.151942 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.168715 21300 raft_consensus.cc:2393] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:29.182614 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:29.118355 21808 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.183223 21811 rpcz_store.cc:276] 0709 13:07:26.059160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.178451 (+3119291us) service_pool.cc:224] Handling call
0709 13:07:29.178780 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.182560 (+  3780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.182793 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:29.187815 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.188385 21296 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:29.129451 21046 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 4, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.196189 21226 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:29.196525 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.164656 23983 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.212318 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 411) took 1001 ms. Trace:
I20260709 13:07:29.213351 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2341) took 1858 ms. Trace:
I20260709 13:07:29.165616 24026 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.215003 21805 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:29.254092 24058 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.115757 24059 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.256592 24059 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.225323 21219 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:29.230726 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.262617 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 407) took 1247 ms. Trace:
I20260709 13:07:29.263118 21220 rpcz_store.cc:276] 0709 13:07:28.014762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.206734 (+191972us) service_pool.cc:224] Handling call
0709 13:07:28.207029 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.209702 (+  2673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.209729 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.210201 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.616854 (+406653us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.616890 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.616953 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.262367 (+645414us) raft_consensus.cc:1685] finished
0709 13:07:29.262402 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.262552 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17855,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":406322,"threads_started":1,"wal-append.queue_time_us":575736}
W20260709 13:07:29.233934 21264 connection.cc:256] RPC call timeout handler was delayed by -1.717743991999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 13:07:29.240262 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43834.9us
I20260709 13:07:29.209661 24038 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.242528 21218 rpcz_store.cc:276] 0709 13:07:28.211027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.128553 (+917526us) service_pool.cc:224] Handling call
0709 13:07:29.158654 (+ 30101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.211988 (+ 53334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.212252 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.242591 21221 rpcz_store.cc:276] 0709 13:07:27.354842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.449298 (+ 94456us) service_pool.cc:224] Handling call
0709 13:07:27.449739 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.051716 (+601977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.051760 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.169406 (+117646us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b2c0006b8f8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:28.169821 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.620980 (+451159us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.621017 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.660159 (+ 39142us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001275d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:28.660222 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.213173 (+552951us) raft_consensus.cc:1685] finished
0709 13:07:29.213191 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.213300 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23107,"raft.queue_time_us":45792,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":1501459072,"thread_start_us":450161,"threads_started":1,"wal-append.queue_time_us":845693}
I20260709 13:07:29.235260 23845 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.238452 21046 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: config changed from index 4 to 3, term changed from 2 to 5, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1), VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:29.270045 21220 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:29.270709 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 413) took 1043 ms. Trace:
I20260709 13:07:29.270272 21046 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 5, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.271035 21220 rpcz_store.cc:276] 0709 13:07:28.227807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.269524 (+1041717us) service_pool.cc:224] Handling call
0709 13:07:29.269842 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.270476 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.270659 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.247763 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.251572 24021 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.223958 24036 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.252295 23781 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.236649 23914 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.280035 24073 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:29.280475 24073 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:29.280813 24073 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.281205 23914 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.281778 23914 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.282246 23914 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:29.282789 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.283772 21813 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.284418 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 723) took 3224 ms. Trace:
I20260709 13:07:29.284726 21813 rpcz_store.cc:276] 0709 13:07:26.060376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.283294 (+3222918us) service_pool.cc:224] Handling call
0709 13:07:29.283581 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.284194 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.284368 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.285401 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.272085 21046 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.253198 23999 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:29.253366 24071 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:29.254195 24022 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:29.189780 21806 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:29.311772 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 831) took 1052 ms. Trace:
I20260709 13:07:29.312371 21806 rpcz_store.cc:276] 0709 13:07:28.258957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.858025 (+599068us) service_pool.cc:224] Handling call
0709 13:07:29.311678 (+453653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.314002 21806 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:29.223528 21810 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.258421 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.315713 21300 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:29.317732 21300 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:29.318307 21811 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:29.266741 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 412) took 1055 ms. Trace:
I20260709 13:07:29.236223 23984 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.237905 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:29.274955 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123081us
W20260709 13:07:29.275900 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 93373.9us
I20260709 13:07:29.319406 21219 rpcz_store.cc:276] 0709 13:07:28.211607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.265797 (+1054190us) service_pool.cc:224] Handling call
0709 13:07:29.266112 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.266323 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.266359 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.266429 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.266476 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.266546 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.266673 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.321051 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.321552 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.322464 21114 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.322772 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.278136 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 418) took 1029 ms. Trace:
W20260709 13:07:29.278946 24037 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.615s	user 0.004s	sys 0.006s
I20260709 13:07:29.243279 23635 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.327852 24074 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.328054 23695 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.328608 24074 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:29.286504 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.288295 21813 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:29.330792 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 727) took 3269 ms. Trace:
W20260709 13:07:29.330893 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44471.4us
I20260709 13:07:29.331141 21813 rpcz_store.cc:276] 0709 13:07:26.061293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.285615 (+3224322us) service_pool.cc:224] Handling call
0709 13:07:29.285857 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.330561 (+ 44704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.330740 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.332407 21813 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:29.332857 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 818) took 2857 ms. Trace:
I20260709 13:07:29.333138 21813 rpcz_store.cc:276] 0709 13:07:26.475098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.331862 (+2856764us) service_pool.cc:224] Handling call
0709 13:07:29.332115 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.332669 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.332814 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.288457 21046 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.334676 21046 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.323392 21221 rpcz_store.cc:276] 0709 13:07:28.248919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.269578 (+1020659us) service_pool.cc:224] Handling call
0709 13:07:29.277525 (+  7947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.277740 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.277776 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.277829 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.277880 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.277951 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.278075 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.324357 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.338024 21219 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:29.314909 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 729) took 3253 ms. Trace:
I20260709 13:07:29.288307 23942 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:29.291213 24036 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:29.351537 24016 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.352312 24036 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.352695 24036 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:29.292397 24021 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.353462 24036 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.353969 24021 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.354384 24021 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.354658 24036 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.355288 21807 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.335575 23984 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.355899 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 921) took 1851 ms. Trace:
I20260709 13:07:29.356251 21807 rpcz_store.cc:276] 0709 13:07:27.504598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.354655 (+1850057us) service_pool.cc:224] Handling call
0709 13:07:29.354954 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.355670 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.355850 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.357009 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.357257 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 408) took 1323 ms. Trace:
I20260709 13:07:29.357535 21813 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:29.340473 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.283180 23914 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.327574 24037 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.329840 23913 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.364681 23913 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.365017 23913 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.365975 24037 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.239205 24053 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.339851 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.367013 21221 raft_consensus.cc:2368] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:29.340569 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.339110 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.357671 21224 rpcz_store.cc:276] 0709 13:07:28.033536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.208983 (+175447us) service_pool.cc:224] Handling call
0709 13:07:28.209315 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:28.228163 (+ 18848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.228207 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:28.228890 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.814098 (+585208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:28.854494 (+ 40396us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.880090 (+ 25596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.880182 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.357051 (+476869us) raft_consensus.cc:1685] finished
0709 13:07:29.357070 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.357206 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92320,"prepare.queue_time_us":54060,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":17782,"raft.queue_time_us":45839,"raft.run_cpu_time_us":6450,"raft.run_wall_time_us":104017,"thread_start_us":438095,"threads_started":1,"wal-append.queue_time_us":681063}
I20260709 13:07:29.369009 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:29.341413 24066 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:29.341142 21806 rpcz_store.cc:276] 0709 13:07:26.061761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.313291 (+3251530us) service_pool.cc:224] Handling call
0709 13:07:29.313732 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.314569 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.314842 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.326745 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:29.342188 24070 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:07:29.336833 21148 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:29.344873 23985 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.347618 23845 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.339639 23635 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:29.350001 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.357971 21813 pending_rounds.cc:85] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 5
I20260709 13:07:29.386452 21813 pending_rounds.cc:107] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:29.386808 21813 raft_consensus.cc:2889] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.360560 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 923) took 1085 ms. Trace:
I20260709 13:07:29.336663 21046 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 4, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.387805 21807 rpcz_store.cc:276] 0709 13:07:28.274928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.359765 (+1084837us) service_pool.cc:224] Handling call
0709 13:07:29.360045 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.360221 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.360246 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.360284 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:29.360337 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.360387 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.360482 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.388625 21046 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 4 to 6, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.390204 21046 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 4 to 5, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.363714 21300 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.374215 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:29.376624 21222 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:29.377280 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:29.378687 24025 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 13:07:29.379242 21292 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:29.336697 24059 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:07:29.382455 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59183.7us
I20260709 13:07:29.336553 24026 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:29.402547 24047 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:29.336769 23989 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.351176 24039 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.663s	user 0.004s	sys 0.004s
I20260709 13:07:29.394752 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.394451 21046 catalog_manager.cc:5697] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 3, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:29.437870 21046 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.392328 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:29.382561 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.018s	sys 0.030s
I20260709 13:07:29.401732 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:29.439503 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.018s	sys 0.030s
I20260709 13:07:29.439698 21807 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:29.440097 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 569321us
I20260709 13:07:29.383280 24053 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.397677 24037 raft_consensus.cc:2764] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:29.400867 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.380653 23942 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.380836 23723 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.391129 24075 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.449167 21300 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:29.450127 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49354.6us
I20260709 13:07:29.452104 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.452560 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.398025 23926 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.454105 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:29.456280 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:29.440442 21046 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 5, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.420317 24013 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:29.458643 21046 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.461066 21151 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:29.462311 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:29.456481 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:29.435195 24059 consensus_queue.cc:1243] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:29.509545 24017 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.514216 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.516211 24058 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.516769 24058 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:29.476100 23757 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.519728 23757 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:29.520210 23757 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.521014 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.521756 21219 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:29.522771 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.524410 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:29.525373 21223 raft_consensus.cc:2393] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:29.526562 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.529274 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.529826 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:29.531569 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.532172 21150 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:29.476217 23695 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.533843 24033 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.534279 23695 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.536242 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.533978 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.537976 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.539000 24047 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.539175 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.539605 24047 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.540081 24047 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.531044 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.472188 24075 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:29.540868 21143 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:29.541631 24075 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:29.542291 24064 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.833s	user 0.002s	sys 0.001s
I20260709 13:07:29.426945 24026 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.540422 23856 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.545360 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 409) took 1505 ms. Trace:
I20260709 13:07:29.549430 21147 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.551419 21814 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:29.392334 23779 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.545797 21225 rpcz_store.cc:276] 0709 13:07:28.040486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.226113 (+185627us) service_pool.cc:224] Handling call
0709 13:07:28.226426 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.687296 (+460870us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:28.965172 (+277876us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.225325 (+260153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.225372 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:29.225420 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.544188 (+318768us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b1800346ba0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419
0709 13:07:29.545157 (+   969us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400116a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:29.545204 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.545309 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10490,"prepare.queue_time_us":45432,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8166,"raft.queue_time_us":83,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12443,"spinlock_wait_cycles":1061716608,"thread_start_us":516054,"threads_started":2,"wal-append.queue_time_us":425028}
I20260709 13:07:29.476981 23819 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:29.479749 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.560225 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:29.560912 21297 raft_consensus.cc:2376] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4. Re-sending same reply.
I20260709 13:07:29.399101 24038 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:29.481528 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:29.565274 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 83815.6us
W20260709 13:07:29.554004 23924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.037s	sys 0.076s
I20260709 13:07:29.566450 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:29.566918 23924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.037s	sys 0.076s
I20260709 13:07:29.567487 23985 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.567981 23985 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.568400 23985 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.484730 21291 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:29.571729 21291 raft_consensus.cc:2368] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:29.487660 24037 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:29.489697 23760 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.869s	user 0.006s	sys 0.003s
I20260709 13:07:29.572434 24037 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:29.453341 24039 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.459379 23804 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.496690 23896 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.497373 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.499078 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:29.442699 24053 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:29.594229 24053 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.460525 23942 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.596840 23942 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.466672 24025 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.597397 24025 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.597798 24025 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.418869 24074 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.403075 23759 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:29.551744 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.552654 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:29.607544 21147 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.610137 21226 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:29.611303 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.612149 21226 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:29.613353 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.465407 21807 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:29.470851 21046 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 3 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.616155 21046 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:29.465193 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 266977us
I20260709 13:07:29.619385 24025 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.619997 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.621534 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.621999 24025 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:29.555894 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.557497 21150 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:29.554774 21814 pending_rounds.cc:85] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 3
I20260709 13:07:29.623646 21814 pending_rounds.cc:107] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:29.623904 21814 raft_consensus.cc:2889] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.624161 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.624527 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 803) took 3572 ms. Trace:
I20260709 13:07:29.624895 21814 rpcz_store.cc:276] 0709 13:07:26.051608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.875224 (+2823616us) service_pool.cc:224] Handling call
0709 13:07:28.875551 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.624322 (+748771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.624478 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.625586 21225 raft_consensus.cc:1217] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Deduplicated request from leader. Original: 1.3->[1.4-4.5]   Dedup: 1.4->[4.5-4.5]
I20260709 13:07:29.625280 24053 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.564426 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.626108 21225 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: [1.4-4.5]
I20260709 13:07:29.627152 24017 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.579435 21219 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:29.588503 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:29.625842 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.481653 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.627903 24017 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:29.628518 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 146934us
I20260709 13:07:29.629212 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.629324 24053 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:29.629748 21225 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:29.631597 23924 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.631886 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.631975 23924 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:29.632038 23942 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.632546 23924 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.633029 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:29.634322 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.634940 21807 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:29.635751 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.618116 21046 catalog_manager.cc:5697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:29.636850 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.627234 21223 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:29.572583 23760 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.636904 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.642238 23760 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.642825 23760 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.643435 21217 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.643159 23917 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:29.643796 21115 leader_election.cc:400] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:29.644202 21115 leader_election.cc:403] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.644835 24052 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.645087 23760 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.652143 21147 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:29.653044 23760 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.653892 23917 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:29.653738 23760 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.656629 23760 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.663154 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.548714 23781 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.545413 24026 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.669091 21298 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:29.670822 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.671099 21151 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:29.673584 21297 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:29.531000 24027 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:29.677484 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.467108 23989 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.683225 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 811) took 3628 ms. Trace:
I20260709 13:07:29.666589 23983 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.664189 24017 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.545723 23856 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.662242 23804 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.702996 21294 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:29.721624 21295 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.722193 21295 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:29.662029 23622 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:07:29.690923 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:29.670501 23635 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.729024 21143 raft_consensus.cc:2376] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8. Re-sending same reply.
I20260709 13:07:29.696070 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.730170 21297 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:29.733103 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:29.695654 24029 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.042s	user 0.007s	sys 0.004s
I20260709 13:07:29.736882 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.663730 23896 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.467057 23926 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.737529 21297 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:07:29.700712 21812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.041s
I20260709 13:07:29.694855 21806 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:29.736160 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2353) took 1021 ms. Trace:
I20260709 13:07:29.691952 23983 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:29.737988 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:29.785490 21812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.015s	sys 0.041s
I20260709 13:07:29.684886 21809 rpcz_store.cc:276] 0709 13:07:26.055081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.014146 (+2959065us) service_pool.cc:224] Handling call
0709 13:07:29.014450 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.044251 (+ 29801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.044285 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.055954 (+ 11669us) log.cc:844] Serialized 52 byte log entry
0709 13:07:29.368053 (+312099us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.670535 (+302482us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.670923 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.682867 (+ 11944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.682966 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.683016 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:29.683027 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.683157 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27790,"raft.queue_time_us":193545,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6452,"spinlock_wait_cycles":21737728,"thread_start_us":592353,"threads_started":2,"wal-append.queue_time_us":405044}
W20260709 13:07:29.789847 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.675437 24021 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.786053 21295 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.822453 21295 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.823290 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.826947 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:29.830933 21809 raft_consensus.cc:2376] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7. Re-sending same reply.
I20260709 13:07:29.833647 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:29.726049 23804 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.821883 21300 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:29.852947 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.855222 21151 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:29.787209 24080 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:29.864476 21814 raft_consensus.cc:2368] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:29.855751 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:29.859651 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.867511 21151 raft_consensus.cc:2376] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4. Re-sending same reply.
I20260709 13:07:29.867560 21300 raft_consensus.cc:2376] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5. Re-sending same reply.
I20260709 13:07:29.733299 23635 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.868716 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.736680 24029 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.875376 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.886983 21297 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:29.703956 24073 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:29.784587 24000 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.850469 23983 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.854669 24022 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.837852 23760 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:29.827593 24082 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:07:29.870256 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:29.821120 23999 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:29.888502 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 426278us
I20260709 13:07:29.952615 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:29.953743 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.869941 23635 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.894906 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:29.860215 24075 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:29.954746 21151 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:29.895681 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 425630us
W20260709 13:07:29.897497 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.897588 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:29.898553 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 265584us
I20260709 13:07:29.886296 21300 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:29.902413 21293 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.956840 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:29.869855 23924 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:29.963464 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.957479 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.972693 21297 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:29.973412 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:29.960125 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:29.981149 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:29.888293 24013 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:29.961580 21143 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:29.962335 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:29.975633 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:29.957908 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.984048 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:29.988792 21263 leader_election.cc:400] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:29.996671 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:30.000742 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:30.000679 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:30.000397 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:30.022253 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:30.023038 21297 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:29.955562 24022 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:29.957154 24080 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:07:29.971107 23913 consensus_meta.cc:287] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
W20260709 13:07:29.970965 24036 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.003s
I20260709 13:07:30.028234 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.981891 21293 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:30.033082 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:29.969486 24033 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.999728 23759 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.994774 24027 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:29.949977 24037 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:30.051430 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:29.994287 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:30.062238 21807 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:29.999549 24025 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.967193 24026 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.068521 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:30.071512 21151 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:30.069243 21221 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:29.957993 23760 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.031913 23819 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:29.993201 24038 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:07:30.075649 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:30.038640 23913 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:30.067369 23759 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.101022 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 203522us
I20260709 13:07:30.065449 24097 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.069248 23992 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.177956 21300 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:30.159597 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:30.075055 24027 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.188301 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:30.100819 24063 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.364s	user 0.000s	sys 0.003s
W20260709 13:07:30.222803 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 260549us
I20260709 13:07:30.164567 23759 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.073047 24096 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:30.074713 23989 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:30.080889 23896 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:30.088323 24025 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:30.272256 23845 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.003s
I20260709 13:07:30.281047 21115 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:30.096638 23856 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:30.077734 24037 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:07:30.276259 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:30.088543 24026 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:30.322484 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:30.264137 24036 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.174161 24045 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:30.163132 24099 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.225s
I20260709 13:07:30.283454 24021 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:30.300954 24039 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:30.372274 21295 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
W20260709 13:07:30.367957 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 394630us
I20260709 13:07:30.374888 21264 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:30.375147 21295 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:30.376478 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1924) took 1506 ms. Trace:
W20260709 13:07:30.353155 24088 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.464s	user 0.000s	sys 0.001s
I20260709 13:07:30.320623 24123 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.189749 24097 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.326447 24096 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:30.551146 24127 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:30.368454 24087 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 13:07:30.399439 23989 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.352923 23942 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:30.412375 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 915) took 4400 ms. Trace:
I20260709 13:07:30.627074 21810 rpcz_store.cc:276] 0709 13:07:26.016665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.860218 (+2843553us) service_pool.cc:224] Handling call
0709 13:07:28.928118 (+ 67900us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:28.928302 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.315481 (+387179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.412096 (+1096615us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54006bbf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.412277 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699435136}
I20260709 13:07:30.352974 24033 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.360718 24038 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.426170 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 916) took 2925 ms. Trace:
I20260709 13:07:30.643091 21813 rpcz_store.cc:276] 0709 13:07:27.501149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.340265 (+1839116us) service_pool.cc:224] Handling call
0709 13:07:29.340521 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.387355 (+ 46834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.411557 (+1024202us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b540030cd54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.426093 (+ 14536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38440320}
I20260709 13:07:30.644691 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:30.380421 23999 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:30.442803 24089 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
W20260709 13:07:30.443598 24095 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
W20260709 13:07:30.444422 24085 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.408s	user 0.001s	sys 0.001s
W20260709 13:07:30.445111 24084 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
W20260709 13:07:30.446058 24081 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
W20260709 13:07:30.449574 23757 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.929s	user 0.009s	sys 0.002s
I20260709 13:07:30.456291 23913 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:30.406078 24029 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:30.348373 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 72214us
W20260709 13:07:30.400231 24049 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:30.395294 23992 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.736982 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:30.738026 24119 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.393420 24075 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.394583 24073 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:30.426908 24086 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
W20260709 13:07:30.738713 24108 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:30.358320 24045 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.358220 24036 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.363790 23856 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.148s
W20260709 13:07:30.743343 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 473784us
I20260709 13:07:30.589655 23845 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.511443 24052 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.000s
W20260709 13:07:30.560961 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 289382us
W20260709 13:07:30.561460 21296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.008s
W20260709 13:07:30.544478 24106 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:07:30.510991 23924 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:30.571727 21145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.016s
W20260709 13:07:30.574618 21116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.015s
W20260709 13:07:30.575217 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.003s
I20260709 13:07:30.579299 21295 rpcz_store.cc:276] 0709 13:07:28.869892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.873157 (+  3265us) service_pool.cc:224] Handling call
0709 13:07:28.890622 (+ 17465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.721474 (+830852us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400492620. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:07:30.375881 (+654407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.376408 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297175296}
I20260709 13:07:30.545451 24020 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:30.175173 24013 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.533689 24099 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:30.625900 24112 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.595770 24022 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:30.613564 23760 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:30.636343 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1416) took 1506 ms. Trace:
I20260709 13:07:30.636942 24096 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.661582 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 752) took 1215 ms. Trace:
I20260709 13:07:30.680819 23999 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.682171 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 416) took 2433 ms. Trace:
I20260709 13:07:30.670841 24038 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.640692 23989 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:30.685586 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2310) took 1762 ms. Trace:
I20260709 13:07:30.622546 24127 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:30.690289 23985 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.121s	user 0.008s	sys 0.003s
I20260709 13:07:30.692435 24097 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:30.697533 23723 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.237s	user 0.010s	sys 0.000s
W20260709 13:07:30.700843 24047 consensus_meta.cc:287] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.160s	user 0.010s	sys 0.000s
I20260709 13:07:30.706929 23779 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:30.712265 21222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2354) took 1972 ms (client timeout 2054 ms). Trace:
I20260709 13:07:30.713940 24000 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:30.716135 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2360) took 1184 ms. Trace:
I20260709 13:07:30.672427 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:30.841171 24000 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.841718 24020 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.781131 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2361) took 1249 ms. Trace:
I20260709 13:07:30.840813 21813 rpcz_store.cc:276] 0709 13:07:29.446652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.644348 (+1197696us) service_pool.cc:224] Handling call
0709 13:07:30.661497 (+ 17149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.737051 23757 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:30.846029 24127 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:30.847700 23757 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:30.848435 21225 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.774609 23781 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:07:30.540095 24025 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.387527 24124 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:30.741014 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.014s	sys 0.029s
I20260709 13:07:30.844166 21226 rpcz_store.cc:276] 0709 13:07:29.531707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.639436 (+107729us) service_pool.cc:224] Handling call
0709 13:07:29.639786 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:30.023846 (+384060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.023896 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:30.024513 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.350923 (+326410us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.350968 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.351041 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.695093 (+344052us) raft_consensus.cc:1685] finished
0709 13:07:30.695122 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.716054 (+ 20932us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5883,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":598661,"threads_started":2,"wal-append.queue_time_us":563989}
W20260709 13:07:30.855930 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.015s	sys 0.029s
W20260709 13:07:30.840787 21116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.005s	sys 0.020s
I20260709 13:07:30.857867 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:30.738755 24075 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.747159 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:30.748133 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 720) took 4688 ms. Trace:
I20260709 13:07:30.749382 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 813) took 4693 ms. Trace:
I20260709 13:07:30.749540 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2301) took 2016 ms. Trace:
I20260709 13:07:30.749832 24036 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:30.750031 21300 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:30.751049 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 743) took 1357 ms. Trace:
W20260709 13:07:30.764264 23983 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.002s
I20260709 13:07:30.751688 23984 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:30.759647 21805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 925) took 2062 ms (client timeout 2535 ms). Trace:
I20260709 13:07:30.760749 24029 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.761582 24135 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:30.761729 23992 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.761605 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.764505 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 742) took 1371 ms. Trace:
I20260709 13:07:30.763868 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1926) took 1844 ms. Trace:
I20260709 13:07:30.760797 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2306) took 1943 ms. Trace:
W20260709 13:07:30.770939 21296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.008s
W20260709 13:07:30.843420 21222 rpcz_store.cc:269] 0709 13:07:28.739967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.836582 (+ 96615us) service_pool.cc:224] Handling call
0709 13:07:30.711991 (+1875409us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540038e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.712165 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901949696}
I20260709 13:07:30.843823 21810 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:30.787153 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 810) took 4732 ms. Trace:
I20260709 13:07:30.549659 24026 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.850239 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2362) took 1318 ms. Trace:
I20260709 13:07:30.852984 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:30.853528 21145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.005s	sys 0.016s
I20260709 13:07:30.845198 21223 rpcz_store.cc:276] 0709 13:07:29.531961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.640372 (+108411us) service_pool.cc:224] Handling call
0709 13:07:29.640703 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.857460 (+216757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.857501 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.866404 (+  8903us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.087418 (+221014us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.577207 (+489789us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.577483 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.748913 (+171430us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000eced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.748966 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.780788 (+ 31822us) raft_consensus.cc:1685] finished
0709 13:07:30.780909 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.781061 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":353618,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":19847,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":35364,"spinlock_wait_cycles":497537792,"thread_start_us":599608,"threads_started":2,"wal-append.queue_time_us":645711}
I20260709 13:07:30.739434 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:30.851385 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:30.854846 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.014s	sys 0.008s
I20260709 13:07:30.840682 23723 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.859042 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:30.540866 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.008s
I20260709 13:07:30.858889 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:30.861389 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:30.858577 24099 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:30.862071 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:30.751602 23855 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:30.843693 23985 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:30.840880 21218 rpcz_store.cc:276] 0709 13:07:28.248379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.272948 (+1024569us) service_pool.cc:224] Handling call
0709 13:07:29.273288 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.277007 (+  3719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.277040 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.290387 (+ 13347us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.738373 (+447986us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.738426 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.738509 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.681859 (+943350us) raft_consensus.cc:1685] finished
0709 13:07:30.681888 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.682087 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5587,"thread_start_us":380259,"threads_started":1,"wal-append.queue_time_us":693458}
I20260709 13:07:30.854270 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:31.106403 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:30.983191 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1925) took 2098 ms. Trace:
I20260709 13:07:30.841480 24052 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
W20260709 13:07:30.850250 24081 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:07:31.107586 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.13198e+06us
I20260709 13:07:31.107009 21295 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:30.762178 23943 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:31.135865 21292 rpcz_store.cc:276] 0709 13:07:28.817255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.855381 (+ 38126us) service_pool.cc:224] Handling call
0709 13:07:28.855636 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.403267 (+547631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.760573 (+1357306us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540001c054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.760738 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177416064}
W20260709 13:07:31.135654 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.000s	sys 0.016s
I20260709 13:07:31.107601 21812 rpcz_store.cc:276] 0709 13:07:26.054354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.012691 (+2958337us) service_pool.cc:224] Handling call
0709 13:07:29.012985 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.037365 (+ 24380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.037400 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.045029 (+  7629us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.822491 (+777462us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.102231 (+279740us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.161884 (+ 59653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.161955 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.786853 (+624898us) raft_consensus.cc:1685] finished
0709 13:07:30.786883 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.787073 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62038,"prepare.queue_time_us":202692,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3115,"raft.queue_time_us":242448,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":21264,"thread_start_us":907014,"threads_started":2,"wal-append.queue_time_us":809403}
I20260709 13:07:30.853785 21299 rpcz_store.cc:276] 0709 13:07:28.922986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.290680 (+367694us) service_pool.cc:224] Handling call
0709 13:07:29.291039 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.291409 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.291442 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.291904 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.593536 (+301632us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:29.593578 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.595332 (+  1754us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.685329 (+1089997us) raft_consensus.cc:1685] finished
0709 13:07:30.685356 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.685513 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":90,"thread_start_us":301287,"threads_started":1,"wal-append.queue_time_us":662895}
I20260709 13:07:31.135754 21808 rpcz_store.cc:276] 0709 13:07:26.055656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.018826 (+2963170us) service_pool.cc:224] Handling call
0709 13:07:29.019071 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.236120 (+217049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.749166 (+1513046us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400623ed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.749328 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132879232}
I20260709 13:07:31.143249 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:31.143728 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.143985 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:30.854218 23804 consensus_meta.cc:287] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.003s
I20260709 13:07:31.133968 21813 raft_consensus.cc:2376] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3. Re-sending same reply.
I20260709 13:07:31.107854 21291 rpcz_store.cc:276] 0709 13:07:28.732727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.733460 (+   733us) service_pool.cc:224] Handling call
0709 13:07:30.749351 (+2015891us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54003af554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.749487 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618159872}
I20260709 13:07:31.136466 23994 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.106949 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 937) took 1456 ms. Trace:
W20260709 13:07:31.135919 21805 rpcz_store.cc:269] 0709 13:07:28.697327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.738256 (+ 40929us) service_pool.cc:224] Handling call
0709 13:07:30.759464 (+2021208us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400660dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.759582 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893426432}
I20260709 13:07:30.843323 24038 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:30.763353 24134 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.136464 21814 rpcz_store.cc:276] 0709 13:07:29.393586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.625630 (+232044us) service_pool.cc:224] Handling call
0709 13:07:30.764321 (+1138691us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54006e0354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.764454 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543256832}
I20260709 13:07:31.135692 21811 rpcz_store.cc:276] 0709 13:07:26.059724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.242143 (+3182419us) service_pool.cc:224] Handling call
0709 13:07:29.318083 (+ 75940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.318827 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.747916 (+1429089us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54006c02d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.748069 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129835264}
I20260709 13:07:31.107779 21294 rpcz_store.cc:276] 0709 13:07:28.884717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.207546 (+322829us) service_pool.cc:224] Handling call
0709 13:07:29.207908 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.703533 (+495625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.982901 (+1279368us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b540029de54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.983106 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1138068736}
I20260709 13:07:31.135553 21807 rpcz_store.cc:276] 0709 13:07:29.393901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.635550 (+241649us) service_pool.cc:224] Handling call
0709 13:07:30.750907 (+1115357us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54005217d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.751000 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979502464}
I20260709 13:07:31.144518 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 754) took 1269 ms. Trace:
I20260709 13:07:31.163620 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:31.164314 21812 rpcz_store.cc:276] 0709 13:07:29.875594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.143464 (+1267870us) service_pool.cc:224] Handling call
0709 13:07:31.144460 (+   996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.164633 21810 rpcz_store.cc:276] 0709 13:07:29.650320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.628459 (+978139us) service_pool.cc:224] Handling call
0709 13:07:31.106896 (+478437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.164906 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:31.165401 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.166049 21812 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:31.134232 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2309) took 2211 ms. Trace:
I20260709 13:07:31.167042 21296 rpcz_store.cc:276] 0709 13:07:28.922689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.237036 (+314347us) service_pool.cc:224] Handling call
0709 13:07:29.237310 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.237491 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:29.564387 (+326896us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.133850 (+1569463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.133923 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:31.133973 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.134051 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.134169 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":615589,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":133282,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":103158,"thread_start_us":1859431,"threads_started":3,"wal-append.queue_time_us":623518}
I20260709 13:07:31.144987 21292 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:31.144136 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.147112 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:31.001636 24067 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.851s	user 0.025s	sys 0.007s
I20260709 13:07:31.148222 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 940) took 1496 ms. Trace:
I20260709 13:07:31.098866 23989 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:30.984473 23759 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
W20260709 13:07:31.008930 23635 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 1.015s	user 0.008s	sys 0.003s
I20260709 13:07:31.148319 23855 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:31.169224 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 429834us
I20260709 13:07:30.853886 23845 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:30.934011 23695 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.179581 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.179736 21809 raft_consensus.cc:2368] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7.
W20260709 13:07:31.188913 24094 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:07:31.136245 24053 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.136439 24115 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.137844 23779 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.843881 24020 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.102111 24058 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.183480 23943 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.186026 24075 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.146802 24029 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:30.851819 24047 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.137928 23983 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.184373 24036 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:31.141672 24135 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.167096 23994 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.177716 24134 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:31.189589 24059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.009s
I20260709 13:07:31.200579 24058 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.202078 24036 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:31.207437 24059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.008s	sys 0.010s
I20260709 13:07:31.195196 24115 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.219316 24134 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:31.255743 21114 leader_election.cc:336] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 2.054s (SENT)
I20260709 13:07:31.256856 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:30.881402 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.054s
W20260709 13:07:31.260717 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.016s	sys 0.061s
I20260709 13:07:31.261826 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:31.262687 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 981647us
W20260709 13:07:31.265633 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.887933 21117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.008s	sys 0.020s
W20260709 13:07:31.267202 21117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.008s	sys 0.024s
I20260709 13:07:31.271384 21143 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:31.275065 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1779) took 1723 ms. Trace:
I20260709 13:07:30.841082 21149 rpcz_store.cc:276] 0709 13:07:29.129532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.129661 (+   129us) service_pool.cc:224] Handling call
0709 13:07:29.130004 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.131561 (+  1557us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:29.131602 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.132172 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.353111 (+220939us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800439f00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:29.662436 (+309325us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.662475 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.662620 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.636025 (+973405us) raft_consensus.cc:1685] finished
0709 13:07:30.636044 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.636282 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12245,"raft.queue_time_us":10909,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":17136,"spinlock_wait_cycles":6582656,"thread_start_us":309149,"threads_started":1,"wal-append.queue_time_us":702437}
I20260709 13:07:31.275533 21145 rpcz_store.cc:276] 0709 13:07:29.551119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.551239 (+   120us) service_pool.cc:224] Handling call
0709 13:07:29.551570 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.551811 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:29.960789 (+408978us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.274561 (+1313772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.274633 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:31.274711 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.274782 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.274931 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":611570,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3963,"thread_start_us":1717484,"threads_started":2,"wal-append.queue_time_us":673255}
I20260709 13:07:31.277004 21151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:31.280117 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.281672 21147 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
W20260709 13:07:31.106492 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 253522us
I20260709 13:07:31.293097 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:31.134061 21218 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:07:31.135437 21190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.535s (SENT) [suppressed 32 similar messages]
I20260709 13:07:30.935109 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 410) took 2786 ms. Trace:
I20260709 13:07:31.304865 21217 rpcz_store.cc:276] 0709 13:07:28.153126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.038979 (+885853us) service_pool.cc:224] Handling call
0709 13:07:29.063055 (+ 24076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.643844 (+580789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.934858 (+1291014us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.935049 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334330240}
W20260709 13:07:31.307474 21221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.011s
I20260709 13:07:31.137343 21225 rpcz_store.cc:276] 0709 13:07:29.532201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.640688 (+108487us) service_pool.cc:224] Handling call
0709 13:07:29.640908 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.848864 (+1207956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.850020 (+  1156us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540035be54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:30.850181 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776670592}
W20260709 13:07:31.307962 21221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.011s
W20260709 13:07:31.143072 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 1.11211e+06us
I20260709 13:07:31.307857 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.136775 21226 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:31.317744 24029 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:31.208482 24036 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.106971 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.137100 21293 rpcz_store.cc:276] 0709 13:07:28.919787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.967483 (+ 47696us) service_pool.cc:224] Handling call
0709 13:07:30.763718 (+1796235us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540015fed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:30.763811 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144152448}
I20260709 13:07:31.328868 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:31.364301 21293 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.182399 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:31.180102 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:30.933574 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 935) took 1294 ms. Trace:
I20260709 13:07:31.184290 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 745) took 1788 ms. Trace:
I20260709 13:07:31.404145 24097 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.404580 21808 rpcz_store.cc:276] 0709 13:07:29.395885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.143935 (+1748050us) service_pool.cc:224] Handling call
0709 13:07:31.184243 (+ 40308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.405584 24097 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.406293 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.166453 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 746) took 1770 ms. Trace:
I20260709 13:07:31.407678 21812 rpcz_store.cc:276] 0709 13:07:29.396156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.165179 (+1769023us) service_pool.cc:224] Handling call
0709 13:07:31.166412 (+  1233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.408221 23998 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:31.408726 23998 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:31.409116 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.410084 23998 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.181592 21813 rpcz_store.cc:276] 0709 13:07:29.652764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.851112 (+1198348us) service_pool.cc:224] Handling call
0709 13:07:31.148138 (+297026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.413453 21813 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:31.414338 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 928) took 2682 ms. Trace:
I20260709 13:07:31.179203 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:31.178288 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.416397 24130 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.416921 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 941) took 1763 ms. Trace:
I20260709 13:07:31.188292 23855 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.418313 23855 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.196952 23943 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.423724 23943 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.317140 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:31.330224 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:31.332204 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:31.332078 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:31.339625 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.340026 23695 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:31.340252 21219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1397) took 2046 ms (client timeout 1881 ms). Trace:
I20260709 13:07:31.340866 24047 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.341169 23856 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.342236 23896 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.403805 21806 rpcz_store.cc:276] 0709 13:07:29.638987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.746842 (+1107855us) service_pool.cc:224] Handling call
0709 13:07:30.933497 (+186655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.190639 23759 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.344378 24059 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.344765 23989 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:31.344679 24038 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.347704 23779 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:29.788699 21220 rpcz_store.cc:276] 0709 13:07:28.715113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.271820 (+556707us) service_pool.cc:224] Handling call
0709 13:07:29.272084 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.272286 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:29.298747 (+ 26461us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.735743 (+436996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.735807 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:29.735874 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.735960 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.736095 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26620,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":94,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":51582,"thread_start_us":427082,"threads_started":1}
I20260709 13:07:31.351629 23983 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.352682 23926 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.352747 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.190419 23635 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.355593 24025 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:31.356060 24013 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.357089 24052 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.357721 24073 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:31.361862 21809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 834) took 1691 ms (client timeout 1749 ms). Trace:
I20260709 13:07:31.361958 24075 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.363068 24105 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:31.303145 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:31.545099 21147 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:31.351073 23845 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.146688 23992 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.352941 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:31.429209 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 246763us
I20260709 13:07:31.182552 23804 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.423427 24103 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:31.407104 21808 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:31.417325 21807 rpcz_store.cc:276] 0709 13:07:29.653044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.177912 (+1524868us) service_pool.cc:224] Handling call
0709 13:07:31.416715 (+238803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.414811 21813 rpcz_store.cc:276] 0709 13:07:28.731779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.411935 (+2680156us) service_pool.cc:224] Handling call
0709 13:07:31.412492 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.413957 (+  1465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.414227 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.442888 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1944) took 2069 ms. Trace:
I20260709 13:07:31.475239 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.343698 23913 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.477851 23856 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.480932 21145 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.481640 21299 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:31.482200 21292 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:31.440424 23994 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.439239 24135 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.483673 23998 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.484050 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:31.475944 21219 rpcz_store.cc:269] 0709 13:07:29.293824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.522526 (+228702us) service_pool.cc:224] Handling call
0709 13:07:31.339863 (+1817337us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54000ebad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.340046 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76147584}
I20260709 13:07:31.485127 23985 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.485211 24017 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:31.488356 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2313) took 2564 ms (client timeout 3173 ms). Trace:
W20260709 13:07:31.489053 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 73310.2us
I20260709 13:07:31.490317 21805 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:31.492635 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 252039us
I20260709 13:07:31.493353 24115 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.508327 21293 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:31.505649 24059 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.541172 24073 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.540436 23757 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:31.539276 24075 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:31.519532 21809 rpcz_store.cc:269] 0709 13:07:29.669961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.870038 (+200077us) service_pool.cc:224] Handling call
0709 13:07:31.361404 (+1491366us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54004e9b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.361641 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2823218048}
I20260709 13:07:31.550695 24038 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:31.551787 23992 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.552719 23635 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:31.553140 24092 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:31.571810 24017 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.554816 21291 raft_consensus.cc:2410] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:31.557794 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 835) took 1887 ms. Trace:
I20260709 13:07:31.489107 23943 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.558238 21300 rpcz_store.cc:276] 0709 13:07:29.373594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.263471 (+889877us) service_pool.cc:224] Handling call
0709 13:07:30.749717 (+486246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.107746 (+358029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.442385 (+334639us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54003af550. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.442669 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117355776}
I20260709 13:07:31.545003 24105 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.568257 21812 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:31.570508 21298 rpcz_store.cc:269] 0709 13:07:28.923801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.052367 (+128566us) service_pool.cc:224] Handling call
0709 13:07:31.487920 (+2435553us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400327b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.488143 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161567616}
I20260709 13:07:31.600073 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 938) took 1949 ms. Trace:
W20260709 13:07:31.584046 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 105561us
I20260709 13:07:31.560765 23856 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.576994 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 936) took 1934 ms. Trace:
I20260709 13:07:31.588501 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 837) took 1908 ms. Trace:
I20260709 13:07:31.589671 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.590394 23913 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.591432 24020 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.638249 21145 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:31.591516 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 933) took 1953 ms. Trace:
W20260709 13:07:31.592298 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 162525us
W20260709 13:07:31.573213 24074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.789s	user 0.021s	sys 0.013s
I20260709 13:07:31.586347 21292 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:31.596881 21808 rpcz_store.cc:276] 0709 13:07:29.670217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.405844 (+1735627us) service_pool.cc:224] Handling call
0709 13:07:31.557723 (+151879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.593166 24033 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:31.590412 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 540) took 1953 ms. Trace:
I20260709 13:07:31.600473 21812 rpcz_store.cc:276] 0709 13:07:29.650733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.410907 (+1760174us) service_pool.cc:224] Handling call
0709 13:07:31.599996 (+189089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.594745 24038 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:31.575363 24059 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.604053 23989 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.605016 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 544) took 1950 ms. Trace:
I20260709 13:07:31.663069 21300 rpcz_store.cc:276] 0709 13:07:29.654861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.601638 (+1946777us) service_pool.cc:224] Handling call
0709 13:07:31.604071 (+  2433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.604555 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.604585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.604663 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.604707 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.604776 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.604926 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.604493 23779 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.602751 21805 rpcz_store.cc:276] 0709 13:07:29.680459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.179900 (+1499441us) service_pool.cc:224] Handling call
0709 13:07:31.588424 (+408524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.663866 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.606633 21806 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:31.602428 21810 rpcz_store.cc:276] 0709 13:07:29.649741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.180514 (+1530773us) service_pool.cc:224] Handling call
0709 13:07:31.566033 (+385519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.613947 24092 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.599385 23723 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.615653 21778 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:31.616405 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2315) took 2055 ms. Trace:
I20260709 13:07:31.624894 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:31.626304 24097 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.628794 23759 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.629617 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.599517 23896 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:07:31.670815 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46206.2us
I20260709 13:07:31.632251 24073 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:31.632664 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46669.9us
I20260709 13:07:31.633487 24036 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.598395 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:31.635548 23757 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.636552 21813 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:31.636981 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.646129 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:31.647324 24099 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.680748 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.681046 24099 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.681514 21224 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:31.682536 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 86376.9us
I20260709 13:07:31.652153 21299 rpcz_store.cc:276] 0709 13:07:29.636974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.575123 (+1938149us) service_pool.cc:224] Handling call
0709 13:07:31.589601 (+ 14478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.589963 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.589997 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.590062 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:31.590093 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.590167 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.590325 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.683765 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:31.686051 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.686762 21299 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:31.668962 21145 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:31.670310 24013 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.670907 21149 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:31.631769 23943 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.665750 21297 rpcz_store.cc:276] 0709 13:07:29.560878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.032260 (+471382us) service_pool.cc:224] Handling call
0709 13:07:31.616049 (+1583789us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400328054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.616213 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3548784896}
W20260709 13:07:31.658679 24074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.053s	user 0.022s	sys 0.013s
W20260709 13:07:31.647385 24045 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.863s	user 0.006s	sys 0.011s
I20260709 13:07:31.637820 24020 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.673707 24026 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:31.634994 23695 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:31.706207 23695 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:31.706321 23757 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.707140 23723 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.707494 23695 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.708879 23695 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.710290 23723 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.703338 23855 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.711241 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.712219 21223 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:31.706221 21811 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:31.713155 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.714219 24114 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:31.715540 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:31.715718 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:31.716375 21149 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.717698 24026 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.711309 21222 raft_consensus.cc:1217] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Deduplicated request from leader. Original: 3.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:07:31.719316 21222 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:31.715577 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.720471 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.720724 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.721287 21222 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:31.675688 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.721994 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.722106 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.722704 24038 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.687332 23896 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.723826 24038 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.724220 23896 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:31.688899 21808 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:31.639163 21809 rpcz_store.cc:276] 0709 13:07:29.638442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.589867 (+1951425us) service_pool.cc:224] Handling call
0709 13:07:31.590343 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.591054 (+   711us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:31.591103 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.591179 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:31.591213 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.591298 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.591439 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3161,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":20241}
I20260709 13:07:31.595755 24025 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.647926 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.691598 24130 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.732645 21143 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:31.601465 24129 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 13:07:31.595595 24052 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.705286 24020 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.715862 21807 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:31.723090 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.694460 24013 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:31.725174 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 934) took 2086 ms. Trace:
I20260709 13:07:31.755726 21808 rpcz_store.cc:276] 0709 13:07:29.638721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.660622 (+2021901us) service_pool.cc:224] Handling call
0709 13:07:31.688332 (+ 27710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.724943 (+ 36611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.725121 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.662494 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2317) took 2088 ms. Trace:
I20260709 13:07:31.714975 21223 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:31.686859 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:31.732721 23896 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.733620 21814 raft_consensus.cc:2410] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:31.734690 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.734712 21225 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:07:31.735455 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 120039us
I20260709 13:07:31.736176 23985 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.736908 21810 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.756726 21292 rpcz_store.cc:276] 0709 13:07:29.561525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.576155 (+2014630us) service_pool.cc:224] Handling call
0709 13:07:31.583509 (+  7354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.649724 (+ 66215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.649949 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.761875 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 832) took 2092 ms. Trace:
I20260709 13:07:31.762354 21810 rpcz_store.cc:276] 0709 13:07:29.669428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.668546 (+1999118us) service_pool.cc:224] Handling call
0709 13:07:31.736657 (+ 68111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.761618 (+ 24961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.761828 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.738673 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.696485 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 741) took 2296 ms. Trace:
I20260709 13:07:31.761355 24033 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:31.748265 21226 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:31.748500 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:31.763605 21813 rpcz_store.cc:276] 0709 13:07:29.393233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.584229 (+2190996us) service_pool.cc:224] Handling call
0709 13:07:31.636085 (+ 51856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.679599 (+ 43514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.679791 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:31.702469 23958 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.861s	user 0.022s	sys 0.017s
W20260709 13:07:31.694437 21264 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.891s (SENT)
I20260709 13:07:31.772360 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:31.763898 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:31.749477 21811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 750) took 2329 ms (client timeout 2653 ms). Trace:
I20260709 13:07:31.764133 21220 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.766732 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:31.770928 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 84219.2us
I20260709 13:07:31.767951 21294 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.739131 24075 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:31.775758 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 101629us
I20260709 13:07:31.775969 24013 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.777496 24013 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.778380 24134 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.780012 21808 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:31.781775 24052 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.782624 24103 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:31.783459 21225 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:31.783358 24103 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.784518 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.743016 24130 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:31.783684 24025 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:31.789819 21294 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:07:31.773504 21811 rpcz_store.cc:269] 0709 13:07:29.397136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.163720 (+1766584us) service_pool.cc:224] Handling call
0709 13:07:31.715091 (+551371us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54004781d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.715250 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179343232}
W20260709 13:07:31.773185 23958 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.075s	user 0.023s	sys 0.018s
I20260709 13:07:31.793013 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:31.794834 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.755123 24129 consensus_queue.cc:1243] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:31.729844 24045 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.753484 21148 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:31.810343 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:31.810655 24134 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:31.810932 21148 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:31.815650 24000 consensus_meta.cc:287] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.951s	user 0.014s	sys 0.007s
I20260709 13:07:31.816259 24000 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.817188 24059 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.818588 21150 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:31.766566 24099 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.799099 21222 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:31.799889 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.774179 23855 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.764393 24033 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.796159 23757 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 13:07:31.805073 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.805778 21116 leader_election.cc:400] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5.
I20260709 13:07:31.807437 24025 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.808045 24130 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:31.808707 21813 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:31.858661 21813 pending_rounds.cc:85] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 5
I20260709 13:07:31.790792 23723 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.809013 23804 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.763959 23985 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:31.762652 23913 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:31.821671 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 55022.6us
I20260709 13:07:31.773216 23989 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:31.714977 24114 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:31.848145 21812 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:31.848137 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.853785 21149 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:31.883504 24025 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:31.884588 24130 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.858986 21813 pending_rounds.cc:107] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:31.862402 23723 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:31.885596 24104 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.990526 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2321) took 1128 ms. Trace:
I20260709 13:07:31.991909 21220 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:32.118813 21813 raft_consensus.cc:2889] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.118492 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 939) took 2467 ms. Trace:
W20260709 13:07:31.990115 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 127520us
W20260709 13:07:31.955463 21190 leader_election.cc:336] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.096s (SENT)
I20260709 13:07:31.959987 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.893910 21298 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.120656 21812 rpcz_store.cc:276] 0709 13:07:29.651116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.666825 (+2015709us) service_pool.cc:224] Handling call
0709 13:07:31.774704 (+107879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.118235 (+343531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.118437 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.900496 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:31.992327 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 839) took 2285 ms. Trace:
I20260709 13:07:32.119379 21294 rpcz_store.cc:276] 0709 13:07:30.862211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.316319 (+454108us) service_pool.cc:224] Handling call
0709 13:07:31.990285 (+673966us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540018bfd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:31.990425 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673203968}
I20260709 13:07:32.061120 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:31.900033 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:32.127866 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.979043 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.079726 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:31.888042 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 93260.2us
I20260709 13:07:32.130995 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:32.133284 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.136623 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.139153 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.140321 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.143478 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:32.122216 21805 rpcz_store.cc:276] 0709 13:07:29.694061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.679333 (+1985272us) service_pool.cc:224] Handling call
0709 13:07:31.700812 (+ 21479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.703162 (+  2350us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:31.799205 (+ 96043us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.979410 (+180205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.979487 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:31.979556 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.979659 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.979834 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75566,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12808,"thread_start_us":183065,"threads_started":2}
I20260709 13:07:32.137497 21142 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:32.147783 21297 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
W20260709 13:07:32.151777 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 171218us
W20260709 13:07:32.059481 24058 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.004s
I20260709 13:07:31.893674 23757 consensus_queue.cc:1243] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:31.891480 23998 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.123001 23723 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.900166 24105 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.132884 24059 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:32.163600 24159 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:32.165921 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.172915 24017 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.174106 24103 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.026520 24036 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:31.990270 24134 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:32.148231 21148 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
I20260709 13:07:32.243371 21218 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.158070 23985 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.239804 21225 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:32.254608 21294 raft_consensus.cc:2410] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:32.178243 23998 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.264462 23998 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.264894 24134 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.185812 24104 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.269464 24104 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.273998 24103 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:32.274513 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:32.275810 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.276763 23855 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.277387 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.277607 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.278262 21292 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:32.278805 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.270895 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.279999 21148 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.285547 24114 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.189373 24099 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:32.290061 21148 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:32.291148 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.291872 24025 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:32.292300 24013 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.005s
W20260709 13:07:32.293143 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 446012us
W20260709 13:07:32.297154 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 176126us
I20260709 13:07:32.297274 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:32.303000 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.305982 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.307458 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.308307 21225 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:32.281353 24045 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:32.315151 21190 leader_election.cc:336] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.550s (SENT)
I20260709 13:07:32.297096 24036 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.317543 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:32.301231 23943 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:32.310159 24058 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.321719 21147 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:32.315243 23856 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.003s
I20260709 13:07:32.327817 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:32.329437 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.329573 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:32.330178 21218 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:32.333171 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.314007 24134 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:32.282017 24020 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.333819 21225 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:32.342841 21294 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:32.340108 23943 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.350419 21806 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:32.321249 23998 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.340304 24025 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.352735 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:32.357901 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.355398 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.336623 24036 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.344700 24058 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:32.336380 23856 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.384649 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:32.375456 21295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.014s	sys 0.070s
I20260709 13:07:32.383105 21294 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:32.386226 21295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.016s	sys 0.071s
I20260709 13:07:32.389351 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:32.356141 24025 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.396826 24045 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:32.397742 21217 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:32.392810 24167 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:07:32.403527 21225 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:32.407809 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.409476 21294 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:32.412685 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.398240 24025 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.403218 23989 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:32.430462 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 316487us
I20260709 13:07:32.434403 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:32.435422 24103 raft_consensus.cc:2764] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:32.437304 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:32.438475 24103 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.429755 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2316) took 2838 ms. Trace:
I20260709 13:07:32.408735 24045 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:32.442589 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.440461 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.409528 24134 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:32.457463 24164 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:07:32.459646 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.460497 21226 raft_consensus.cc:2368] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
W20260709 13:07:32.462133 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.448233 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:32.442014 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.463949 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:32.466346 21225 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:32.475463 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:32.475528 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.480432 21147 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.461529 24134 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.442575 21295 rpcz_store.cc:276] 0709 13:07:29.561220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.444713 (+1883493us) service_pool.cc:224] Handling call
0709 13:07:31.486600 (+ 41887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.489348 (+  2748us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:31.576696 (+ 87348us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.399120 (+822424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.399171 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.399217 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.399417 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.399538 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1331,"prepare.queue_time_us":314928,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":8662,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5256,"thread_start_us":800185,"threads_started":2,"wal-append.queue_time_us":710337}
I20260709 13:07:32.462366 23856 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.461321 23759 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:32.487584 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.489944 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.528195 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:32.530943 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:32.532440 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 84475.4us
I20260709 13:07:32.486147 24134 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.480211 24017 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.533275 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:32.475612 24026 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.460698 24045 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.541447 24182 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.541970 21145 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:32.547080 23855 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.494903 23943 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.581709 23855 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.534924 24020 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.589358 21147 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:32.546903 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:32.550277 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 549) took 1786 ms. Trace:
W20260709 13:07:32.551720 24168 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:32.552719 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:32.554792 21223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55540
I20260709 13:07:32.557307 21151 raft_consensus.cc:606] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:32.557950 24104 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.558507 24180 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.560284 24000 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:32.561175 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.561937 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:32.562306 24155 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.806s	user 0.006s	sys 0.006s
I20260709 13:07:32.565693 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 578) took 1294 ms. Trace:
W20260709 13:07:32.566787 21814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 833) took 2897 ms (client timeout 2264 ms). Trace:
W20260709 13:07:32.567505 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 305644us
I20260709 13:07:32.567759 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.568993 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.570878 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1780) took 3018 ms. Trace:
I20260709 13:07:32.572255 21220 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:32.573910 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.577847 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.591692 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.591548 21298 rpcz_store.cc:276] 0709 13:07:30.763969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.667668 (+903699us) service_pool.cc:224] Handling call
0709 13:07:31.670357 (+  2689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.121928 (+451571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.549980 (+428052us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540018bad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.550204 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446131072}
I20260709 13:07:32.593926 21151 raft_consensus.cc:614] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:32.491855 24103 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.529520 23695 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:07:32.600716 21114 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.496258 24013 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:32.581224 24026 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.814657 24013 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:32.815086 24026 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:32.593770 24038 consensus_meta.cc:287] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.007s
W20260709 13:07:32.628918 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.630684 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1796) took 1120 ms. Trace:
W20260709 13:07:32.815003 24178 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:32.794956 24105 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:32.818174 21150 rpcz_store.cc:276] 0709 13:07:31.510590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.510746 (+   156us) service_pool.cc:224] Handling call
0709 13:07:31.547221 (+ 36475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.828189 (+280968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.630338 (+802149us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540017b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.630607 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623525760}
I20260709 13:07:32.825919 21778 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:32.828333 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 298148us
W20260709 13:07:32.809803 24150 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.222s	user 0.007s	sys 0.011s
W20260709 13:07:32.667730 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.764576 24169 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:07:32.756342 24176 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.630915 21810 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.034s	sys 0.059s
W20260709 13:07:32.841522 21810 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.037s	sys 0.067s
I20260709 13:07:32.732270 24180 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:32.794601 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.842027 24105 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.851738 23998 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.855377 24174 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:32.855870 24157 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.051s	user 0.004s	sys 0.006s
I20260709 13:07:32.855926 24174 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.856463 24174 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.858055 24105 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.858196 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.860765 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1800) took 1209 ms. Trace:
I20260709 13:07:32.861949 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.862695 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.594682 24059 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:07:32.632050 21144 rpcz_store.cc:276] 0709 13:07:29.552162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.552268 (+   106us) service_pool.cc:224] Handling call
0709 13:07:29.564404 (+ 12136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.554018 (+2989614us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54000c33a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf5858 00007f2b6dd79e9d 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c
0709 13:07:32.554087 (+    69us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.554109 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.554151 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:32.554195 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.555218 (+  1023us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b5400215054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.570534 (+ 15316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.570686 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5401,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":6064640128}
I20260709 13:07:32.494019 23759 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.757369 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.729533 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2365) took 1107 ms. Trace:
I20260709 13:07:32.534724 24058 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.595572 24052 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:07:32.631129 21143 rpcz_store.cc:276] 0709 13:07:31.271217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.273127 (+  1910us) service_pool.cc:224] Handling call
0709 13:07:31.273743 (+   616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.743858 (+470115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.565450 (+821592us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540031d8d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.565635 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037451520}
I20260709 13:07:32.764178 23989 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.644049 24036 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:32.593950 23985 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.813552 23913 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:32.813819 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 267030us
I20260709 13:07:32.813987 23926 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.815148 24013 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.593776 21223 raft_consensus.cc:606] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:32.919540 21223 raft_consensus.cc:614] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:32.629837 24074 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
W20260709 13:07:32.816555 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 215940us
I20260709 13:07:32.802414 21295 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:32.743009 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 840) took 3040 ms. Trace:
I20260709 13:07:32.709146 21218 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:32.921212 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.922605 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:32.821219 24103 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.861183 21148 rpcz_store.cc:276] 0709 13:07:31.651710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.292100 (+640390us) service_pool.cc:224] Handling call
0709 13:07:32.292466 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.314139 (+ 21673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.314162 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.322785 (+  8623us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.486631 (+163846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:32.486688 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.486779 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.860542 (+373763us) raft_consensus.cc:1685] finished
0709 13:07:32.860563 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.860706 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8674,"raft.queue_time_us":15701,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4919,"thread_start_us":135129,"threads_started":1,"wal-append.queue_time_us":244394}
W20260709 13:07:32.863862 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 82206.8us
I20260709 13:07:32.863517 24176 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.632357 21297 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.864705 23998 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.862955 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2379) took 1002 ms. Trace:
I20260709 13:07:32.865036 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2314) took 3304 ms. Trace:
W20260709 13:07:32.865783 24173 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:07:32.866955 24130 consensus_meta.cc:287] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.000s
I20260709 13:07:32.868609 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53492 (request call id 30) took 1599 ms. Trace:
I20260709 13:07:32.872375 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2377) took 1112 ms. Trace:
W20260709 13:07:32.874528 24158 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.095s	user 0.009s	sys 0.000s
I20260709 13:07:32.879356 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:32.631227 21814 rpcz_store.cc:269] 0709 13:07:29.669723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.178892 (+1509169us) service_pool.cc:224] Handling call
0709 13:07:32.566536 (+1387644us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400660154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:32.566713 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510450048}
I20260709 13:07:32.880450 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.933482 21151 rpcz_store.cc:276] 0709 13:07:31.269045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.276668 (+  7623us) service_pool.cc:224] Handling call
0709 13:07:32.868412 (+1591744us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400215054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:32.868521 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941573888}
I20260709 13:07:32.885740 21224 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
I20260709 13:07:32.886755 24190 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.887928 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1407) took 1254 ms. Trace:
I20260709 13:07:32.900974 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.902734 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 843) took 1548 ms. Trace:
I20260709 13:07:32.937852 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:32.656860 21807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.010s
W20260709 13:07:32.938542 21807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.001s	sys 0.018s
I20260709 13:07:32.924082 24103 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.911692 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.913707 24092 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.913789 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.914409 23989 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.914808 23759 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:32.914968 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.915465 21146 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.915277 23985 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:32.815507 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.907450 21219 rpcz_store.cc:276] 0709 13:07:31.649935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.662705 (+ 12770us) service_pool.cc:224] Handling call
0709 13:07:31.676685 (+ 13980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.689734 (+ 13049us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:31.690090 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.768245 (+ 78155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.768286 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:31.768327 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.709661 (+941334us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54001275d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.709716 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.709889 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":788,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":2114,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10484,"spinlock_wait_cycles":30998144,"thread_start_us":77657,"threads_started":1,"wal-append.queue_time_us":171930,"wal-append.run_cpu_time_us":1432,"wal-append.run_wall_time_us":1004638}
I20260709 13:07:32.917428 24134 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.946637 24073 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:32.960007 24134 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:32.961349 21294 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:32.920996 21806 rpcz_store.cc:276] 0709 13:07:29.694400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.718970 (+2024570us) service_pool.cc:224] Handling call
0709 13:07:31.719404 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.352297 (+632893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.734204 (+381907us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540012edd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.734440 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445122304}
I20260709 13:07:32.923964 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:32.927700 21221 rpcz_store.cc:276] 0709 13:07:31.865396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.861626 (+996230us) service_pool.cc:224] Handling call
0709 13:07:32.862887 (+  1261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:32.931946 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 753) took 3059 ms. Trace:
I20260709 13:07:32.943449 24017 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.934111 21222 rpcz_store.cc:276] 0709 13:07:31.763147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.131080 (+367933us) service_pool.cc:224] Handling call
0709 13:07:32.131376 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.159192 (+ 27816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.159220 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.159302 (+    82us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.162445 (+  3143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.872164 (+709719us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54002369d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.872208 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.872325 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63480704}
I20260709 13:07:32.909667 21298 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:32.939630 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 841) took 1626 ms. Trace:
I20260709 13:07:32.944764 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:32.958559 23855 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:32.937758 21217 rpcz_store.cc:276] 0709 13:07:31.653388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.665009 (+ 11621us) service_pool.cc:224] Handling call
0709 13:07:31.699901 (+ 34892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.402850 (+702949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.887696 (+484846us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54000fb754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:32.887872 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604292480}
W20260709 13:07:32.946208 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45321.8us
I20260709 13:07:32.929483 24104 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:32.961452 23723 consensus_meta.cc:287] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.000s
I20260709 13:07:32.938035 21810 rpcz_store.cc:276] 0709 13:07:31.354757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.763327 (+408570us) service_pool.cc:224] Handling call
0709 13:07:31.767110 (+  3783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.767820 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.767972 (+   152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.801756 (+ 33784us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.050915 (+249159us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:32.842001 (+791086us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.902397 (+ 60396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.902475 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.902510 (+    35us) raft_consensus.cc:1685] finished
0709 13:07:32.902522 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.902660 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54289,"prepare.queue_time_us":110955,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":60109,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"thread_start_us":976309,"threads_started":2,"wal-append.queue_time_us":507411}
I20260709 13:07:32.957438 23759 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.883924 21150 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:32.966509 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 337903us
I20260709 13:07:32.966874 21223 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:32.967514 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47712.6us
I20260709 13:07:32.939088 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:32.947576 24103 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.927780 21296 rpcz_store.cc:276] 0709 13:07:29.560558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.353988 (+1793430us) service_pool.cc:224] Handling call
0709 13:07:31.354531 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.396173 (+ 41642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.396224 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.491583 (+ 95359us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.566977 (+ 75394us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:31.567013 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.567080 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.561715 (+994635us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:32.864654 (+302939us) raft_consensus.cc:1685] finished
0709 13:07:32.864675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.864867 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26664,"raft.queue_time_us":39145,"raft.run_cpu_time_us":2105,"raft.run_wall_time_us":111014,"spinlock_wait_cycles":31390592,"thread_start_us":74944,"threads_started":1,"wal-append.queue_time_us":165800}
I20260709 13:07:32.946447 24033 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:32.951023 24130 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.961050 24134 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.975986 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:32.978138 24189 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:32.979552 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.962617 21809 rpcz_store.cc:276] 0709 13:07:29.872372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.740116 (+1867744us) service_pool.cc:224] Handling call
0709 13:07:31.740672 (+   556us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.741420 (+   748us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:31.741450 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.742203 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.146186 (+403983us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.146229 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.146303 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.931693 (+785390us) raft_consensus.cc:1685] finished
0709 13:07:32.931720 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.931882 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1113,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":403497,"threads_started":1,"wal-append.queue_time_us":597623}
I20260709 13:07:32.965363 21807 rpcz_store.cc:276] 0709 13:07:31.353684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.760906 (+407222us) service_pool.cc:224] Handling call
0709 13:07:31.764221 (+  3315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.764817 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.764849 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.765395 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.861245 (+ 95850us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.939133 (+1077888us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.939340 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.939413 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.939453 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:32.939468 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.939577 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":300404,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":6550,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":3856,"thread_start_us":1079542,"threads_started":2,"wal-append.queue_time_us":549271}
W20260709 13:07:32.981047 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79223.9us
I20260709 13:07:32.985061 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:32.987246 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:32.971980 24104 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.995639 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 133013us
I20260709 13:07:32.995924 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:32.982167 23779 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.000430 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.002774 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2319) took 3440 ms. Trace:
I20260709 13:07:33.000056 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.003192 21293 rpcz_store.cc:276] 0709 13:07:29.562084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.586144 (+2024060us) service_pool.cc:224] Handling call
0709 13:07:31.589158 (+  3014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.628726 (+ 39568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.628756 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.629304 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.671819 (+ 42515us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:31.671877 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.671969 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.873851 (+1201882us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:32.997238 (+123387us) raft_consensus.cc:1685] finished
0709 13:07:32.997256 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.002717 (+  5461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9663,"raft.queue_time_us":40193,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":6258944,"thread_start_us":42024,"threads_started":1,"wal-append.queue_time_us":143356}
I20260709 13:07:32.995635 24130 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:32.993322 24104 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.990197 24190 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:32.989775 24033 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.980508 23804 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:33.013197 21296 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:32.978820 23723 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.020009 21263 leader_election.cc:400] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:33.020375 21263 leader_election.cc:403] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:32.997925 24134 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:33.022401 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53416.7us
I20260709 13:07:33.003033 23779 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.037655 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:33.012691 23998 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:33.049712 24025 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.003s
I20260709 13:07:33.050227 24025 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.023211 24175 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.053651 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:33.056162 23855 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.056658 21300 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:33.058034 21300 pending_rounds.cc:85] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 4
I20260709 13:07:33.012517 21048 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:33.058321 21300 pending_rounds.cc:107] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:07:33.058641 21300 raft_consensus.cc:2889] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.064966 21299 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.067970 23723 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.069867 21296 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.070437 23985 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:33.071054 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72247.1us
I20260709 13:07:33.073228 24130 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.077237 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2367) took 1371 ms. Trace:
I20260709 13:07:33.077798 21224 rpcz_store.cc:276] 0709 13:07:31.706303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.726364 (+ 20061us) service_pool.cc:224] Handling call
0709 13:07:33.076992 (+1350628us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540038c554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:33.077146 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443045120}
I20260709 13:07:33.078896 24176 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.052255 24025 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.082050 21299 raft_consensus.cc:1217] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-5.6]   Dedup: 1.4->[3.5-5.6]
I20260709 13:07:33.082753 21299 pending_rounds.cc:85] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 4
I20260709 13:07:33.083413 24190 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.035655 23779 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.086318 21299 pending_rounds.cc:107] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:07:33.084620 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.008114 24000 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:33.084460 24194 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6.
I20260709 13:07:33.086687 21299 raft_consensus.cc:2889] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:33.086827 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49313.5us
I20260709 13:07:32.996949 23759 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.035298 24180 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:33.099977 21264 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.451s (SENT)
I20260709 13:07:33.101375 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:33.085973 23998 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.115983 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:33.100255 24182 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:33.123796 24182 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.124146 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:33.125131 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:33.100386 24036 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:33.099392 24025 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:33.107424 23985 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:07:33.131178 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 130805us
I20260709 13:07:33.100452 24191 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:33.185760 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.119647 24097 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.097002 24174 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.119858 23998 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:33.195991 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 110065us
I20260709 13:07:33.199425 24195 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:33.200170 23998 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.200316 24195 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.202342 23998 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.204352 24026 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.205544 21291 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:33.126641 23989 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.215451 21297 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:33.130370 24180 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:33.156384 24036 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:33.188455 24045 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:33.212127 24182 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.223489 23989 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.237382 24045 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:33.236898 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:33.244616 23759 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.244544 24045 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.246035 24190 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.212967 24134 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:33.247668 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 49153.9us
I20260709 13:07:33.221343 24097 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.228139 24180 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:33.255427 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.258514 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.269809 24199 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.281726 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.256174 24180 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:33.303980 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 178916us
I20260709 13:07:33.305565 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.263362 24175 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.313090 24208 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:33.313690 24208 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.314546 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:33.316144 24208 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.318176 23985 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:33.318745 23985 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.319190 23985 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.324429 24174 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.271183 24187 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:33.327008 24187 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:33.327991 24187 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.265748 23723 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.281090 23856 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.337024 24104 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.341101 21812 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.342914 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.343761 21806 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:33.349018 24199 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.349265 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.350065 21811 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.340293 24104 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.308768 23998 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.357627 21805 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.309134 24097 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.359127 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.359773 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.311748 24186 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:33.361600 21115 leader_election.cc:336] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.749s (SENT)
I20260709 13:07:33.360328 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.370105 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.352726 24190 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:33.370411 21807 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:33.375846 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 61361.1us
I20260709 13:07:33.370941 21806 raft_consensus.cc:2376] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5. Re-sending same reply.
I20260709 13:07:33.310724 24013 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.368644 24186 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.369848 24026 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.425678 21147 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:33.426875 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.427784 21810 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:33.427982 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.377511 23856 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.429713 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:33.431562 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 69993.8us
I20260709 13:07:33.354415 23723 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.433606 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.423242 24186 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:33.439597 21097 auto_rebalancer.cc:893] Removing replace marker failed: Replica f81bf1abd0b34f518d1f2b79cc4dba77 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:33.440039 24103 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.442799 24103 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:33.440068 21097 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:33.383502 23998 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:07:33.432611 24199 consensus_queue.cc:1243] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:33.462718 23998 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.368295 24036 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.435472 23856 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.463796 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.478138 21810 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:33.448518 21097 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:33.496152 21814 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:33.477028 23998 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:33.496809 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.498826 21810 raft_consensus.cc:2410] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:33.447181 23779 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.499428 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.500190 21806 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.465827 23985 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.514524 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.515102 21810 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:33.515233 21814 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:33.519130 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2329) took 1346 ms. Trace:
I20260709 13:07:33.518782 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.520205 21806 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.522982 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.523586 21814 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.519587 21295 rpcz_store.cc:276] 0709 13:07:32.172942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.989394 (+816452us) service_pool.cc:224] Handling call
0709 13:07:32.996056 (+  6662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.010028 (+ 13972us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:33.022781 (+ 12753us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.518374 (+495593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.518427 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:33.518478 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.518540 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.519075 (+   535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6263,"prepare.queue_time_us":12615,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":72140,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":22418,"thread_start_us":414192,"threads_started":2,"wal-append.queue_time_us":201419}
W20260709 13:07:33.526533 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.527869 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.536535 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.536619 21810 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.538371 21812 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:33.540772 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.541281 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.541544 21811 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.541983 21295 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:33.542389 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.543107 21811 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.569936 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.598059 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.602267 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.603322 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.604470 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.605175 21807 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.605863 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:33.607513 24214 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:07:33.609838 21190 leader_election.cc:336] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.963s (SENT)
I20260709 13:07:33.610318 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.536231 24213 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.611804 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.574376 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.522089 23998 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.617684 21806 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:33.574759 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.618119 21190 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.621904 21805 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:33.622200 21810 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.625773 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.625919 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.620039 23723 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.640753 21810 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:33.641465 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.642050 21297 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.642175 21810 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:33.643953 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.644348 24038 raft_consensus.cc:2764] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:33.646310 24105 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:33.646710 24105 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:33.647167 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:33.647799 21149 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.648398 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:33.649688 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:33.650161 24103 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.650269 21148 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:33.650760 24103 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.651938 24186 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.652918 24103 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.654177 24195 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.654728 24186 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.622500 24000 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:33.655598 24130 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:33.656962 24130 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:33.657275 24000 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:33.657481 24130 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.627315 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.659142 21806 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.631368 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.664829 21297 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:33.617937 24013 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:33.668660 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.669643 21149 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:33.621843 24216 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.677385 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:33.568739 23855 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.679090 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:33.681533 21811 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:33.619696 24182 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.696681 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.697646 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.698258 21297 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:33.702647 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 100454us
I20260709 13:07:33.705962 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.708062 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.709549 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.710157 21297 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 3.
I20260709 13:07:33.628063 24180 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.696455 23855 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.711820 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.647558 24105 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.702044 24129 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:33.682696 24218 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:33.717875 23985 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:33.723544 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.711751 23998 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:33.723389 21035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 186004us
I20260709 13:07:33.723944 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.724098 24038 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:33.733978 21814 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:33.723731 24182 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.736099 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:33.736898 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60288.1us
I20260709 13:07:33.723237 24105 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.723313 23856 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.746799 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.747560 24130 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.747982 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:33.749028 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:33.750265 21297 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:33.751768 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.753131 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:33.755770 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:33.756352 21224 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:33.757695 24216 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.759856 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:33.725912 24129 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:33.761322 21806 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:33.767510 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:33.770004 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:33.770788 21224 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:33.771672 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:33.773459 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:33.776787 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:33.777590 21226 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:33.779743 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:33.780297 21217 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:33.783835 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 60012.8us
I20260709 13:07:33.768378 24186 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.781929 21144 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:33.768471 23985 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.769423 24182 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:33.778254 24038 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.775017 24216 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:33.781885 24058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.013s	sys 0.026s
I20260709 13:07:33.808946 21217 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
W20260709 13:07:33.795439 24058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.013s	sys 0.026s
I20260709 13:07:33.813097 21142 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:33.814735 21150 raft_consensus.cc:606] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.791996 24186 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:33.816370 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:33.819962 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.826182 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:33.828774 24221 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.831503 24036 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.827667 23855 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:33.831100 24233 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:33.833103 24233 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.833540 24233 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.833904 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:33.834386 23943 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.839725 23856 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.839934 23943 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:33.840953 21190 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:33.840876 23943 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.835602 24182 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.815150 24129 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:33.805505 23804 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:33.875982 24129 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.838076 24186 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:33.890002 24230 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:07:33.880808 24216 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:33.872478 24233 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.399758 24104 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.400456 24104 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.401561 24233 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:34.754738 24239 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.882s	user 0.001s	sys 0.000s
W20260709 13:07:34.881865 21080 debug-util.cc:398] Leaking SignalData structure 0x7b080034d660 after lost signal to thread 20036
W20260709 13:07:36.402390 21080 debug-util.cc:398] Leaking SignalData structure 0x7b0800091d20 after lost signal to thread 20039
I20260709 13:07:36.402673 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1819) took 2755 ms. Trace:
I20260709 13:07:36.402819 24104 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:36.403913 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 965) took 2650 ms. Trace:
I20260709 13:07:36.403060 21146 rpcz_store.cc:276] 0709 13:07:33.647096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.652104 (+  5008us) service_pool.cc:224] Handling call
0709 13:07:33.652430 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.652803 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.652832 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.653400 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.707164 (+ 53764us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.707201 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.707347 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.402468 (+2695121us) raft_consensus.cc:1685] finished
0709 13:07:36.402487 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.402613 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":989,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":53389,"threads_started":1,"wal-append.queue_time_us":116065}
W20260709 13:07:35.111186 24219 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.505s	user 0.002s	sys 0.010s
I20260709 13:07:35.848531 24194 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:36.404907 24194 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:35.877564 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1802) took 4200 ms. Trace:
I20260709 13:07:36.406001 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2342) took 3073 ms. Trace:
I20260709 13:07:36.406212 21142 rpcz_store.cc:276] 0709 13:07:31.677683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.311977 (+634294us) service_pool.cc:224] Handling call
0709 13:07:32.321819 (+  9842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.814626 (+1492807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.877249 (+2062623us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400065754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:35.877490 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3429229952}
W20260709 13:07:35.889407 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.408069 21116 connection.cc:256] RPC call timeout handler was delayed by -1.6903599050000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:07:36.406544 21294 rpcz_store.cc:276] 0709 13:07:33.332661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.345518 (+ 12857us) service_pool.cc:224] Handling call
0709 13:07:33.347007 (+  1489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.355941 (+  8934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.355967 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.365137 (+  9170us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.497257 (+132120us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:33.497301 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.497372 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.110336 (+1612964us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:36.405633 (+1295297us) raft_consensus.cc:1685] finished
0709 13:07:36.405675 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.405931 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":805,"raft.queue_time_us":1322,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5836,"spinlock_wait_cycles":33646464,"thread_start_us":66144,"threads_started":1,"wal-append.queue_time_us":128440}
W20260709 13:07:36.408612 21116 connection.cc:256] RPC call timeout handler was delayed by -1.4673843610000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
I20260709 13:07:35.894793 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1813) took 3013 ms. Trace:
W20260709 13:07:35.900190 21115 connection.cc:256] RPC call timeout handler was delayed by -2.0394163219999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:07:35.907827 23723 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:36.409449 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:36.410197 23723 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:35.911820 24222 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 2.315s	user 0.002s	sys 0.014s
I20260709 13:07:36.411424 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:33.880960 24180 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:36.040962 23779 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:36.061825 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53492 (request call id 31) took 3008 ms. Trace:
W20260709 13:07:36.038928 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 2.19788e+06us
I20260709 13:07:36.039326 23804 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:36.036674 24000 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.420763 24000 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:36.421700 24000 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:36.422470 21080 debug-util.cc:398] Leaking SignalData structure 0x7b0800091cc0 after lost signal to thread 21083
W20260709 13:07:36.087922 23998 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 2.329s	user 0.020s	sys 0.004s
W20260709 13:07:36.089378 21814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.238s	user 0.000s	sys 0.019s
W20260709 13:07:36.099794 21291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1948) took 4039 ms (client timeout 2975 ms). Trace:
I20260709 13:07:36.106071 24175 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:36.114286 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:36.118173 21293 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:36.119674 21048 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 6, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:36.129945 24209 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 2.668s	user 0.003s	sys 0.013s
W20260709 13:07:36.141327 24038 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 2.346s	user 0.008s	sys 0.025s
I20260709 13:07:36.147886 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2338) took 3517 ms. Trace:
I20260709 13:07:36.170138 24045 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.173146 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1962) took 3701 ms. Trace:
I20260709 13:07:36.176005 24013 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.188143 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.214002 21035 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 881a7cf58d404812aa274b116b666741 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7c5246dc52bb49f38aef22aba1467452 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:36.297055 24190 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:36.325443 24033 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:36.328575 24105 consensus_meta.cc:287] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 2.583s	user 0.026s	sys 0.006s
I20260709 13:07:36.329030 24134 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:36.320488 24244 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.338299 24017 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:36.341567 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1824) took 2579 ms. Trace:
I20260709 13:07:36.348799 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:36.350344 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:36.350684 21300 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:36.353101 21264 connection.cc:256] RPC call timeout handler was delayed by -3.0776027999999087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:07:36.354403 24246 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.356824 23855 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:36.360381 24245 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.413254 21150 rpcz_store.cc:276] 0709 13:07:33.053377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.053529 (+   152us) service_pool.cc:224] Handling call
0709 13:07:36.061633 (+3008104us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400065754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:36.061733 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748893440}
I20260709 13:07:36.413635 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:36.409264 21147 rpcz_store.cc:276] 0709 13:07:32.881336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.881464 (+   128us) service_pool.cc:224] Handling call
0709 13:07:32.882763 (+  1299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.426295 (+543532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.894521 (+2468226us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540017be54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:35.894725 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248042752}
I20260709 13:07:36.404256 21809 rpcz_store.cc:276] 0709 13:07:33.753545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.766483 (+ 12938us) service_pool.cc:224] Handling call
0709 13:07:33.778980 (+ 12497us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:33.783395 (+  4415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.783423 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:33.803370 (+ 19947us) log.cc:844] Serialized 546 byte log entry
0709 13:07:33.813654 (+ 10284us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:33.813709 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.813778 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.403687 (+2589909us) raft_consensus.cc:1685] finished
0709 13:07:36.403706 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.403836 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803,"raft.queue_time_us":524,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":4313,"thread_start_us":9812,"threads_started":1,"wal-append.queue_time_us":69196}
W20260709 13:07:36.465421 21291 rpcz_store.cc:269] 0709 13:07:32.060087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.567484 (+507397us) service_pool.cc:224] Handling call
0709 13:07:36.099508 (+3532024us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400160dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:36.099693 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318591360}
W20260709 13:07:36.466120 21035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 252176us
W20260709 13:07:36.427527 21191 connection.cc:256] RPC call timeout handler was delayed by -2.1546178449999616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:07:36.465545 21292 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:36.437032 21116 connection.cc:256] RPC call timeout handler was delayed by -1.0581688239999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:07:36.468341 21296 rpcz_store.cc:276] 0709 13:07:32.630417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.099114 (+468697us) service_pool.cc:224] Handling call
0709 13:07:33.114400 (+ 15286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.126030 (+ 11630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.126077 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.129258 (+  3181us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:33.129315 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.147546 (+3018231us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b540022ddd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:36.147604 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.147772 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14286208}
W20260709 13:07:36.469120 21116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.545s (SENT) [suppressed 20 similar messages]
W20260709 13:07:36.471370 21814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.620s	user 0.002s	sys 0.021s
W20260709 13:07:36.466847 21264 connection.cc:256] RPC call timeout handler was delayed by -2.988502799999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:07:36.472518 21264 connection.cc:256] RPC call timeout handler was delayed by -2.96240279999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:07:36.474468 21191 connection.cc:256] RPC call timeout handler was delayed by -2.0661988790000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29750000000000004s for a response
I20260709 13:07:36.466877 21149 rpcz_store.cc:276] 0709 13:07:33.762619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.762751 (+   132us) service_pool.cc:224] Handling call
0709 13:07:33.763128 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.765768 (+  2640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.765814 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.769225 (+  3411us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.828097 (+ 58872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.870025 (+2041928us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.870255 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.870344 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.341354 (+471010us) raft_consensus.cc:1685] finished
0709 13:07:36.341372 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.341511 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2043724,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":24194,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"thread_start_us":36764,"threads_started":1,"wal-append.queue_time_us":2467590}
I20260709 13:07:36.484568 21295 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:36.500612 21264 connection.cc:256] RPC call timeout handler was delayed by -2.8814027999999325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:07:36.501224 21264 connection.cc:256] RPC call timeout handler was delayed by -2.8274027999999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:07:36.504805 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:36.485633 24013 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.423179 24000 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.515919 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:36.458910 24199 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.469928 21298 rpcz_store.cc:276] 0709 13:07:32.471605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.014184 (+542579us) service_pool.cc:224] Handling call
0709 13:07:33.031440 (+ 17256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.238644 (+207204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.238683 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.240291 (+  1608us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.305828 (+ 65537us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:33.305872 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.172645 (+2866773us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b540001e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:36.172712 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.172770 (+    58us) raft_consensus.cc:1685] finished
0709 13:07:36.172789 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.173069 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66017,"raft.queue_time_us":112382,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4909,"spinlock_wait_cycles":204849024,"thread_start_us":119579,"threads_started":2,"wal-append.queue_time_us":96498,"wal-append.run_cpu_time_us":2147,"wal-append.run_wall_time_us":1002152}
I20260709 13:07:36.466835 24175 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:36.482286 24038 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.523018 21297 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:36.524211 24260 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:36.473330 23804 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:36.465916 24033 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:36.425534 23723 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:36.526319 21264 connection.cc:256] RPC call timeout handler was delayed by -2.7833027999998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 13:07:36.482052 24176 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:36.486938 23856 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.527815 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:36.539043 21291 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:36.503912 24233 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:36.500078 24058 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.512444 23926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.441s	user 0.025s	sys 0.034s
I20260709 13:07:36.507650 24105 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.512373 24013 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:36.507786 24249 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.484318 24134 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.512158 24258 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:36.543135 21220 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:36.406055 24194 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.483330 24045 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.484182 24244 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:36.549015 21191 connection.cc:256] RPC call timeout handler was delayed by -1.850058368999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:07:36.557009 21191 connection.cc:256] RPC call timeout handler was delayed by -1.7393583690000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:07:36.505940 24017 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:36.541891 23926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.470s	user 0.025s	sys 0.034s
I20260709 13:07:36.482084 24245 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.579694 21291 raft_consensus.cc:1217] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-8.5]   Dedup: 6.4->[8.5-8.5]
W20260709 13:07:36.561443 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.580282 21291 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:07:36.529596 21048 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), pending config changed. New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:36.551918 24038 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.508857 24190 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:36.557582 21191 connection.cc:256] RPC call timeout handler was delayed by -1.5151880539999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:07:36.589846 21191 connection.cc:256] RPC call timeout handler was delayed by -1.393181917999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:07:36.542676 24176 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.588948 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1968) took 4043 ms. Trace:
I20260709 13:07:36.590845 21299 rpcz_store.cc:276] 0709 13:07:32.545220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.065967 (+520747us) service_pool.cc:224] Handling call
0709 13:07:33.081798 (+ 15831us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:33.214310 (+132512us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:33.214339 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.228378 (+ 14039us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.335515 (+107137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:33.335564 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.335638 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.129261 (+2793623us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:36.579429 (+450168us) raft_consensus.cc:1685] finished
0709 13:07:36.579449 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.588884 (+  9435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13211,"raft.queue_time_us":17044,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":8155904,"thread_start_us":186237,"threads_started":2,"wal-append.queue_time_us":193564}
I20260709 13:07:36.520011 24246 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.592834 24176 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:36.578665 24194 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.594165 21294 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:07:36.590319 21191 connection.cc:256] RPC call timeout handler was delayed by -1.3279321950000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:07:36.601047 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:36.555796 24258 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:36.579718 23855 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.549058 24058 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.540194 24199 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.552433 24233 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:36.553664 23856 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.611848 24033 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.627868 23856 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:36.628371 24033 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.599474 24038 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.553730 24105 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.615615 24190 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:36.577422 24175 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:36.556448 23804 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.569235 23779 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:36.780298 21292 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:36.613965 24262 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.548334 24260 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:36.821130 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 216652us
W20260709 13:07:36.619681 21115 connection.cc:256] RPC call timeout handler was delayed by -1.7172864320000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
W20260709 13:07:36.831429 21115 connection.cc:256] RPC call timeout handler was delayed by -1.5926112760000706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:07:36.831926 21115 connection.cc:256] RPC call timeout handler was delayed by -1.4076363770000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
I20260709 13:07:36.682046 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:36.832553 21115 connection.cc:256] RPC call timeout handler was delayed by -1.3454024569999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30760000000000004s for a response
I20260709 13:07:36.832819 21150 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:07:36.840327 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 316279us
W20260709 13:07:36.832960 21115 connection.cc:256] RPC call timeout handler was delayed by -1.3305751939999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
W20260709 13:07:36.847839 21115 connection.cc:256] RPC call timeout handler was delayed by -1.2926455450000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:07:36.848229 21115 connection.cc:256] RPC call timeout handler was delayed by -1.2288949439999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:07:36.834338 21191 leader_election.cc:336] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.708s (SENT)
I20260709 13:07:36.608575 24258 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.555569 24249 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:36.863577 21264 connection.cc:256] RPC call timeout handler was delayed by -2.6123027999999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:07:36.926610 21264 connection.cc:256] RPC call timeout handler was delayed by -2.4444347469999457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35000000000000003s for a response
W20260709 13:07:36.926959 21264 connection.cc:256] RPC call timeout handler was delayed by -1.8573877300000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 13:07:36.804260 24251 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:07:36.927244 21264 connection.cc:256] RPC call timeout handler was delayed by -1.8483877300000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:07:36.928634 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 94340.8us
W20260709 13:07:36.930480 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 516888us
I20260709 13:07:36.629040 24045 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:36.965950 21264 connection.cc:256] RPC call timeout handler was delayed by -1.412232691999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:07:36.973883 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:36.612924 23855 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:36.849406 24104 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:36.978042 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:36.859485 24175 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.971701 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:36.987385 21225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58884ca99bd494292202a75faf1833c"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:36.925938 24190 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:36.982409 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 124869us
I20260709 13:07:37.013273 21225 raft_consensus.cc:606] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:37.013736 21225 raft_consensus.cc:614] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:37.020648 24190 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.022433 24260 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:36.992810 24216 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:07:37.029510 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.981760 24259 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:37.002003 24252 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:07:36.963343 23723 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:36.850993 24262 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:36.862462 24257 consensus_queue.cc:1175] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3585d99c303e453c8c3762b294caba4e" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:07:36.982426 23856 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
W20260709 13:07:37.287081 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 309129us
I20260709 13:07:37.120646 21150 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:37.085443 21807 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.004s
W20260709 13:07:37.284793 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 269365us
W20260709 13:07:37.096278 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 3.26513e+06us
W20260709 13:07:37.057955 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.285637 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08003cae40 after lost signal to thread 21175
I20260709 13:07:37.294571 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:37.295920 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:37.294147 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 194604us
W20260709 13:07:37.305729 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9320 after lost signal to thread 21250
I20260709 13:07:37.286057 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.306130 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:37.306638 21142 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:37.256069 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.256501 21144 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:37.301971 21264 leader_election.cc:336] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.878s (SENT)
I20260709 13:07:37.312136 21264 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:37.296232 21807 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:37.306149 21080 debug-util.cc:398] Leaking SignalData structure 0x7b0800349920 after lost signal to thread 21251
W20260709 13:07:37.316360 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08003121c0 after lost signal to thread 21324
W20260709 13:07:37.316717 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08003246e0 after lost signal to thread 21325
W20260709 13:07:37.311547 21115 connection.cc:256] RPC call timeout handler was delayed by -1.062841509000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:07:37.398249 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:37.400547 21080 debug-util.cc:398] Leaking SignalData structure 0x7b0800346280 after lost signal to thread 21838
W20260709 13:07:37.401033 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08002efd60 after lost signal to thread 21839
W20260709 13:07:37.404229 21080 debug-util.cc:398] Leaking SignalData structure 0x7b080029fce0 after lost signal to thread 24157
W20260709 13:07:37.406690 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 100646us
W20260709 13:07:37.113801 24194 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.000s
W20260709 13:07:37.299293 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 308201us
W20260709 13:07:37.411731 21296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.028s
I20260709 13:07:37.114856 24176 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.030948 24013 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:37.079466 21048 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.050952 24134 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:37.124833 24261 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:37.479472 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 177535us
W20260709 13:07:37.518072 21264 leader_election.cc:336] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.881s (SENT)
I20260709 13:07:37.521553 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:37.017259 24045 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.500748 21296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.012s	sys 0.028s
I20260709 13:07:37.597067 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1974) took 1248 ms. Trace:
I20260709 13:07:37.597463 21296 rpcz_store.cc:276] 0709 13:07:36.349059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.517332 (+168273us) service_pool.cc:224] Handling call
0709 13:07:36.517625 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.517847 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.852479 (+334632us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.596696 (+744217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.596746 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.596797 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.596863 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.597005 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476589,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":1060738,"threads_started":2,"wal-append.queue_time_us":733108}
I20260709 13:07:37.599305 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:37.501540 21298 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.017s	sys 0.050s
W20260709 13:07:37.600082 21298 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.017s	sys 0.050s
I20260709 13:07:37.478411 21145 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:37.506004 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:37.506642 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 211615us
I20260709 13:07:37.053031 24246 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.510454 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:37.511960 21115 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.849s (SENT)
I20260709 13:07:37.506795 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:37.299293 24245 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.525805 24105 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.528026 24249 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.513958 23779 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:37.531339 24271 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:37.532123 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1433) took 3754 ms. Trace:
W20260709 13:07:37.600713 24258 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.631s	user 0.001s	sys 0.008s
W20260709 13:07:37.525833 24264 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.411s	user 0.000s	sys 0.000s
I20260709 13:07:37.535315 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:37.537191 24267 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:07:37.538208 24266 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:37.539390 24033 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:37.540483 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.541251 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:37.639920 21292 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.541805 24244 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.548872 24262 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.080153 23855 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.632606 23926 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.304888 24199 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.293931 23804 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.550948 24233 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.556332 24013 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:37.502897 24176 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.572178 24038 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.576468 23943 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:37.581461 21222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1427) took 3826 ms (client timeout 2959 ms). Trace:
I20260709 13:07:37.408097 24248 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.583082 24260 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:37.583606 21294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1980) took 1233 ms (client timeout 1555 ms). Trace:
W20260709 13:07:37.682436 21294 rpcz_store.cc:269] 0709 13:07:36.350640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.409112 (+ 58472us) service_pool.cc:224] Handling call
0709 13:07:37.583450 (+1174338us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540029e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:37.583550 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422874496}
I20260709 13:07:37.584322 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2335) took 5054 ms. Trace:
I20260709 13:07:37.683399 21293 rpcz_store.cc:276] 0709 13:07:32.530565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.047867 (+517302us) service_pool.cc:224] Handling call
0709 13:07:36.117885 (+3070018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.468058 (+350173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.584112 (+1116054us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b5400160dd0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:37.584239 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6974303616}
I20260709 13:07:37.004627 24104 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:37.585686 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.688862 24129 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:37.689481 24129 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:37.588260 21048 catalog_manager.cc:5697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 2, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:07:37.523512 21264 leader_election.cc:336] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.174s (SENT)
I20260709 13:07:37.602666 21811 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:37.602280 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:37.603298 21046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 363) took 16691 ms (client timeout 15000 ms). Trace:
I20260709 13:07:37.603346 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:37.610626 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:37.625234 21806 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 3.
W20260709 13:07:37.696470 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 184537us
I20260709 13:07:37.626348 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1830) took 1068 ms. Trace:
I20260709 13:07:37.628463 21220 rpcz_store.cc:276] 0709 13:07:33.761081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.761191 (+   110us) service_pool.cc:224] Handling call
0709 13:07:33.772975 (+ 11784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.553667 (+2780692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.515482 (+961815us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b540038d454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:37.515658 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6370301184}
I20260709 13:07:37.532238 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:37.627771 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.066s
W20260709 13:07:37.698547 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.017s	sys 0.066s
W20260709 13:07:37.630649 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123939us
W20260709 13:07:37.635680 21263 connection.cc:256] RPC call timeout handler was delayed by -3.15939792100005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:07:37.549901 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:37.653005 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.699666 21263 connection.cc:256] RPC call timeout handler was delayed by -3.15939792100005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:07:37.644114 24249 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:37.645833 24270 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.706573 24270 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:37.707809 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.708546 21811 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:37.708806 24270 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:37.675066 21222 rpcz_store.cc:269] 0709 13:07:33.754773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.759636 (+  4863us) service_pool.cc:224] Handling call
0709 13:07:37.581229 (+3821593us) spinlock_profiling.cc:243] Waited 2.8 s on lock 0x7b540038e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:37.581368 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6430746496}
W20260709 13:07:37.709355 21807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 770) took 4158 ms (client timeout 2164 ms). Trace:
I20260709 13:07:37.709372 24249 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:07:37.709849 21807 rpcz_store.cc:269] 0709 13:07:33.542455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.605622 (+ 63167us) service_pool.cc:224] Handling call
0709 13:07:37.700809 (+4095187us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b54005c4ed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:37.700910 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6617293184}
I20260709 13:07:37.711694 24249 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:37.686806 24190 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.636979 23779 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.724871 23779 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.670032 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.726009 21300 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:37.697759 21147 rpcz_store.cc:276] 0709 13:07:36.558201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.558491 (+   290us) service_pool.cc:224] Handling call
0709 13:07:36.589081 (+ 30590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.602452 (+ 13371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.602479 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:36.625093 (+ 22614us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.002559 (+377466us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.603517 (+600958us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.626016 (+ 22499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.626103 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.626145 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:37.626155 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.626286 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34907,"prepare.queue_time_us":76413,"raft.queue_time_us":48185,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":2819,"spinlock_wait_cycles":10099584,"thread_start_us":501679,"threads_started":2,"wal-append.queue_time_us":702464}
I20260709 13:07:37.701802 21150 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.691820 21048 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 7, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.637143 24271 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.702576 24036 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.693274 21046 rpcz_store.cc:269] 0709 13:07:20.911889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.912269 (+   380us) service_pool.cc:224] Handling call
0709 13:07:37.602980 (+16690711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.343565 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.548728 (+205163us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.551012 (+  2284us) write_op.cc:435] Acquired schema lock
0709 13:07:30.556786 (+  5774us) tablet.cc:662] Decoding operations
0709 13:07:30.634962 (+ 78176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.635016 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.635042 (+    26us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:07:30.719740 (+ 84698us) tablet.cc:701] Row locks acquired
0709 13:07:30.719772 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:07:30.719977 (+   205us) write_op.cc:270] Start()
0709 13:07:30.720135 (+   158us) write_op.cc:276] Timestamp: P: 1783602450719915 usec, L: 0
0709 13:07:30.720164 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.838500 (+118336us) log.cc:844] Serialized 9163 byte log entry
0709 13:07:31.607732 (+769232us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.766905 (+159173us) write_op.cc:301] APPLY: starting
0709 13:07:31.767033 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.767652 (+   619us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.802127 (+ 34475us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.886016 (+ 83889us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.886541 (+   525us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:07:31.886590 (+    49us) write_op.cc:312] APPLY: finished
0709 13:07:31.949916 (+ 63326us) log.cc:844] Serialized 152 byte log entry
0709 13:07:32.040243 (+ 90327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.158342 (+118099us) write_op.cc:454] Released schema lock
0709 13:07:32.188777 (+ 30435us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:32.267702 (+ 78925us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.267738 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2336725,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":158815,"apply.run_cpu_time_us":8552,"apply.run_wall_time_us":500762,"num_ops":22,"prepare.queue_time_us":613346,"prepare.run_cpu_time_us":23939,"prepare.run_wall_time_us":890409,"raft.queue_time_us":365760,"raft.run_cpu_time_us":14120,"raft.run_wall_time_us":78670,"replication_time_us":887288,"spinlock_wait_cycles":1920,"thread_start_us":914145,"threads_started":4,"wal-append.queue_time_us":372493,"wal-append.run_cpu_time_us":23692,"wal-append.run_wall_time_us":1784529}]]}
I20260709 13:07:37.642902 24258 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:37.717741 21263 connection.cc:256] RPC call timeout handler was delayed by -2.849797921000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:07:37.717788 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 114535us
W20260709 13:07:37.731070 21263 connection.cc:256] RPC call timeout handler was delayed by -2.849797921000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 13:07:37.731426 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:37.731575 21263 connection.cc:256] RPC call timeout handler was delayed by -2.8389085709999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:07:37.719354 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:37.679983 24176 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.713423 21291 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
W20260709 13:07:37.721123 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 197642us
I20260709 13:07:37.692766 24260 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.722951 24270 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:37.738466 21048 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.718487 24233 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.716619 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.742026 21145 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:37.689006 24104 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:37.732055 21263 connection.cc:256] RPC call timeout handler was delayed by -2.7246085709999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:07:37.743198 21263 connection.cc:256] RPC call timeout handler was delayed by -2.7246085709999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:07:37.743654 21263 connection.cc:256] RPC call timeout handler was delayed by -2.7169137370000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:07:37.744016 21263 connection.cc:256] RPC call timeout handler was delayed by -2.673713737000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:07:37.718343 24038 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:37.704187 24262 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:37.744386 21263 connection.cc:256] RPC call timeout handler was delayed by -2.673713737000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:07:37.745185 21263 connection.cc:256] RPC call timeout handler was delayed by -2.6577068520000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2864s for a response
W20260709 13:07:37.745618 21263 connection.cc:256] RPC call timeout handler was delayed by -2.5954137370000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:07:37.749121 21809 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:37.749203 21263 connection.cc:256] RPC call timeout handler was delayed by -2.56571373700001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:07:37.749768 21263 connection.cc:256] RPC call timeout handler was delayed by -2.56571373700001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:07:37.750138 21263 connection.cc:256] RPC call timeout handler was delayed by -2.5612137370000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:07:37.750495 21263 connection.cc:256] RPC call timeout handler was delayed by -2.507406852000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30310000000000004s for a response
W20260709 13:07:37.750839 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3065137370000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 13:07:37.751189 21263 connection.cc:256] RPC call timeout handler was delayed by -2.1963979209999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2596s for a response
W20260709 13:07:37.751538 21263 connection.cc:256] RPC call timeout handler was delayed by -1.934408570999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2596s for a response
W20260709 13:07:37.751880 21263 connection.cc:256] RPC call timeout handler was delayed by -1.8696979210000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2959s for a response
W20260709 13:07:37.752177 21263 connection.cc:256] RPC call timeout handler was delayed by -1.8696979210000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2959s for a response
W20260709 13:07:37.752525 21263 connection.cc:256] RPC call timeout handler was delayed by -1.6860085710000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2872s for a response
W20260709 13:07:37.752861 21263 connection.cc:256] RPC call timeout handler was delayed by -1.6756137370000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2872s for a response
W20260709 13:07:37.753206 21263 connection.cc:256] RPC call timeout handler was delayed by -1.601408570999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29660000000000003s for a response
W20260709 13:07:37.753559 21263 connection.cc:256] RPC call timeout handler was delayed by -1.5424137370000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30200000000000005s for a response
W20260709 13:07:37.753926 21263 connection.cc:256] RPC call timeout handler was delayed by -1.3782085709999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3214s for a response
W20260709 13:07:37.754331 21263 connection.cc:256] RPC call timeout handler was delayed by -1.3782085709999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3214s for a response
W20260709 13:07:37.754694 21263 connection.cc:256] RPC call timeout handler was delayed by -1.2747085710000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33290000000000003s for a response
I20260709 13:07:37.690549 24129 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:37.755003 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.703886 24045 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:37.736740 23804 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.763577 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.760969 21048 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 7, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 7 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.768690 21048 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.773653 21048 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.737785 24260 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.700558 23998 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:37.738505 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:37.747316 21264 leader_election.cc:336] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.653s (SENT)
I20260709 13:07:37.748303 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:37.774683 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.008s
W20260709 13:07:37.762672 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 881a7cf58d404812aa274b116b666741 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) due to error UNKNOWN_ERROR; will retry: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.782554 21147 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:37.783583 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:37.783167 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.000s	sys 0.008s
I20260709 13:07:37.785085 21296 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:07:37.784245 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 812582us
W20260709 13:07:37.779953 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.003s
I20260709 13:07:37.741154 24270 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.788882 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:37.789491 24175 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:07:37.790112 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.790673 21294 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:37.790938 24270 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.791564 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.792577 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.799714 21150 raft_consensus.cc:2410] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:37.740382 21292 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:37.733610 24036 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.758210 24278 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:37.787346 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.011s	sys 0.004s
I20260709 13:07:37.813954 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:37.817658 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:37.808100 21048 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1), VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.820951 21809 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:07:37.821382 21809 pending_rounds.cc:85] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:37.821699 21809 pending_rounds.cc:107] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:37.821933 21809 raft_consensus.cc:2889] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:37.821362 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 66150.1us
I20260709 13:07:37.824069 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:37.824239 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:37.827436 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 80148us
I20260709 13:07:37.828063 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.828783 21149 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:37.828888 21225 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:37.828104 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.829679 21220 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
W20260709 13:07:37.830480 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 92030.2us
I20260709 13:07:37.839097 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:37.841706 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.842929 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.843665 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:37.846197 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.847190 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:37.847662 21296 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:37.847785 21297 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:37.848668 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 151416us
I20260709 13:07:37.850466 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:37.851080 21809 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.822938 23856 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.801997 24262 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:37.850454 21292 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:37.849653 21115 leader_election.cc:336] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.998s (SENT)
I20260709 13:07:37.865043 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.864617 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.872254 21148 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:37.872401 21144 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:37.826149 24270 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.865443 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.854631 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.861125 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.853317 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.864120 21143 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:37.854316 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:37.853996 21294 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.857070 24213 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.875358 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:37.856853 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.891937 21293 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:37.856240 21221 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:37.844043 21048 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 3, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.808326 23998 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.838927 24248 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.882536 21220 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:37.853762 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.884369 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.884375 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.885047 21146 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:37.839239 24291 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.882946 21142 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:37.858275 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.893349 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:37.893963 21809 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:37.887137 21115 leader_election.cc:336] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.105s (SENT)
I20260709 13:07:37.841097 24278 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:37.847499 24246 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:37.868803 24036 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.929178 24036 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.929639 24036 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.898262 24182 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.930927 24182 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.931664 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.932389 21294 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:37.932961 24182 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:37.857776 24283 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:37.933192 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.933576 24291 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:37.934285 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.934898 21294 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:37.902117 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:37.903488 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.908612 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:37.936857 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 49760.7us
I20260709 13:07:37.906203 21296 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:37.906570 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.938650 21144 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
W20260709 13:07:37.909431 21114 connection.cc:256] RPC call timeout handler was delayed by -4.5191463009999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 13:07:37.907353 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:37.939379 21114 connection.cc:256] RPC call timeout handler was delayed by -4.4397290910000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:07:37.939630 21224 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:37.939983 21114 connection.cc:256] RPC call timeout handler was delayed by -3.2439041889999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:07:37.906554 21292 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:37.911336 21295 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:37.940919 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:37.911911 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.907352 21226 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:37.912222 21219 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:37.912674 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:37.913033 21151 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:37.913182 21048 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 5, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 5 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.881894 24270 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:37.915691 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.916546 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.853147 23804 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.869663 24258 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.855420 24271 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:37.907826 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.920616 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:37.856383 24282 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.921208 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.925896 23998 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.873971 24249 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:37.926844 23926 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.905891 24248 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:37.927124 24045 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:37.927781 24013 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:37.911269 21147 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:37.952718 24270 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.942072 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:37.950376 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.949585 21297 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:37.990460 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:37.952164 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:37.991917 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.955416 21048 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:37.992923 21806 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:37.891611 24020 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:37.959187 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.994521 21226 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
W20260709 13:07:37.956789 21115 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.264s (SENT)
W20260709 13:07:37.921123 24000 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.395s	user 0.010s	sys 0.003s
I20260709 13:07:37.969885 21292 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:37.973778 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:37.975926 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.996917 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.958078 24276 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.984642 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:37.947180 24262 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.942072 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:37.904968 24134 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:37.908730 24194 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:07:37.957310 21814 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.015s	sys 0.016s
W20260709 13:07:38.019184 21814 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.017s	sys 0.017s
I20260709 13:07:37.992403 21293 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:37.997462 21226 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
W20260709 13:07:37.997910 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 55903.9us
I20260709 13:07:37.983876 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:37.999040 21809 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.021845 21295 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.996315 21218 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:38.023083 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.011355 24261 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.025122 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.025225 24261 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.002058 24020 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.028337 24020 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.002941 24013 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.002470 21805 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.008047 21292 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:38.005396 21048 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:38.007694 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 65692.6us
I20260709 13:07:37.983525 24248 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.959296 23856 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:37.903563 24213 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.016819 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.017079 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.078155 21220 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:37.958463 23804 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.017668 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.109656 21806 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:37.822034 24033 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:38.006044 24036 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.040956 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:38.013252 24045 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.013695 24175 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.059798 24017 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.036952 24013 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:38.066816 24221 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:38.065830 24176 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.067479 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 964) took 4314 ms. Trace:
I20260709 13:07:38.000948 21224 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:38.070685 21222 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:38.107015 24246 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:38.123508 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 82661.6us
W20260709 13:07:38.122821 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 166074us
I20260709 13:07:38.125239 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:38.178726 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 276702us
I20260709 13:07:38.126760 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:38.191587 21297 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:38.191687 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.138044 21809 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.192274 21225 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.099068 21295 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:38.141881 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.190188 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.193389 21226 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:38.141574 21048 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 4 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.194278 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.195691 21048 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 1 to 3, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:38.147826 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:38.121956 24271 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.179248 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.180034 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:37.974273 24282 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.202389 21220 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.186842 21814 rpcz_store.cc:276] 0709 13:07:33.753246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.757398 (+  4152us) service_pool.cc:224] Handling call
0709 13:07:33.757754 (+   356us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:33.795098 (+ 37344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.795127 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:33.812126 (+ 16999us) log.cc:844] Serialized 78 byte log entry
0709 13:07:36.471825 (+2659699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:36.491744 (+ 19919us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.019565 (+1527821us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.056737 (+ 37172us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.066699 (+  9962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.067189 (+   490us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.067231 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:38.067243 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.067403 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788415,"prepare.queue_time_us":756964,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":109,"raft.queue_time_us":809460,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":14715,"spinlock_wait_cycles":22272,"thread_start_us":3434523,"threads_started":5,"wal-append.queue_time_us":2463202,"wal-append.run_cpu_time_us":2977,"wal-append.run_wall_time_us":1214904}
I20260709 13:07:38.183019 24213 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.183511 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.190846 21293 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:38.198275 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.128249 24175 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.199229 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.209288 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.207687 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.209671 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:38.201036 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:38.206652 21808 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.210532 21224 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:38.124272 21264 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.727s (SENT)
I20260709 13:07:38.207772 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.207851 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.210002 21806 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:38.211369 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.211611 21144 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.212639 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.212008 21143 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.213658 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.204017 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.179759 24013 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.214500 21226 raft_consensus.cc:2410] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:38.215916 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.211414 21048 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.217738 21148 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:38.217785 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.218544 21220 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.204501 24250 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.220353 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.218621 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.224475 21805 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:38.223088 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:38.225744 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.220913 21151 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.048827 24278 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.222889 24250 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:38.235733 23943 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.555s	user 0.003s	sys 0.007s
I20260709 13:07:38.236634 24250 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:38.238682 21033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 482377us
I20260709 13:07:38.243582 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:38.246165 24271 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:38.248638 24176 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.250447 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:38.252187 24288 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.252666 24288 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:38.253055 24288 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.260095 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:38.262073 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:38.213152 24038 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:38.214236 24175 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.204986 23926 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.278573 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1975) took 1929 ms. Trace:
I20260709 13:07:38.208801 24258 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:38.285996 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 161737us
W20260709 13:07:38.290759 21264 leader_election.cc:336] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.755s (SENT)
I20260709 13:07:38.223086 24134 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:38.291208 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.192361 24221 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.223973 24299 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.199712 24000 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:07:38.289502 21298 rpcz_store.cc:276] 0709 13:07:36.349293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.522797 (+173504us) service_pool.cc:224] Handling call
0709 13:07:36.536840 (+ 14043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.577044 (+ 40204us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:37.600450 (+1023406us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.779887 (+179437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.779932 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.780070 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.278270 (+498200us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54003d3bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:38.278335 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.278498 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1053577,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1585,"raft.queue_time_us":93,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6316,"spinlock_wait_cycles":91890944,"thread_start_us":1202183,"threads_started":2,"wal-append.queue_time_us":174688}
I20260709 13:07:38.258270 24045 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.302250 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.264840 24271 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:38.286943 24038 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.301582 21224 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.324572 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.291958 24258 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.289695 23926 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:38.294370 24134 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:38.288034 24304 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:38.341799 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.349097 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:38.351886 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 61161.5us
W20260709 13:07:38.353345 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.320089 24259 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.327329 24038 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.360321 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:38.362113 21298 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:38.362592 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 158658us
I20260709 13:07:38.364423 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:38.355160 24260 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.001s
I20260709 13:07:38.339207 24258 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.367960 21813 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:38.368180 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.365633 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.351359 23926 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.374818 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.378319 21814 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.375085 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.318490 24299 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.379747 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.375555 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.357590 24304 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.376091 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.386312 21809 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:38.386547 24058 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.387420 24307 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.387130 24058 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.386948 24304 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.378625 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.381861 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.392364 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.389775 21810 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:38.392153 21813 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:07:38.379317 24296 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
W20260709 13:07:38.395787 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 93661.8us
I20260709 13:07:38.359006 24246 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.397850 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.406055 21806 raft_consensus.cc:2376] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5. Re-sending same reply.
I20260709 13:07:38.374601 24260 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.394595 24307 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:38.399557 24134 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.370349 24303 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.380144 24301 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.409315 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.374361 24249 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.423381 21145 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:38.423604 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:38.427094 21226 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:38.402544 24270 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.416502 24309 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:38.417270 23804 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.418004 24265 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:38.418818 24260 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:38.420022 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.442914 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.449496 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:38.450510 21224 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:38.365182 24259 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.453346 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.453824 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.453995 21810 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:38.456079 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.456779 21809 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.456609 21226 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.458587 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.461445 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.462407 21807 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.449867 21813 raft_consensus.cc:2376] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4. Re-sending same reply.
I20260709 13:07:38.466703 21808 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:38.468742 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 75091.8us
W20260709 13:07:38.452678 24298 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:07:38.469453 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.471908 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.473023 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.470820 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.447484 24265 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:38.478242 24129 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.481671 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1445) took 1075 ms. Trace:
I20260709 13:07:38.481755 24259 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.482102 21150 rpcz_store.cc:276] 0709 13:07:37.405877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.521211 (+115334us) service_pool.cc:224] Handling call
0709 13:07:38.481455 (+960244us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001f7f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:38.481594 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412630912}
W20260709 13:07:38.483745 24302 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:38.486904 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:38.487686 24305 log.cc:927] Time spent T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:38.488179 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.488871 21813 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.489668 21806 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.475826 21810 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:38.470619 24260 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:38.535308 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 140120us
I20260709 13:07:38.476627 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.539875 21226 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:38.477320 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.443869 24248 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.457460 24304 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.478818 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.439798 24045 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:38.460245 24282 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.477895 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.549685 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.556299 21814 raft_consensus.cc:2410] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:38.541198 21812 raft_consensus.cc:2376] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7. Re-sending same reply.
I20260709 13:07:38.480047 24301 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:38.548331 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 139072us
W20260709 13:07:38.549309 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 68953.7us
I20260709 13:07:38.549953 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.563882 21810 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:38.550302 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:38.539595 24260 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.562924 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.568795 24260 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.552708 21808 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:38.553174 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.572587 21807 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:38.546813 21809 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:38.551726 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.564980 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.573693 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.574326 21299 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:38.444487 24271 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.578310 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.548506 24291 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.546020 24303 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:38.551210 23943 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.497349 24249 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:38.561666 24301 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.596175 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.596845 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.602276 21150 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.599188 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.594288 21226 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:38.599138 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 46970.7us
I20260709 13:07:38.603979 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.601218 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.604728 21148 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.602571 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.605393 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:38.607961 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:38.561136 24307 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:38.615465 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.623785 24303 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.575472 24265 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.624212 24303 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:38.624590 24265 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.624606 24303 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.627965 24311 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:07:38.629050 24315 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:38.633751 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.634585 24213 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:38.635321 24291 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.638334 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:38.639405 21148 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:38.640509 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.641180 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.623312 21226 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:38.643082 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.618405 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.618706 24322 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:38.614418 24309 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:07:38.593327 24058 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.579517 24313 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:38.607743 24301 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.655920 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:38.659138 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.591912 24175 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.651926 24190 raft_consensus.cc:2764] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:38.608186 23943 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.649020 24270 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:38.733531 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77696.7us
I20260709 13:07:38.749603 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:38.622352 24314 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.664889 24319 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.734171 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.657369 23723 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:38.739596 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 103008us
W20260709 13:07:38.753647 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 151157us
I20260709 13:07:38.753760 21226 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
W20260709 13:07:38.756559 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 312746us
I20260709 13:07:38.757580 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.736029 24315 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.756765 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:38.732867 24058 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:38.761548 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.762583 21226 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:38.764647 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:38.765739 21293 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:38.765990 21292 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.767733 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.737739 24299 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.766067 21296 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:38.774565 21298 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:38.770306 21264 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.770926 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.777530 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:38.778111 21300 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.781574 23943 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:38.782336 23943 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.782824 23943 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.760377 24190 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.787022 21300 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:38.787214 24058 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.767474 24246 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.788328 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.789423 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.790340 24299 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.759181 23723 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.756942 24319 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:38.798846 21221 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:38.801832 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.775816 24270 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.792851 23943 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.786864 24260 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:38.825026 24248 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:38.778538 24314 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:38.826644 24262 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:38.828329 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 54381.1us
I20260709 13:07:38.801419 23723 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:38.868793 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.812913 24316 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:38.807443 24268 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:38.937104 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:38.938238 21224 raft_consensus.cc:2410] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:38.939082 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85498.2us
I20260709 13:07:38.805363 24319 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:38.947908 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 177728us
I20260709 13:07:38.806787 24045 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:07:38.827193 24329 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
W20260709 13:07:38.958652 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 169037us
I20260709 13:07:38.975039 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:38.976720 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:38.977799 21224 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:38.979519 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:38.936726 24268 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:38.982924 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:38.947690 24129 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.983805 24307 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.980415 24299 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:38.987053 24330 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:38.984097 24190 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.835727 24303 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.997720 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:39.001634 21298 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 3.
I20260709 13:07:39.005450 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1992) took 1075 ms. Trace:
W20260709 13:07:39.009620 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.008105 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:39.025718 21292 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:39.022748 21291 rpcz_store.cc:276] 0709 13:07:37.930294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.934626 (+  4332us) service_pool.cc:224] Handling call
0709 13:07:37.934922 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.935114 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.935409 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.180431 (+245022us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.004986 (+824555us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18002df4c0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287
0709 13:07:39.005088 (+   102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.005142 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.005190 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.005278 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.005398 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39264,"prepare.queue_time_us":10048,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":5500,"raft.queue_time_us":288812,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":36021,"spinlock_wait_cycles":36391936,"thread_start_us":399800,"threads_started":2,"wal-append.queue_time_us":348632}
I20260709 13:07:39.035652 21294 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.041378 24058 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.041867 24058 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.045995 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 1990) took 1165 ms. Trace:
I20260709 13:07:39.046365 21299 rpcz_store.cc:276] 0709 13:07:37.881074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.891658 (+ 10584us) service_pool.cc:224] Handling call
0709 13:07:39.045819 (+1154161us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540001d454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.045943 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467467136}
I20260709 13:07:38.997262 24329 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:39.006085 24315 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.052592 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1435) took 1235 ms. Trace:
I20260709 13:07:39.055833 21223 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:07:39.055478 21222 rpcz_store.cc:276] 0709 13:07:37.817319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.817436 (+   117us) service_pool.cc:224] Handling call
0709 13:07:39.052365 (+1234929us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000ed3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.052522 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417832704}
W20260709 13:07:39.045596 24013 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.000s
I20260709 13:07:38.996285 24129 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:38.807721 24282 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
W20260709 13:07:39.061640 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 78822.1us
I20260709 13:07:39.055706 24175 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.056161 21298 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:39.074965 24261 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.079474 24303 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.068280 24274 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.080787 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.099393 21810 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.068831 24134 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.073892 24299 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.042919 24058 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.082665 24260 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.091691 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:39.070626 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 82403.6us
I20260709 13:07:39.074579 24330 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.066175 23943 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.112574 24330 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.113883 23943 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.081068 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.060757 24268 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.115901 24310 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.116000 24129 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.116360 24310 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.116593 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:39.117038 24058 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.117815 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.082049 24333 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:07:39.118638 24038 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.001s
I20260709 13:07:39.079528 24331 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:39.119817 24331 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.122247 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:39.102164 24274 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.116772 24310 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.119333 21220 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:39.106514 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.067950 24328 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:07:39.138017 21810 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:39.070540 24013 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.099619 24340 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.143091 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:39.145516 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 53936.8us
W20260709 13:07:39.121812 23926 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.002s
I20260709 13:07:39.157240 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.161787 21222 raft_consensus.cc:2376] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8. Re-sending same reply.
I20260709 13:07:39.116068 24268 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.140527 24304 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.185346 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:39.160013 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.160902 24260 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.155704 24262 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:39.138701 24274 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.119051 24038 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.177728 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.178651 21291 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.179147 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.179318 23926 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.180058 24013 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.182834 24270 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.159679 24340 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.191817 21299 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.193818 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:39.142549 24307 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:39.175120 24288 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
I20260709 13:07:39.159955 23943 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.200748 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.201288 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:39.161032 24303 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.161155 24333 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.190619 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.258785 21222 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 3.
I20260709 13:07:39.204674 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:39.212234 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 101654us
W20260709 13:07:39.215725 24311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.031s
I20260709 13:07:39.219743 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.183305 24330 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.187904 24282 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:39.254907 21225 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.227449 21217 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.197023 24260 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:39.224174 24213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.010s
I20260709 13:07:39.302163 21222 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:39.205298 24248 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:39.207646 24331 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:39.259454 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 58235.3us
W20260709 13:07:39.306596 24213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.015s	sys 0.017s
I20260709 13:07:39.311719 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.311659 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.307696 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.256909 24303 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.317960 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:39.222132 24265 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.002s
W20260709 13:07:39.302567 24311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.039s
I20260709 13:07:39.280165 24333 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:39.310317 24343 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:39.313349 24213 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:39.322080 24332 log.cc:927] Time spent T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:39.322186 24327 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.322472 24334 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:07:39.323472 24013 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:39.324115 24038 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:39.135813 24326 consensus_queue.cc:1175] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e66e7254b764832b244bb5b07b4a208" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:39.358548 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.327698 24194 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.328337 23723 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.329233 24324 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.303038 24304 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:39.332340 24301 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:07:39.332859 23926 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.350508 24331 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.345206 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.345243 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.348423 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.347870 24333 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.320866 24303 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.258090 24288 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
I20260709 13:07:39.324664 24340 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.348193 24248 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.395277 24248 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.359867 21149 raft_consensus.cc:2410] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:39.222442 24307 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:39.364380 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46392 (request call id 84) took 35906 ms (client timeout 29999 ms). Trace:
I20260709 13:07:39.366938 21148 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:39.312738 24282 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:39.350993 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 129945us
I20260709 13:07:39.360976 24194 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:39.368827 24260 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.369696 24304 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:39.370766 24213 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.364110 24324 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.354501 24351 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.359570 24258 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.977s	user 0.011s	sys 0.000s
W20260709 13:07:39.371826 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.373798 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.435427 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1448) took 1670 ms. Trace:
I20260709 13:07:39.435853 21145 rpcz_store.cc:276] 0709 13:07:37.763211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.763360 (+   149us) service_pool.cc:224] Handling call
0709 13:07:39.428773 (+1665413us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54000857d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.433475 (+  4702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515660160}
W20260709 13:07:39.436187 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 62446.3us
I20260709 13:07:39.374722 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.375417 24354 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:39.439977 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 65326.9us
I20260709 13:07:39.440841 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.376876 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.377854 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.378243 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 870) took 1326 ms. Trace:
I20260709 13:07:39.441435 21151 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.378461 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 858) took 1527 ms. Trace:
I20260709 13:07:39.441649 21147 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:39.441473 21805 rpcz_store.cc:276] 0709 13:07:38.051808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.127849 (+ 76041us) service_pool.cc:224] Handling call
0709 13:07:39.378034 (+1250185us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54005c5b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.378179 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50562432}
I20260709 13:07:39.441972 21811 rpcz_store.cc:276] 0709 13:07:37.850696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.850821 (+   125us) service_pool.cc:224] Handling call
0709 13:07:39.378317 (+1527496us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400660154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.378412 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121050368}
W20260709 13:07:39.386523 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.335016 24319 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.444621 24258 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.445102 24319 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.280576 23943 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.446640 24258 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.447139 23943 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.447284 24352 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.448273 24354 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.363230 24104 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.448679 24354 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:39.448782 24058 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.448937 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.448808 24104 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.449594 21222 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.365744 24331 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:39.450439 23723 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.450613 24331 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:39.401607 21298 rpcz_store.cc:269] 0709 13:07:03.468952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.486369 (+ 17417us) service_pool.cc:224] Handling call
0709 13:07:03.629726 (+143357us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b2c0006e2e8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c682a0a 00007f2b6c682693 00007f2b6c682631 00007f2b6ddb5902 00007f2b6ddb56dd 00007f2b6dd80f3f 00007f2b6dd806b3 00007f2b6dd789fa 00007f2b72d404c9 00007f2b6c2bcc54
0709 13:07:03.695061 (+ 65335us) log.cc:844] Serialized 494 byte log entry
0709 13:07:39.355509 (+35660448us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":206,"mutex_wait_us":10404,"raft.queue_time_us":10879,"raft.run_cpu_time_us":1523,"raft.run_wall_time_us":1523,"spinlock_wait_cycles":67068160,"thread_start_us":96026,"threads_started":1,"wal-append.queue_time_us":197007,"wal-append.run_cpu_time_us":2393,"wal-append.run_wall_time_us":1087502}
I20260709 13:07:39.451068 24351 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.451525 24324 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.404816 24349 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.402933 24307 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.453244 24351 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.455848 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.456565 21219 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.356791 24327 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.443028 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.449118 24354 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.450256 24104 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.457780 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.458923 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.387487 24301 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.389235 23779 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.460314 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:39.463728 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.472236 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:39.475214 21145 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:39.476143 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.470095 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.471612 21299 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:39.443015 24246 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.003s
I20260709 13:07:39.464176 21222 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:39.477692 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:39.449265 24058 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.458376 24340 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.482167 21148 raft_consensus.cc:2410] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:39.485670 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.486876 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.466009 24352 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.498811 21296 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:39.498564 21114 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.484254 24319 raft_consensus.cc:2764] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:39.513229 21147 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.483651 24246 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.512003 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:39.521246 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 137365us
I20260709 13:07:39.498639 24013 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:39.522886 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.523890 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.524453 21809 raft_consensus.cc:2376] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4. Re-sending same reply.
I20260709 13:07:39.506757 24104 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.526621 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.526710 21148 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.527240 21811 raft_consensus.cc:2376] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8. Re-sending same reply.
I20260709 13:07:39.525683 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:39.529248 24353 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:39.521080 24304 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.530607 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.531298 21812 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:39.532034 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.532938 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.533416 21812 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:39.534401 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.535141 21812 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:39.535969 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.536648 21812 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:39.537392 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.537638 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.538128 21809 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:39.538287 21812 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.538647 21809 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:39.539654 24351 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:39.541880 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.543323 24352 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.547333 24058 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.548864 24058 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.552114 24282 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.552259 24288 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.491179 24194 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.554044 24194 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.555287 24301 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.560089 24303 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.560529 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:39.561434 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:39.562822 24303 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.563465 24013 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:39.567800 24347 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:07:39.567705 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.591609 21811 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:39.571223 24358 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:39.573208 21300 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:39.579789 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.582041 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 454) took 1214 ms. Trace:
I20260709 13:07:39.584458 24329 raft_consensus.cc:1064] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: attempting to promote NON_VOTER 5e66e7254b764832b244bb5b07b4a208 to VOTER
I20260709 13:07:39.593834 21217 rpcz_store.cc:276] 0709 13:07:38.367595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.485879 (+118284us) service_pool.cc:224] Handling call
0709 13:07:38.486161 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.301046 (+814885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.581758 (+280712us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540039b7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:39.581968 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704424192}
I20260709 13:07:39.558246 24307 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:07:39.590095 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 110146us
I20260709 13:07:39.513121 24339 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.480355 23779 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.615473 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.560155 21147 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:39.616046 21222 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.613584 24307 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.578619 24274 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.617995 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.630218 21151 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:39.631179 21217 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.628703 21294 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:39.640864 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.643847 21222 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:39.654574 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:39.663786 24355 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:07:39.665741 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 153958us
I20260709 13:07:39.667438 21219 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.618794 24339 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:39.674005 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 131169us
I20260709 13:07:39.675575 21142 raft_consensus.cc:2410] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:39.673930 21114 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:39.675076 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:39.679116 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.681026 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.685302 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.688131 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.690718 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.693048 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.697110 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.698012 21217 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.601454 24310 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:39.729574 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48620.1us
I20260709 13:07:39.732438 21145 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.733551 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.734428 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.742110 21813 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:39.610415 24331 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.760247 21219 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.758829 21218 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.762806 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.764245 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.672073 24339 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.762151 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.765090 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.771991 21217 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.773350 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.736420 24340 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:39.779954 21222 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:39.732234 24307 raft_consensus.cc:2764] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:39.742920 24303 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.729601 24327 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.766552 24246 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.787089 21146 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:39.779124 24315 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.802309 21143 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.761618 24301 raft_consensus.cc:2764] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:39.785240 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.671126 24356 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.341s
I20260709 13:07:39.770720 24213 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.813791 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.814319 24213 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:39.815310 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.815245 24213 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.816512 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.817243 21147 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:39.818152 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.743139 24013 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.785265 24354 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.776223 24363 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:39.820282 24363 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.820559 24354 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.781733 24299 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.798918 24331 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.821761 24274 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:39.795228 23779 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.803326 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.822697 24356 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.822947 21143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:39.823081 24221 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.823565 21143 raft_consensus.cc:606] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.823935 21143 raft_consensus.cc:614] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.807876 24340 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.811512 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.832289 21814 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:39.812255 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.832976 21812 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:39.812706 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.834453 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.834892 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.812821 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.820641 24363 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:39.821898 21148 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.799854 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:39.824330 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.841017 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.848235 21150 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:39.785127 24303 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:39.825680 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:39.877429 21294 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.800684 24310 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.821797 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.849745 21150 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.807085 24315 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:39.868140 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.800624 24329 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.824972 21147 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.881657 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 173007us
W20260709 13:07:39.882961 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 61221us
I20260709 13:07:39.887497 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.888973 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.891582 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.829696 24356 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:39.896005 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.898061 24371 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.894990 24327 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.899461 24221 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.900559 24356 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.901232 24246 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.903549 24340 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.851468 24333 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:39.909924 24333 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:39.909649 24339 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.914799 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.879427 24303 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.923070 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.886627 24315 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.931217 21294 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:39.937763 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.938620 21146 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:39.938982 21147 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:39.940543 21147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d142716765ff4750912c13d99d61a1df"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:07:39.940734 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2390) took 2052 ms. Trace:
I20260709 13:07:39.941254 21147 raft_consensus.cc:606] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.941175 21223 rpcz_store.cc:276] 0709 13:07:37.888809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.888928 (+   119us) service_pool.cc:224] Handling call
0709 13:07:39.055573 (+1166645us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.056232 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.940535 (+884303us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000ed3d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:39.940673 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633678592}
I20260709 13:07:39.941951 21147 raft_consensus.cc:614] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.942601 21150 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.943305 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:39.943889 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:39.947146 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:39.890944 24370 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.948333 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:39.948235 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52285.4us
I20260709 13:07:39.946208 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.898649 24363 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:39.957305 21146 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:39.957777 21222 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:39.960016 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.961325 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:39.961979 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.961759 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:39.895397 23779 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:07:39.964865 21294 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.964502 21222 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.930539 24262 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.966379 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.952244 24371 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.959736 24288 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:39.966210 24310 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.977751 21809 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:39.983750 24339 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:39.972510 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.985018 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.986742 21814 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.977281 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:39.987046 21223 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:39.990038 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:39.991237 21222 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:39.966809 21143 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:39.968961 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:39.993700 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.978904 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:39.973582 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.979678 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.980018 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:39.995612 21217 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.995782 21218 raft_consensus.cc:2393] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.995976 21219 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:39.994833 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.963912 24213 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:39.971040 24260 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.975317 24370 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:39.994972 21812 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:39.983570 24310 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:39.965798 24327 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:40.007929 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:39.983646 23779 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:39.964996 24258 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:07:39.957018 24291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.319s	user 0.003s	sys 0.009s
I20260709 13:07:40.018471 21812 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:40.014113 24271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.012s	sys 0.010s
I20260709 13:07:40.043735 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:39.979135 24363 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.019668 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:39.999449 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:40.045444 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46128.1us
I20260709 13:07:40.045539 24301 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.002135 24288 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:40.047602 21143 raft_consensus.cc:2410] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:40.003813 24333 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.050421 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.016100 24354 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.014487 24104 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:40.042646 24291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.003s	sys 0.010s
W20260709 13:07:40.043193 24271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.012s	sys 0.011s
I20260709 13:07:40.015976 24379 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:40.070452 21115 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.055502 24260 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.074376 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.026451 24339 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.066967 24262 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.086607 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.070779 24104 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:40.042866 23779 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.084873 24330 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.087477 24260 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:40.099380 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57726.2us
I20260709 13:07:40.091288 24058 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:40.093598 24352 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:40.110834 21294 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:40.107375 24299 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:40.114807 24325 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.115293 24325 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:40.116647 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.114545 24299 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.118727 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:40.119831 24380 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.121954 21147 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:40.122404 21147 pending_rounds.cc:85] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 5
I20260709 13:07:40.122689 21147 pending_rounds.cc:107] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:40.122972 21147 raft_consensus.cc:2889] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.107333 24260 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.125499 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.129261 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:40.110141 24301 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.118742 24352 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:40.135185 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2395) took 2245 ms. Trace:
W20260709 13:07:40.147622 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.136686 21778 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.129s	user 0.017s	sys 0.031s
I20260709 13:07:40.133363 24194 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:07:40.137503 24378 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:40.141867 24303 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:40.144088 21033 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 881a7cf58d404812aa274b116b666741 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:07:40.124342 24288 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:40.142308 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.147543 21225 rpcz_store.cc:276] 0709 13:07:37.890249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.209071 (+318822us) service_pool.cc:224] Handling call
0709 13:07:40.135010 (+1925939us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400127ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:40.135131 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338469120}
I20260709 13:07:40.159797 21810 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.096699 24310 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.160717 21810 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:40.160351 21778 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.155s	user 0.018s	sys 0.031s
I20260709 13:07:40.135145 24213 consensus_queue.cc:1243] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:40.165755 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 2.193e+06us
I20260709 13:07:40.123086 24262 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:40.132916 24058 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:40.174285 24058 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:40.175284 24058 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.129778 24391 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:40.170449 21778 connection.cc:256] RPC call timeout handler was delayed by -1.6749484560000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2977s for a response
W20260709 13:07:40.177735 21778 connection.cc:256] RPC call timeout handler was delayed by -1.0476484560000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3674s for a response
I20260709 13:07:40.156426 24352 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:40.159878 24375 log.cc:927] Time spent T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:40.165042 21810 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.127557 24291 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:07:40.173126 24337 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.105s	user 0.004s	sys 0.000s
I20260709 13:07:40.179003 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.181699 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.182518 21810 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.184928 21805 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:40.158427 24129 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.186091 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.158215 24385 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:40.187505 21809 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:40.131986 24330 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:40.188087 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.190147 21807 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:40.131989 24249 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:40.191444 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.190766 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:40.192591 21805 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:40.194733 24367 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.430s	user 0.002s	sys 0.000s
I20260709 13:07:40.145205 24301 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.202546 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2397) took 2311 ms. Trace:
I20260709 13:07:40.202913 21220 rpcz_store.cc:276] 0709 13:07:37.890844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.219715 (+328871us) service_pool.cc:224] Handling call
0709 13:07:38.219996 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.137916 (+917920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.202329 (+1064413us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400116054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:40.202492 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046656256}
I20260709 13:07:40.136951 24104 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.204787 24303 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:40.205722 24384 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:40.212149 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:40.227926 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.229416 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:40.232787 21810 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:40.233233 21810 pending_rounds.cc:85] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
I20260709 13:07:40.233502 21810 pending_rounds.cc:107] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:40.233806 21810 raft_consensus.cc:2889] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.236233 24288 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.182387 24392 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.241976 21221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2396) took 2351 ms (client timeout 1545 ms). Trace:
W20260709 13:07:40.245755 21221 rpcz_store.cc:269] 0709 13:07:37.890538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.893104 (+  2566us) service_pool.cc:224] Handling call
0709 13:07:40.241754 (+2348650us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540038b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:40.241887 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009805696}
I20260709 13:07:40.246205 24258 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:40.249097 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.250041 21810 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:40.252164 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 119869us
I20260709 13:07:40.252972 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:40.254273 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:40.254988 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:40.255602 21293 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.200389 24299 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:40.255404 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:40.254165 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:40.276031 21296 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:40.273983 24213 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:40.276806 24213 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:40.256796 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:40.277885 21299 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:40.246747 24288 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.246728 24258 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.280360 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.279745 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:40.283512 21299 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:40.284919 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:40.286213 21291 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.289474 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:40.290169 21297 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.302438 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:40.296650 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 105276us
I20260709 13:07:40.305416 21116 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:40.207434 24385 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.306794 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:40.237708 24129 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.311962 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:40.312585 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.345523 21807 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:40.313055 24340 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:40.317575 24410 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:40.325762 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1474) took 1718 ms. Trace:
W20260709 13:07:40.307883 24402 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:07:40.336268 24382 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:07:40.277709 24213 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.258283 24017 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:40.340461 24406 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:40.346625 21299 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:40.350514 21293 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:07:40.353845 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.335485 24386 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:07:40.376641 21297 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:40.373633 21144 rpcz_store.cc:276] 0709 13:07:38.607245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.607375 (+   130us) service_pool.cc:224] Handling call
0709 13:07:38.614632 (+  7257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.734590 (+119958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.734618 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.753006 (+ 18388us) log.cc:844] Serialized 52 byte log entry
0709 13:07:39.022720 (+269714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.095125 (+ 72405us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.106846 (+ 11721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.106950 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.172546 (+1065596us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:40.315574 (+143028us) raft_consensus.cc:1685] finished
0709 13:07:40.325467 (+  9893us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.325680 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10728,"prepare.queue_time_us":119869,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":199975,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":45947,"spinlock_wait_cycles":14245120,"thread_start_us":385376,"threads_started":3,"wal-append.queue_time_us":299968}
I20260709 13:07:40.250993 24392 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:40.389521 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 150088us
I20260709 13:07:40.391597 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.413543 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:40.428829 24104 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:40.433655 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.434195 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.434378 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 804) took 1442 ms. Trace:
I20260709 13:07:40.434669 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:40.434801 21806 rpcz_store.cc:276] 0709 13:07:38.992384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.992542 (+   158us) service_pool.cc:224] Handling call
0709 13:07:39.378163 (+385621us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:07:39.378590 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.378630 (+    40us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:07:39.379443 (+   813us) log.cc:844] Serialized 104 byte log entry
0709 13:07:39.434863 (+ 55420us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:39.434920 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.434994 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.564388 (+129394us) raft_consensus.cc:1685] finished
0709 13:07:39.564408 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.434085 (+869677us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54005c5b50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:40.434312 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69229,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":885851008,"thread_start_us":55073,"threads_started":1,"wal-append.queue_time_us":115450}
I20260709 13:07:40.385639 24340 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:40.385197 23779 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.418872 24213 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.412961 24406 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:40.414172 24301 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.371749 24315 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.480058 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:40.489045 24258 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.495182 24406 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.496163 24315 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:40.496883 21292 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.465828 23779 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:40.500825 23779 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.503197 23779 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.516803 24385 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:40.549239 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.481146 24399 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.417500 24260 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.609534 24315 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:40.610091 24315 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.613636 21144 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:40.607813 24363 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:07:40.639535 21810 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:40.640537 21805 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
W20260709 13:07:40.634601 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 221144us
I20260709 13:07:40.644085 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:40.647076 24385 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.647964 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:40.632521 24399 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:40.654278 24260 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.651077 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:40.646054 24301 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:40.653105 24258 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.663997 24134 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.695662 24134 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.665763 24288 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.657889 23779 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.675139 24392 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:40.698526 24129 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.666054 24399 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:40.700444 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 393705us
I20260709 13:07:40.703118 24399 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.699280 24134 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:40.634585 24340 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.705190 24260 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:40.708775 24278 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:40.679802 24333 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:07:40.665294 24363 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:07:40.713088 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.713083 21297 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:40.719092 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.713480 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 65603.5us
W20260709 13:07:40.728085 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.709396 24352 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.003s
W20260709 13:07:40.736366 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 314693us
I20260709 13:07:40.713249 24278 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:40.712119 24315 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:40.732486 24333 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.678476 24301 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.733795 24260 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:40.759836 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:40.741425 24329 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.768730 24329 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.767184 21221 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:40.773367 21221 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:40.775030 24329 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:40.767920 24260 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:40.740958 24352 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.778427 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:40.781118 21221 raft_consensus.cc:2410] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:40.782627 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:40.787321 21144 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:40.788686 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.805410 24315 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.808434 24315 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:40.785327 24405 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
W20260709 13:07:40.967862 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.985910 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:40.850553 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.034s
I20260709 13:07:40.812341 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:40.987629 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.019s	sys 0.040s
I20260709 13:07:40.832867 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:40.987993 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:40.988008 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 742466us
I20260709 13:07:40.989687 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:40.824911 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:40.994398 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:40.995777 21805 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:40.837663 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:40.996987 21805 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:40.997283 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 159717us
I20260709 13:07:40.811183 24260 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:40.998229 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:40.995123 21811 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:41.000622 21805 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:41.004091 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.004709 21297 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.008627 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:41.007758 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:40.902993 23779 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:41.012815 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.881825 24366 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.904275 24413 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.015697 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.832721 24261 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:40.999229 24288 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.017004 21814 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:41.017385 21143 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:41.016095 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f81bf1abd0b34f518d1f2b79cc4dba77 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:41.017961 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.001633 24422 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:41.023682 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:41.022424 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.006958 24058 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:41.023048 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.027473 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.010361 24314 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.031474 24409 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.031867 24409 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:41.018690 24258 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.026446 24422 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.035995 24422 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:41.021129 24418 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:41.026141 24333 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:41.028503 24315 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.069445 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:41.027194 24058 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:41.027697 24261 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:41.074234 24391 consensus_meta.cc:287] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.888s	user 0.004s	sys 0.008s
I20260709 13:07:41.034767 24399 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:41.032702 24409 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.074972 24418 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.090855 24391 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.028928 24288 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.099452 24420 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.068197 24301 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:41.102929 24432 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:41.105185 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.121474 24221 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.109004 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1837) took 1379 ms. Trace:
I20260709 13:07:41.110966 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2001) took 2107 ms. Trace:
I20260709 13:07:41.023826 24366 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.112287 24326 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:41.111919 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:41.103029 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 607) took 1577 ms. Trace:
I20260709 13:07:41.028752 24413 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.114123 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 596) took 1759 ms. Trace:
I20260709 13:07:41.156203 21145 rpcz_store.cc:276] 0709 13:07:39.354934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.486868 (+131934us) service_pool.cc:224] Handling call
0709 13:07:39.487207 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.744282 (+257075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.113879 (+1369597us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000857d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.114050 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563312896}
I20260709 13:07:41.157475 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:41.157846 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123461us
I20260709 13:07:41.158461 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.114858 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 590) took 1800 ms. Trace:
I20260709 13:07:41.119508 24352 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.125739 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.087996 24058 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:41.129904 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.138197 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:41.138825 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:41.140159 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.164968 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:41.108146 24428 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.142632 21151 rpcz_store.cc:276] 0709 13:07:39.729277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.730401 (+  1124us) service_pool.cc:224] Handling call
0709 13:07:41.108809 (+1378408us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400065254. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:41.108943 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664981248}
I20260709 13:07:41.143180 21298 rpcz_store.cc:276] 0709 13:07:39.003367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.003488 (+   121us) service_pool.cc:224] Handling call
0709 13:07:39.003818 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.049102 (+ 45284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:39.183781 (+134679us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.486692 (+302911us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.489939 (+  3247us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.494639 (+  4700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.494687 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.494734 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.109771 (+1615037us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18003d9b40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419
0709 13:07:41.110759 (+   988us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54003af554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.110796 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.110911 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5654,"prepare.queue_time_us":124338,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":34804,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":11150,"spinlock_wait_cycles":135048320,"thread_start_us":168410,"threads_started":2,"wal-append.queue_time_us":208626,"wal-append.run_cpu_time_us":2859,"wal-append.run_wall_time_us":1269034}
I20260709 13:07:41.142443 24258 raft_consensus.cc:2764] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:41.154791 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.159114 21142 rpcz_store.cc:276] 0709 13:07:39.314313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.314591 (+   278us) service_pool.cc:224] Handling call
0709 13:07:41.114682 (+1800091us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540040ef54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:41.114807 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710993280}
W20260709 13:07:41.161244 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.132552 24314 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.166633 21297 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:41.101639 24399 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.154116 21148 rpcz_store.cc:276] 0709 13:07:39.589126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.589256 (+   130us) service_pool.cc:224] Handling call
0709 13:07:39.665958 (+ 76702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.845279 (+179321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.102797 (+1257518us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001ddb54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.102969 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358223744}
I20260709 13:07:41.152275 24221 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:41.168823 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.167670 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.157660 24304 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:41.186452 21145 raft_consensus.cc:2410] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:41.187458 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.188525 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:41.189417 21142 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:41.190466 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.188083 21145 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:41.193621 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.193704 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.196141 21148 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:41.197204 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:41.198760 24434 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:41.199779 24261 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.200346 24261 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:41.200773 24261 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:41.200683 24422 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.201792 24261 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.202334 21294 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:41.204941 24325 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.206079 24325 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.206182 24258 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.175880 24129 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:41.210132 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.212325 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.220695 21148 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:41.189424 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 119266us
I20260709 13:07:41.217790 24424 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.206874 24410 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:41.232018 24221 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.233898 24356 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.234467 24413 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.220522 24349 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:41.235888 24424 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.248126 24399 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.249426 24366 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.251049 24288 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.184594 24314 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.238547 24327 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.228339 24274 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.178279 24428 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:41.256804 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 87909.2us
I20260709 13:07:41.256945 24424 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.255947 24349 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.264680 24422 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:41.261212 24327 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:41.270175 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.263504 24221 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:41.281179 24398 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.034s	user 0.000s	sys 0.005s
I20260709 13:07:41.280766 24327 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.282650 24327 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.267864 24424 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.253523 24410 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.287787 24058 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.289517 21146 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.291625 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 611) took 1160 ms. Trace:
I20260709 13:07:41.292003 21147 rpcz_store.cc:276] 0709 13:07:40.130784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.130943 (+   159us) service_pool.cc:224] Handling call
0709 13:07:40.131269 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.132618 (+  1349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.132652 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.133096 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.167544 (+ 34448us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.167615 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.167708 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.280669 (+1112961us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:41.284123 (+  3454us) raft_consensus.cc:1685] finished
0709 13:07:41.284142 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.291564 (+  7422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3538,"raft.queue_time_us":24894,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":21717,"spinlock_wait_cycles":10326400,"thread_start_us":30777,"threads_started":1,"wal-append.queue_time_us":52189}
I20260709 13:07:41.265317 24274 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.305692 21147 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.308820 24428 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.290961 24258 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:41.313936 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 807) took 2294 ms. Trace:
I20260709 13:07:41.314364 21813 rpcz_store.cc:276] 0709 13:07:39.020037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.020530 (+   493us) service_pool.cc:224] Handling call
0709 13:07:39.020893 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.761886 (+740993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.313709 (+1551823us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54005136d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.313882 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657806208}
I20260709 13:07:41.321056 21808 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.321429 21808 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:41.322191 21808 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.319120 21150 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:41.323114 21808 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:41.325724 21190 leader_election.cc:336] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.555s (SENT)
I20260709 13:07:41.334605 23779 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:41.337340 24288 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:41.332381 24311 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.338485 24311 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:41.339644 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.341797 24311 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.325680 24314 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.344267 24311 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.333693 24258 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:41.347103 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.347402 24129 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.347960 24129 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:41.348800 24129 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.349335 24278 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.349958 24129 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.350476 24278 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.347460 24354 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:41.327209 24058 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.364209 21151 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:41.355190 24354 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.376215 24274 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.381026 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.393142 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:41.394380 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.395292 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.398654 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.394392 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.401309 21218 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:41.390542 24260 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:07:41.405035 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.460299 21217 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:41.447067 21220 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:07:41.460490 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 66187.1us
W20260709 13:07:41.475698 21114 leader_election.cc:336] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.545s (SENT)
I20260709 13:07:41.476115 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.478261 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.478452 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:41.446424 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.461045 24390 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:41.482738 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 79461.2us
I20260709 13:07:41.391396 24282 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.421064 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:41.487166 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.487628 21223 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.405968 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.489559 21808 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:41.491935 21808 pending_rounds.cc:85] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:41.492234 21808 pending_rounds.cc:107] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:41.492308 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.492574 21808 raft_consensus.cc:2889] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:41.492761 21190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.108s (SENT) [suppressed 71 similar messages]
I20260709 13:07:41.492937 21805 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:41.396656 24331 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:41.493551 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 806) took 2485 ms. Trace:
I20260709 13:07:41.496163 21808 rpcz_store.cc:276] 0709 13:07:39.008566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.008684 (+   118us) service_pool.cc:224] Handling call
0709 13:07:39.036187 (+ 27503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.320960 (+2284773us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004e19a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:07:41.493210 (+172250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.493486 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413188992}
I20260709 13:07:41.411962 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.498664 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.499472 21811 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:07:41.501674 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.502074 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.502712 21811 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:41.491437 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.494843 21805 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:41.435634 24442 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:41.504282 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.405472 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.506297 21218 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.403906 24385 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.461166 24221 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.505215 21809 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:41.504458 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.469415 24261 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.508961 24215 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:41.521071 24304 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:41.521620 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 366875us
I20260709 13:07:41.522097 24304 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.522971 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:41.523954 24301 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.527809 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:41.524442 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:41.509321 21222 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:41.509379 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.509976 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.529734 21807 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:41.466584 24410 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.397962 24443 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:07:41.402603 24274 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:07:41.486361 24379 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:41.516695 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 1999) took 2519 ms. Trace:
I20260709 13:07:41.398568 24058 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:41.497097 24282 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.502151 24278 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.520113 24438 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:41.520328 24261 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.389608 24258 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:41.545938 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.570039 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.589337 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.589159 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.571080 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.589960 21297 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:41.590158 21298 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:41.516778 24260 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.574766 21300 rpcz_store.cc:276] 0709 13:07:38.997005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.997177 (+   172us) service_pool.cc:224] Handling call
0709 13:07:39.004359 (+  7182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.593412 (+589053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.516461 (+1923049us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540022c9d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.516629 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307643136}
I20260709 13:07:41.445998 24424 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.483026 23723 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:07:41.584707 24330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.018s	sys 0.021s
I20260709 13:07:41.530987 24422 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.572228 24310 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.495878 24435 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:07:41.588683 24443 consensus_queue.cc:1243] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:41.515734 24385 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.585403 24420 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:41.607887 24421 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:41.609202 24282 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.609313 24261 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.531685 24399 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:07:41.616444 24424 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.635429 24379 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.635874 24379 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:41.590806 24278 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.618647 24354 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:41.597131 24330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.019s	sys 0.022s
I20260709 13:07:41.652642 24412 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.653102 24412 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:41.603914 24422 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.655227 24439 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.655668 24439 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:41.656144 24385 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.656407 24439 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.662673 24439 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.676311 24418 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.679108 24422 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.672966 24379 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.682716 24379 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.653867 24412 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.692343 24412 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.519869 21217 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:41.751724 21190 leader_election.cc:336] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.816s (SENT)
W20260709 13:07:41.756812 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.761963 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:41.764971 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.765990 21291 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:41.766142 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:41.767836 21226 raft_consensus.cc:2376] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6. Re-sending same reply.
I20260709 13:07:41.581202 21295 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:41.769176 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 241282us
I20260709 13:07:41.770114 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2010) took 1498 ms. Trace:
I20260709 13:07:41.581924 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.772063 21294 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:41.773129 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:41.773905 21222 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:41.774969 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.776305 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:41.776664 21296 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:41.777453 21222 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:41.778577 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 188609us
I20260709 13:07:41.778786 21222 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.525597 24221 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.782123 21222 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:41.795063 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.770638 21292 rpcz_store.cc:276] 0709 13:07:40.271405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.271575 (+   170us) service_pool.cc:224] Handling call
0709 13:07:40.271940 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.497357 (+225417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.769452 (+1272095us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003d3bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.769831 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516789504}
I20260709 13:07:41.797762 24221 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:41.781535 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:41.810101 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.813942 21148 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:41.814118 24194 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.814940 24194 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.587510 24058 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.817473 24394 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:41.821581 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 66431us
I20260709 13:07:41.821966 21813 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:41.822225 24418 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.823093 24418 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:41.823693 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.824259 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.825974 24418 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.827543 21291 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:41.820291 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:41.797981 24371 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:41.815521 24194 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.605376 24310 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.835644 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:41.836238 21810 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:41.836802 21219 raft_consensus.cc:2368] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8.
I20260709 13:07:41.838333 24310 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:41.838846 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.841990 24278 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.843171 24335 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.844357 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 85414.4us
I20260709 13:07:41.844646 24420 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.816593 24349 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.832682 24421 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:41.832515 24399 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:41.853569 24380 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.819490 21222 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.797145 24370 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:41.860553 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.852820 24421 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.863576 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.864568 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.867515 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.871966 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.855473 24380 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.874814 21300 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:41.854291 24221 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.874433 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:41.880457 24441 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.883621 21146 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:41.883674 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.889762 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:41.845556 24420 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.871624 24371 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.891456 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:41.844323 24335 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.900869 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:41.902274 21297 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:41.903215 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:41.903571 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:41.904084 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 90772.7us
I20260709 13:07:41.905424 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:41.905673 24371 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:41.905840 24424 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:41.907392 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 369783us
I20260709 13:07:41.891110 24404 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:41.911998 21222 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.912561 24324 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.915625 24299 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.908452 21293 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:41.914521 24190 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.919485 21150 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.881366 24441 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.918267 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:41.924355 24356 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.002s
I20260709 13:07:41.926162 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:41.926901 24329 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.927393 24329 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.927524 21144 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:41.927806 24329 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.931309 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1853) took 1105 ms. Trace:
I20260709 13:07:41.931766 21148 rpcz_store.cc:276] 0709 13:07:40.825835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.228009 (+402174us) service_pool.cc:224] Handling call
0709 13:07:41.239218 (+ 11209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.814641 (+575423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.930980 (+116339us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540031c9d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.931233 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273621888}
I20260709 13:07:41.935437 24250 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:41.935940 24250 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.936333 24250 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.939388 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.922569 24221 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.940415 21147 raft_consensus.cc:2410] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:41.940807 21145 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.941319 21145 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:41.942055 24354 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.943077 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 469) took 2494 ms. Trace:
I20260709 13:07:41.943485 21224 rpcz_store.cc:276] 0709 13:07:39.448433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.450025 (+  1592us) service_pool.cc:224] Handling call
0709 13:07:39.450318 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.652134 (+201816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.652176 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.666988 (+ 14812us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.807919 (+140931us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.807964 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.942401 (+2134437us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540038de54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:41.942475 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.942546 (+    71us) raft_consensus.cc:1685] finished
0709 13:07:41.942558 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.942898 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":236,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":15348,"spinlock_wait_cycles":463112576,"thread_start_us":41508,"threads_started":1,"wal-append.queue_time_us":173451,"wal-append.run_cpu_time_us":1855,"wal-append.run_wall_time_us":1001874}
I20260709 13:07:41.940912 21806 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:41.942451 21145 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.919901 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.930979 24349 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:41.949565 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 44345.5us
I20260709 13:07:41.951414 24380 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:41.952759 24404 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.954315 24404 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.954735 24404 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:41.956714 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:41.957379 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:41.963868 24249 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.964651 24249 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:41.966055 24221 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:41.968211 24428 consensus_queue.cc:1175] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e66e7254b764832b244bb5b07b4a208" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)" } } last_received_current_leader { term: 5 index: 4 } }
I20260709 13:07:41.972695 24249 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:41.978964 21218 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:41.980001 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72836us
I20260709 13:07:41.948916 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:41.983749 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 68485.9us
W20260709 13:07:41.989929 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.992266 24354 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.992612 24400 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.992816 24354 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.992861 24335 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:41.993335 24354 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.994800 24249 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.995247 24249 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:41.995630 24249 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.962817 24194 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:41.996573 24058 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:42.000465 24194 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:42.001510 24460 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:07:41.993060 24400 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.006769 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.013635 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.013720 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.014634 21808 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:42.015770 21145 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.019835 24441 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:42.007620 24194 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.030566 24420 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:42.009287 24400 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:42.035502 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.036015 21808 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:42.036847 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 979) took 1597 ms. Trace:
I20260709 13:07:42.037389 21810 raft_consensus.cc:2955] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:42.039409 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.045032 24390 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.045784 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:42.059501 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 140547us
W20260709 13:07:42.062217 21190 leader_election.cc:336] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.927s (SENT)
I20260709 13:07:42.047045 24404 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.062685 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.053646 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:42.063355 24404 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.063633 21807 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.064328 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.065069 21814 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:42.066075 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.066828 21814 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:42.054287 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 578456us
W20260709 13:07:42.067530 24311 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.005s
I20260709 13:07:42.067907 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.068768 21809 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:42.069552 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.070158 21809 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:42.070640 21293 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:42.070750 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:42.071475 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:42.071776 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.072129 21297 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:42.072235 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:42.072582 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 47235.4us
I20260709 13:07:42.073583 21219 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:42.069645 21299 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:41.797137 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.062736 21150 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:42.073414 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:42.049136 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.071009 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.084662 24405 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.085201 24405 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.085563 24405 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.073485 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:42.051707 21806 rpcz_store.cc:276] 0709 13:07:40.439461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.847937 (+1408476us) service_pool.cc:224] Handling call
0709 13:07:41.848756 (+   819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.948043 (+ 99287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.036613 (+ 88570us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54003c3554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:42.036776 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211183488}
W20260709 13:07:42.068360 24443 consensus_queue.cc:1175] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3585d99c303e453c8c3762b294caba4e" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:07:42.088488 24338 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:42.089442 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:42.049536 24194 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:42.098299 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.015790 24324 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:42.097687 24194 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.092902 24338 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.102303 21300 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:42.102175 24311 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:42.102603 21223 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.002s
I20260709 13:07:42.103519 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1500) took 1316 ms. Trace:
I20260709 13:07:42.108009 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.097756 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:42.111127 24250 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:42.130913 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:42.125190 24262 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:42.137674 21808 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:42.137989 21224 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:42.126590 21145 rpcz_store.cc:276] 0709 13:07:40.787185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.208559 (+421374us) service_pool.cc:224] Handling call
0709 13:07:41.208868 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.940550 (+731682us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54003f41a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:07:42.103005 (+162455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.103049 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.103092 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:42.103159 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.103247 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.103455 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13526,"raft.queue_time_us":14854,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":134,"spinlock_wait_cycles":1382893440}
I20260709 13:07:42.120301 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.136714 21222 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:42.144213 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.145669 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.146919 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:42.147432 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.151511 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.151876 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.154735 24409 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:42.154960 24462 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:42.155871 24456 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:42.156378 24456 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:42.156538 23779 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.157037 23779 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.157428 23779 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.157369 24456 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.158388 21809 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:42.159152 24456 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.159569 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:42.160019 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 155402us
W20260709 13:07:42.161701 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.163074 24443 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.152680 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.153591 21808 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:42.166731 21807 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:42.049612 24441 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:07:42.170466 24340 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:42.170821 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:42.172230 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.172797 24385 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.173086 24134 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.173399 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.173750 21294 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:42.174170 21814 raft_consensus.cc:2410] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:42.172394 24271 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:42.175175 21299 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:42.163807 24443 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:42.176951 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.179847 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 109980us
I20260709 13:07:42.175052 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.178999 21223 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:42.183988 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:42.190855 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48452us
W20260709 13:07:42.192552 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74791.1us
W20260709 13:07:42.194347 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.194921 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.199756 21218 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:42.200975 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.201850 21809 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:42.195411 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.203699 21292 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:42.204319 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.204988 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:42.170518 24311 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.207928 24326 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:07:42.211167 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 115758us
I20260709 13:07:42.202857 21808 raft_consensus.cc:2376] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5. Re-sending same reply.
I20260709 13:07:42.211014 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.219758 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.204092 21292 pending_rounds.cc:85] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 3
I20260709 13:07:42.192198 24278 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.221149 21806 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:42.228966 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.223742 24338 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:42.229743 23943 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.232066 24385 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.232429 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:42.232820 24385 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:42.234203 24385 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:42.235675 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 173509us
W20260709 13:07:42.236353 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.224190 24311 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.238101 21218 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:42.238853 24311 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:42.221019 21292 pending_rounds.cc:107] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:42.239451 21292 raft_consensus.cc:2889] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.239199 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:42.229719 24463 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:42.246714 21224 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:42.253885 23779 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.263837 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:42.267163 24464 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.174s	user 0.003s	sys 0.000s
I20260709 13:07:42.271230 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.272941 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:42.276064 21813 raft_consensus.cc:2410] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:42.277177 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.278463 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:42.279776 21809 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.284157 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.285542 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:42.285730 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.286115 21807 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.286504 21806 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:42.287249 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:42.287967 21806 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 4: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:42.289847 24439 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.290387 21143 raft_consensus.cc:2410] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:42.291536 24129 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.941s	user 0.014s	sys 0.008s
I20260709 13:07:42.292044 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.293546 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.293939 24443 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:42.300937 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:42.302660 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:42.306439 21808 raft_consensus.cc:2376] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4. Re-sending same reply.
I20260709 13:07:42.309049 21149 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:42.312656 21808 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:42.313519 21143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1856) took 1326 ms (client timeout 1642 ms). Trace:
W20260709 13:07:42.313997 21143 rpcz_store.cc:269] 0709 13:07:40.986672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.038130 (+ 51458us) service_pool.cc:224] Handling call
0709 13:07:42.313247 (+1275117us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540040c754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:42.313440 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792327040}
I20260709 13:07:42.316411 24324 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:42.317188 24324 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:42.323451 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:42.323804 24412 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.007s
I20260709 13:07:42.324172 24271 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.324728 24271 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:42.325795 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.325531 24354 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:42.326272 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.325881 24271 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:42.327975 24379 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.645s	user 0.014s	sys 0.003s
I20260709 13:07:42.308588 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:42.322616 24329 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:42.290565 24439 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.232086 23943 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:42.330797 21814 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:42.359318 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:42.296406 24424 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.302038 24221 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:42.427847 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.513769 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.715265 21809 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
W20260709 13:07:42.884160 24400 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.000s
I20260709 13:07:42.330046 24409 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.327092 24390 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:42.883713 21805 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.004s
I20260709 13:07:42.940829 21805 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:07:42.578677 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 323508us
W20260709 13:07:42.927317 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.468194 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 108989us
W20260709 13:07:42.613045 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.695689 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.490093 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 103885us
I20260709 13:07:42.934123 24354 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:42.928097 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:42.485042 24467 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:07:42.487989 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.609699 24429 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:42.682042 24405 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.003s
W20260709 13:07:42.663859 21048 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 374) took 11414 ms (client timeout 15000 ms). Trace:
W20260709 13:07:42.678683 24456 consensus_meta.cc:287] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
W20260709 13:07:42.946638 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 702761us
I20260709 13:07:42.425360 24285 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.488602 24330 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.659848 24404 consensus_meta.cc:287] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.001s
I20260709 13:07:42.486956 24371 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.884663 24439 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:42.615164 23779 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:42.964563 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 433924us
I20260709 13:07:42.965022 21221 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:42.484800 24423 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.489549 24248 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.488270 24356 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.940063 24329 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:42.385632 24379 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.571s
I20260709 13:07:42.668299 21047 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 4, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.516487 24249 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.967824 21226 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:42.959000 24285 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:42.961614 24371 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.979156 21189 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:42.488283 24194 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:42.980314 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 492419us
I20260709 13:07:42.956663 24412 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.989104 21149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 597) took 3631 ms (client timeout 1787 ms). Trace:
W20260709 13:07:42.994748 21300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.019s
W20260709 13:07:42.955735 21048 rpcz_store.cc:269] 0709 13:07:31.250092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.251300 (+  1208us) service_pool.cc:224] Handling call
0709 13:07:42.663602 (+11412302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:38.557741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:38.635351 (+ 77610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:38.635406 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:38.635425 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:38.644882 (+  9457us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:38.644964 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:38.644998 (+    34us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:07:38.646353 (+  1355us) tablet.cc:701] Row locks acquired
0709 13:07:38.646406 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:38.646618 (+   212us) write_op.cc:270] Start()
0709 13:07:38.646775 (+   157us) write_op.cc:276] Timestamp: P: 1783602458646508 usec, L: 0
0709 13:07:38.646792 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:07:38.771960 (+125168us) log.cc:844] Serialized 7323 byte log entry
0709 13:07:39.081539 (+309579us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:39.332971 (+251432us) op_driver.cc:464] REPLICATION: finished
0709 13:07:39.485400 (+152429us) write_op.cc:301] APPLY: starting
0709 13:07:39.485500 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:39.485943 (+   443us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:39.485964 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:39.792153 (+306189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:39.792446 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:07:39.792500 (+    54us) write_op.cc:312] APPLY: finished
0709 13:07:39.792879 (+   379us) log.cc:844] Serialized 125 byte log entry
0709 13:07:39.793058 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:39.793228 (+   170us) write_op.cc:454] Released schema lock
0709 13:07:39.793280 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:39.793665 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:39.793700 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3662416,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":147414,"apply.run_cpu_time_us":5848,"apply.run_wall_time_us":313015,"num_ops":18,"prepare.queue_time_us":55551,"prepare.run_cpu_time_us":33243,"prepare.run_wall_time_us":501895,"raft.queue_time_us":217609,"raft.run_cpu_time_us":34035,"raft.run_wall_time_us":99463,"replication_time_us":686025,"spinlock_wait_cycles":6188416,"thread_start_us":408677,"threads_started":4,"wal-append.queue_time_us":272871,"wal-append.run_cpu_time_us":58078,"wal-append.run_wall_time_us":1745254}]]}
I20260709 13:07:42.946851 24400 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:43.014354 21300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.019s
W20260709 13:07:43.014839 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.966741 24354 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:42.957679 24409 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.995712 24456 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.958074 24405 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:43.007876 21149 rpcz_store.cc:269] 0709 13:07:39.357671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.464942 (+107271us) service_pool.cc:224] Handling call
0709 13:07:42.988769 (+3523827us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b540040cc54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:42.988962 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5807925632}
I20260709 13:07:42.996085 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.006222 24371 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.020411 24258 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.020532 24424 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:43.020597 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 61800.4us
I20260709 13:07:43.021251 24429 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:43.021682 24400 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:42.959266 24330 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.995637 24248 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:42.994386 24423 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.033252 24429 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.039479 24480 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:43.039755 24429 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.040158 24480 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.042364 24480 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.042444 24324 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.043495 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.043993 24250 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.048038 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.053118 24421 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:43.053743 24421 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.054461 24480 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.018190 24285 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:43.063473 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 97623.2us
W20260709 13:07:43.069900 24469 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.977s	user 0.038s	sys 0.013s
I20260709 13:07:43.073515 24271 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.076185 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2441) took 1006 ms. Trace:
I20260709 13:07:43.076573 21226 rpcz_store.cc:276] 0709 13:07:42.069934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.071936 (+  2002us) service_pool.cc:224] Handling call
0709 13:07:43.076027 (+1004091us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540038cf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:43.076129 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057941888}
I20260709 13:07:43.058885 24258 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.031971 24412 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.060879 24420 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.061316 24324 raft_consensus.cc:2764] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:07:43.046541 24354 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.085203 24285 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.044333 24356 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.086357 24420 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.093132 21047 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 4, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:43.107154 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.107884 24480 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.109036 24412 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.109571 24423 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:43.113164 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 50752.4us
I20260709 13:07:43.118681 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.125648 24405 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.112203 24420 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.132689 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:43.132800 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.133493 21222 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 4: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:43.133684 21219 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:43.133410 21226 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:43.122210 21047 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.126150 24249 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.129009 24421 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:43.163576 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 76767.1us
I20260709 13:07:43.167771 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:43.148901 24324 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.171011 24324 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.164503 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.181809 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:43.122890 24480 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.152170 24194 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.130900 24412 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:43.191339 21807 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:43.193809 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1004) took 1080 ms. Trace:
I20260709 13:07:43.194289 21807 rpcz_store.cc:276] 0709 13:07:42.113305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.302798 (+189493us) service_pool.cc:224] Handling call
0709 13:07:43.186406 (+883608us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:43.186677 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.193482 (+  6805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.193736 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6265088}
I20260709 13:07:43.182171 24482 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.150370 24405 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.181887 24324 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.196395 21218 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:43.153258 24429 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.217070 21299 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:43.225948 24477 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:07:43.227440 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.239986 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.210003 24482 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:43.233517 24271 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.147082 24423 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:07:43.239464 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.210250 24390 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:43.265133 21292 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.265331 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.265856 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.269660 21226 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:43.269879 21224 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:43.266331 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:43.271507 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 89853.9us
I20260709 13:07:43.214527 24248 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.273399 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.268568 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.274083 21293 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.274211 21291 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.274897 21218 raft_consensus.cc:2410] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:43.268370 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.267558 21295 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:43.276635 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.277211 21294 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.233723 24249 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.279708 24303 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.279592 24482 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.280723 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.233539 23943 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.233593 24258 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.286979 21294 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:43.288285 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 343631us
I20260709 13:07:43.276165 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.287621 21217 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:43.290979 21296 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:43.268791 24330 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.294363 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.222543 24405 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.298916 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.299199 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.300230 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.300760 21812 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.300684 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.301694 21808 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.297636 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.303783 21809 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.286383 24248 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.310135 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.320631 21805 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:43.266620 24250 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:43.273178 24271 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:43.318966 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.014s	sys 0.009s
I20260709 13:07:43.318485 21808 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:43.317667 21809 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:43.292351 24324 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.326737 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.014s	sys 0.009s
I20260709 13:07:43.329339 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:43.329303 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.07038e+06us
I20260709 13:07:43.330442 21813 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:43.326552 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.332991 21150 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:43.327229 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.335449 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:43.337289 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.338129 21143 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:43.338358 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.339208 21809 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:43.339968 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:43.340646 21145 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.342325 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.343150 21148 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:43.352914 21217 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:43.353225 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 65900.8us
W20260709 13:07:43.359318 21810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.031s	sys 0.022s
W20260709 13:07:43.359792 21810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.031s	sys 0.022s
I20260709 13:07:43.327379 24390 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.355744 21808 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:43.362138 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.360980 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.362684 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.349632 24400 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.340479 24480 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.363094 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:43.319053 24249 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.357532 24421 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.373268 21805 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:43.375466 21813 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:43.375490 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.376006 21813 pending_rounds.cc:85] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:43.376262 21813 pending_rounds.cc:107] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:43.376425 21813 raft_consensus.cc:2889] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.378891 21218 raft_consensus.cc:2410] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:43.382051 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.370921 24400 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.382710 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.358976 24324 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.358712 24248 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.357051 24303 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.372088 24330 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.384783 21805 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:43.437347 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 54753us
I20260709 13:07:43.384071 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:43.442412 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 62594us
I20260709 13:07:43.447590 21812 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:43.420086 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 832) took 1278 ms. Trace:
I20260709 13:07:43.440719 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.444401 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:43.452267 21293 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:43.453142 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:43.458308 21115 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.420094 24261 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:43.450392 21811 rpcz_store.cc:276] 0709 13:07:42.049407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.100664 (+ 51257us) service_pool.cc:224] Handling call
0709 13:07:42.170291 (+ 69627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.208168 (+ 37877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.208215 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.208799 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.270572 (+ 61773us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b18002d5560. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:07:42.612990 (+342418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:42.613034 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.613108 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.297315 (+684207us) raft_consensus.cc:1685] finished
0709 13:07:43.297345 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.327663 (+ 30318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37384,"raft.queue_time_us":37735,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":15140096,"thread_start_us":342215,"threads_started":1,"wal-append.queue_time_us":853162}
I20260709 13:07:43.459517 24261 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.459919 24261 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.460273 24303 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.460889 24303 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.461305 24303 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:43.462278 24303 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.464062 21145 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:43.402240 24194 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.487370 24439 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:43.384717 24421 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.490392 24421 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.386503 24400 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.492856 24371 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.493636 24356 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.494397 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.463887 24419 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:43.495204 24330 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.463400 24486 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:43.539928 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45627.1us
I20260709 13:07:43.540973 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.542378 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.500012 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.543955 21293 raft_consensus.cc:2410] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:43.544570 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 172355us
I20260709 13:07:43.498745 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:43.436599 24489 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:43.552019 21221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2428) took 2056 ms (client timeout 1770 ms). Trace:
W20260709 13:07:43.550972 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 167407us
W20260709 13:07:43.554378 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.552484 21221 rpcz_store.cc:269] 0709 13:07:41.490341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.491089 (+   748us) service_pool.cc:224] Handling call
0709 13:07:43.513180 (+2022091us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540038ca54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:43.545212 (+ 32032us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822273408}
I20260709 13:07:43.500844 24429 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:43.556329 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 195427us
I20260709 13:07:43.563805 21292 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:43.535737 24271 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.568640 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.568997 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.487485 24194 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.569871 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.535772 24419 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:43.565296 21190 leader_election.cc:336] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.635s (SENT)
I20260709 13:07:43.555317 24412 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.513885 23779 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:43.556962 24330 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:43.579550 21292 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:43.594717 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.588320 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.588538 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2409) took 1194 ms. Trace:
I20260709 13:07:43.593593 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.596290 21296 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.588733 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:43.588850 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 90184.9us
I20260709 13:07:43.568645 24480 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:43.596015 21295 rpcz_store.cc:276] 0709 13:07:42.394456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.208052 (+813596us) service_pool.cc:224] Handling call
0709 13:07:43.217350 (+  9298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.286870 (+ 69520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.588261 (+301391us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:43.588481 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108930944}
I20260709 13:07:43.558094 24484 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.569600 24405 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.597422 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:43.588943 21299 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:43.565734 24356 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.578559 24419 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.598865 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.601441 21298 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:43.577697 24262 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:43.591997 24271 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.622239 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 834) took 1521 ms. Trace:
I20260709 13:07:43.605494 24484 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.598223 24423 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.577907 24412 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.556293 24489 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.632133 21291 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:07:43.609330 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44077.4us
W20260709 13:07:43.623761 24456 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.596s	user 0.003s	sys 0.009s
I20260709 13:07:43.618346 24262 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:43.615042 24429 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:43.577759 24485 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.634531 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.578500 24428 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:07:43.627743 24285 consensus_meta.cc:287] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.009s
I20260709 13:07:43.642058 21298 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 8. Ops: []
I20260709 13:07:43.609961 24248 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.608323 24497 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:43.644773 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.645516 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:43.650460 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 51663.1us
I20260709 13:07:43.656149 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.639961 24456 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:43.640173 24262 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.639066 24261 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.660857 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.661630 21295 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:43.662725 24261 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.662427 24330 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.663719 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.664330 21294 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:43.637835 24412 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.627893 24484 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.632769 24249 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.609006 24250 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:43.665759 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:43.639602 24423 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:43.625126 24421 consensus_queue.cc:1059] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:43.677502 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.667675 24258 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.627585 24271 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.681105 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:43.687956 24324 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:43.679993 21190 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.762s (SENT)
I20260709 13:07:43.678110 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.690801 21292 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:43.689284 24423 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.699932 24497 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:43.701146 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.701486 21190 leader_election.cc:336] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.036s (SENT)
I20260709 13:07:43.703446 24271 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.704241 24419 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.704779 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:43.707448 21218 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:43.716563 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:43.716841 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.720914 21292 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:43.717350 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.717321 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 102233us
I20260709 13:07:43.729739 24249 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:43.724483 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:43.736692 21190 leader_election.cc:336] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.160s (SENT)
I20260709 13:07:43.737396 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:43.738638 24475 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:43.742098 21224 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:43.739500 24385 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.748211 21292 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:43.748747 21293 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:43.719907 24421 raft_consensus.cc:3055] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:43.755321 21805 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:43.761777 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:43.763728 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.764075 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.764562 21807 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:43.745925 24354 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.752353 24285 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.695868 24400 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.712590 24258 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:43.775746 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 71069.2us
I20260709 13:07:43.765448 24371 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.746419 24262 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.788177 24262 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.770040 23779 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:43.789333 23779 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.778532 24194 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.792531 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.766527 24509 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.793943 24400 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.794148 24509 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.795998 21221 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:43.797174 24509 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.755944 24421 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:43.782032 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45424.9us
I20260709 13:07:43.784204 24429 raft_consensus.cc:2764] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:43.784970 24489 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:43.805027 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.806835 21809 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.805440 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.779417 24303 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:43.808874 24258 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:43.817525 24303 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:43.824003 24285 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:43.824400 24303 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.824987 24285 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:43.823073 21809 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
W20260709 13:07:43.802534 24420 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.002s
I20260709 13:07:43.800922 24400 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.831374 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:43.832183 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.831686 21114 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:43.832465 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.833377 21296 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:43.833899 21296 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:43.834561 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 89085.6us
W20260709 13:07:43.830678 21190 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.172s (SENT)
I20260709 13:07:43.827986 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:43.829900 24285 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:43.836879 24400 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:43.837575 24285 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.817767 24262 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:43.838476 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.779354 24412 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.825572 24303 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.841565 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.840714 24262 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:43.842700 24493 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.843552 24423 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.830422 24428 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:43.840267 24330 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.832647 24419 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:43.861853 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.862838 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:43.836391 24420 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.858952 24507 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:43.875547 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44908.7us
I20260709 13:07:43.856603 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.884925 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:43.873675 24514 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:07:43.897742 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.897742 21809 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:43.898918 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.899636 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:43.852392 24262 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.901727 21813 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:43.955480 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 98973.9us
I20260709 13:07:43.954823 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.958016 21116 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.901433 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:43.961263 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.962103 21296 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:43.964164 21809 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:43.968765 21297 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:43.972777 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.973140 21264 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:43.970777 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:43.878556 24423 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:43.895217 24354 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:43.979460 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 166140us
I20260709 13:07:43.980201 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:43.987462 21149 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.900895 24507 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.976997 21813 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:43.901125 24475 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.940755 24261 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.983079 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.990429 21809 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.990622 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:43.993444 24517 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.993935 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.994177 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.995113 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.996160 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:43.996711 21299 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:43.997438 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:43.967769 24324 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.991457 21813 raft_consensus.cc:2376] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6. Re-sending same reply.
I20260709 13:07:43.968866 23779 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.998035 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.993463 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.902312 24285 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.001770 21149 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:43.892220 24258 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:07:43.868950 24484 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:44.003279 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.955174 24330 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:44.004125 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 279733us
I20260709 13:07:43.876858 24428 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.004881 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.010525 21147 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:43.976423 24429 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.010844 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.980214 24456 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.013399 21145 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:44.018913 21150 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:43.980376 24385 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.015162 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:43.967572 24405 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:44.016093 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.016918 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:44.017164 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.017735 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.022994 21148 raft_consensus.cc:2410] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:43.993945 24517 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.999454 24475 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.877737 24493 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.020906 21144 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:44.034138 21809 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:43.954474 24439 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:07:44.030100 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 128750us
W20260709 13:07:44.034794 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 46145.5us
I20260709 13:07:43.999465 24507 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.021288 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.037508 21809 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:44.039109 24356 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:44.041502 24324 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:44.041869 24356 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.960186 24421 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:43.997704 24515 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:44.033150 24475 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.051476 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.032956 24517 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.037995 24248 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.047621 24400 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.056517 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.057546 24484 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.058156 24484 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:44.059373 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47369.4us
W20260709 13:07:44.063943 24513 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:44.065199 24510 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.065820 24510 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.034071 24429 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.067649 24412 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.068436 24330 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.069259 24429 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.070443 21296 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:44.071295 24248 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.071712 24248 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.072345 24507 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.073275 24262 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.039947 24370 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.080904 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.042515 24324 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:44.089932 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.083611 21809 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:44.079989 24400 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.053376 24405 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.104298 24507 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:43.622705 21806 rpcz_store.cc:276] 0709 13:07:42.101044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.288426 (+187382us) service_pool.cc:224] Handling call
0709 13:07:42.330161 (+ 41735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.564838 (+234677us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:42.632741 (+ 67903us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.558974 (+926233us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.598261 (+ 39287us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.616661 (+ 18400us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.621923 (+  5262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.621969 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:43.622009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.622072 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.622187 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52314,"prepare.queue_time_us":372079,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":51652,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":14705,"spinlock_wait_cycles":12525952,"thread_start_us":906270,"threads_started":3,"wal-append.queue_time_us":489226}
I20260709 13:07:44.107388 21809 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:44.074294 24475 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.081879 24261 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:44.116473 24261 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.046949 24523 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:44.115314 24262 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.097656 24258 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.100199 24405 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:44.121183 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 122073us
I20260709 13:07:44.127211 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.128818 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.110446 24400 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:44.126268 24258 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:44.082571 24423 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.125387 24370 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.176855 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48158.6us
I20260709 13:07:44.177695 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.137915 24129 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.174840 24258 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.174952 24424 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:44.183602 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 165938us
I20260709 13:07:44.186393 24529 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.186847 24529 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.187189 24529 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.190387 24493 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.192994 24400 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.197662 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 983) took 2162 ms. Trace:
I20260709 13:07:44.197458 24529 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:44.200591 24490 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.610s	user 0.002s	sys 0.001s
I20260709 13:07:44.202967 21810 rpcz_store.cc:276] 0709 13:07:42.035628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.036547 (+   919us) service_pool.cc:224] Handling call
0709 13:07:42.036852 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.037174 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:42.189988 (+152814us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.576465 (+1386477us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.196685 (+620220us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b18002b3a80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:07:44.196919 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.197143 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.197211 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.197273 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.197359 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.197572 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41714,"prepare.queue_time_us":1439566,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":480299,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":10926,"spinlock_wait_cycles":11022592,"thread_start_us":1294192,"threads_started":3,"wal-append.queue_time_us":818164}
W20260709 13:07:44.212378 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 177856us
W20260709 13:07:44.215929 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 98666.3us
I20260709 13:07:44.218526 24428 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.207417 24371 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.220023 24517 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.220168 24371 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.215996 21263 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.222146 24517 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.222920 24493 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.223181 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.224139 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1477) took 1098 ms. Trace:
I20260709 13:07:44.224354 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.225015 24493 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.224802 24248 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.225167 24509 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:44.225778 24509 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:44.224519 21223 rpcz_store.cc:276] 0709 13:07:43.125854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.126464 (+   610us) service_pool.cc:224] Handling call
0709 13:07:43.134513 (+  8049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.151402 (+ 16889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.151447 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.166326 (+ 14879us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.482711 (+316385us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:43.482767 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.482864 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.199847 (+716983us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:44.223859 (+ 24012us) raft_consensus.cc:1685] finished
0709 13:07:44.223879 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.224060 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1581,"raft.queue_time_us":5537,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":19060,"spinlock_wait_cycles":175802496,"thread_start_us":293460,"threads_started":1,"wal-append.queue_time_us":351600}
I20260709 13:07:44.226891 24248 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:44.229001 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.221549 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:44.230221 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.231139 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.231823 21223 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:44.233798 24515 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:44.235500 24475 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.235749 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.235598 24515 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.236457 21220 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:44.237393 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.238431 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.239029 21225 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:44.243845 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.244058 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.244340 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.244637 21298 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.244946 24409 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.237942 21220 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:44.245951 21114 leader_election.cc:400] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8.
I20260709 13:07:44.247087 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.248071 24428 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.178653 24370 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.237932 24515 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.210199 24424 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:44.214408 24480 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:44.256549 21190 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.257989 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.259414 24480 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.261654 21142 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:44.262279 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.258078 24428 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:44.266345 24488 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.692s	user 0.002s	sys 0.003s
I20260709 13:07:44.269629 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.226907 24509 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.271775 24483 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.271940 21778 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.257618 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.274073 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:44.280103 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.281090 24529 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.283572 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.288168 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1481) took 1143 ms. Trace:
I20260709 13:07:44.288938 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.290144 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.275110 24409 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.288578 21222 rpcz_store.cc:276] 0709 13:07:43.144345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.144495 (+   150us) service_pool.cc:224] Handling call
0709 13:07:43.148862 (+  4367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.171820 (+ 22958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.171862 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.172626 (+   764us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.374245 (+201619us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:43.574454 (+200209us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.577414 (+  2960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.577502 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.265085 (+687583us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18000ae100. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db
0709 13:07:44.265662 (+   577us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:44.287929 (+ 22267us) raft_consensus.cc:1685] finished
0709 13:07:44.287965 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.288110 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3115,"prepare.queue_time_us":282649,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":11181,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":17395,"spinlock_wait_cycles":238757632,"thread_start_us":387218,"threads_started":2,"wal-append.queue_time_us":327446}
I20260709 13:07:44.296849 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.297770 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.297683 21294 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.294891 24409 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.278797 24428 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:44.301589 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.278363 24483 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.311292 21293 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.315052 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.315878 21293 raft_consensus.cc:2368] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9.
W20260709 13:07:44.318786 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 70085.5us
I20260709 13:07:44.309006 24409 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:44.323197 24503 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.653s	user 0.003s	sys 0.000s
I20260709 13:07:44.323335 24456 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.323536 24370 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.327095 21298 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:44.329087 24420 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.328768 24424 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.302245 24529 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.321525 21294 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:44.339747 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.340764 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.341724 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.343961 21150 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:44.347167 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.345028 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.349417 21293 raft_consensus.cc:2368] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:44.349460 21143 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.346705 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.350757 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.351329 21145 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.353816 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.357127 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.357191 24420 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.357834 24420 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.358165 24420 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.352871 24497 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.359742 24497 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.360163 24497 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.364039 24524 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.364795 24524 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:44.364812 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.366358 24524 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.352980 24248 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.367934 24248 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.368359 24248 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.368902 24524 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.369179 24480 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.371236 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:44.372308 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.372575 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.373442 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.374066 21299 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:44.374522 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.373509 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.375725 24370 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.376387 21295 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:44.377097 24258 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.377724 21295 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:44.374919 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:44.382515 24495 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.766s	user 0.003s	sys 0.000s
I20260709 13:07:44.382454 24537 raft_consensus.cc:2764] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:44.383411 24261 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:44.384752 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.384881 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.385790 24510 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.386539 24370 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.387985 24537 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:44.392063 24542 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:44.390627 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.354664 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.395159 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:44.397145 21145 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:44.401990 24510 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.369247 24405 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.402037 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:44.393858 24502 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.767s	user 0.002s	sys 0.000s
I20260709 13:07:44.413370 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.393754 24529 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.414651 21294 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:44.402478 24510 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.424096 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.425109 21298 raft_consensus.cc:2368] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:44.379127 24258 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.429697 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.447849 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 488) took 1081 ms. Trace:
I20260709 13:07:44.448273 21217 rpcz_store.cc:276] 0709 13:07:43.366984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.367142 (+   158us) service_pool.cc:224] Handling call
0709 13:07:43.373816 (+  6674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.378003 (+  4187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.378045 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.386983 (+  8938us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.551277 (+164294us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.551317 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.551385 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.393298 (+841913us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:44.447549 (+ 54251us) raft_consensus.cc:1685] finished
0709 13:07:44.447572 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.447787 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26974,"raft.queue_time_us":1383,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4614,"spinlock_wait_cycles":112289024,"thread_start_us":101136,"threads_started":1,"wal-append.queue_time_us":189793}
I20260709 13:07:44.450088 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:44.403771 24324 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:44.451485 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:44.437971 24524 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:44.452401 24324 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:44.452883 24324 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:44.451485 24285 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.453474 24285 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.453894 24285 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.453867 24324 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.414328 24370 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.421157 24529 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.456255 24529 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.456358 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2415) took 1231 ms. Trace:
I20260709 13:07:44.456712 21297 rpcz_store.cc:276] 0709 13:07:43.224765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.226734 (+  1969us) service_pool.cc:224] Handling call
0709 13:07:44.456129 (+1229395us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540022ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:44.456277 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593789184}
I20260709 13:07:44.459796 21295 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:44.426862 24510 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.460413 24548 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:44.464591 24497 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.430361 24428 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:44.467844 21143 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:44.489806 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.499586 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:44.500073 24405 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.471172 24248 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.471763 24480 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.451159 24409 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.517498 24423 raft_consensus.cc:2764] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:44.472577 24420 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:44.528685 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.591539 21143 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:44.617590 24480 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:44.618368 24480 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.637596 21142 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:44.608305 24485 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:44.675072 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 279967us
I20260709 13:07:44.677163 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:44.679214 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.679626 24285 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.680344 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.681630 24285 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.681891 21297 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:44.677847 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.683589 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:44.683861 21294 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:44.684000 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.684247 21143 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:44.679642 24529 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.685598 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.687603 24530 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.688095 24530 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.690097 24385 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:44.690472 24420 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.690670 24385 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.691933 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.692485 24258 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.693038 24258 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.693542 24405 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.692507 21293 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:44.696470 21218 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:44.697414 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.697960 21218 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:44.700269 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:44.700903 21148 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.701304 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.702647 21142 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:44.702854 21293 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:44.690100 24530 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.701622 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.704447 21294 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:44.704747 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:44.705365 21143 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:44.706441 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.701622 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.708731 21148 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.708793 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:44.706992 21142 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.711755 24420 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.712296 24420 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.714469 24420 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:44.715083 24492 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.037s	user 0.003s	sys 0.000s
I20260709 13:07:44.721958 21293 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:44.722460 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.729770 21222 raft_consensus.cc:2376] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:07:44.719458 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 487) took 1356 ms. Trace:
I20260709 13:07:44.729722 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.722908 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.687139 24480 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.676829 24409 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.734424 21297 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.749447 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.833340 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.730899 21218 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.819758 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.900681 21293 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:44.902115 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 919) took 1607 ms. Trace:
I20260709 13:07:44.817698 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:44.870046 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.904425 21224 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.816962 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.905606 21294 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:44.871245 24324 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.880978 24285 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.906517 24324 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.906857 24285 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.909116 24285 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.909173 24324 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.792400 24221 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:44.887473 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:44.910164 24221 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.910996 21144 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:44.912236 24221 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.793494 24248 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.735788 21143 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:44.730635 21226 rpcz_store.cc:276] 0709 13:07:43.363249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.363371 (+   122us) service_pool.cc:224] Handling call
0709 13:07:43.376091 (+ 12720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.386295 (+ 10204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:43.657288 (+270993us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.472409 (+815121us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18000a5fa0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a 00007f2b6dd84a2a
0709 13:07:44.718913 (+246504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.718961 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.719011 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.719241 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.719404 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26371,"prepare.queue_time_us":257446,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1053,"raft.queue_time_us":375,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":52581,"spinlock_wait_cycles":9846656,"thread_start_us":369005,"threads_started":2}
I20260709 13:07:44.915437 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.916083 21226 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:44.912516 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.916891 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.917443 21226 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:44.917809 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.918210 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.918812 21219 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:44.918982 21226 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:44.718379 24390 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.919904 24390 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:44.921954 24390 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:44.922587 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.923128 21226 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.930267 21226 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:44.931093 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.931655 21226 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:44.932438 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.932976 21226 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.935793 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1486) took 1299 ms. Trace:
I20260709 13:07:44.936230 21221 rpcz_store.cc:276] 0709 13:07:43.636473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.641314 (+  4841us) service_pool.cc:224] Handling call
0709 13:07:43.668179 (+ 26865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.796550 (+128371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.935516 (+1138966us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001270d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:44.935728 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293339392}
I20260709 13:07:44.937824 24261 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.938555 24518 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.582s	user 0.001s	sys 0.001s
I20260709 13:07:44.938393 24261 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:44.940008 21226 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:44.941084 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:44.941638 21226 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.941715 24421 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.948356 21226 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:44.949368 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.949717 24529 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.950021 21226 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:44.950860 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.951733 24258 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.951818 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.952453 21226 raft_consensus.cc:2376] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:07:44.953194 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:44.916419 21225 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:44.956415 21225 pending_rounds.cc:85] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 4
I20260709 13:07:44.956645 21225 pending_rounds.cc:107] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:44.956856 21225 raft_consensus.cc:2889] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.958127 21225 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:07:44.960834 24522 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.893s	user 0.004s	sys 0.000s
I20260709 13:07:44.962028 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2421) took 1128 ms. Trace:
I20260709 13:07:44.962381 21292 rpcz_store.cc:276] 0709 13:07:43.833584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.833690 (+   106us) service_pool.cc:224] Handling call
0709 13:07:43.833991 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.839155 (+  5164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.839187 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.844307 (+  5120us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.009630 (+165323us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:44.009678 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.009758 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.926853 (+917095us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:44.961725 (+ 34872us) raft_consensus.cc:1685] finished
0709 13:07:44.961751 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.961964 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2357,"spinlock_wait_cycles":18971392,"thread_start_us":164933,"threads_started":1,"wal-append.queue_time_us":223232}
I20260709 13:07:44.971153 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2424) took 1135 ms. Trace:
I20260709 13:07:44.970485 21294 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:44.971658 21296 rpcz_store.cc:276] 0709 13:07:43.835208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.972288 (+137080us) service_pool.cc:224] Handling call
0709 13:07:44.970957 (+998669us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54003d3454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:44.971072 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119007488}
I20260709 13:07:44.973067 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:44.974668 24371 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:44.975051 24456 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.976670 24456 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.977011 24456 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.985343 24385 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:44.985750 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:44.986505 21291 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:44.986743 24271 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:44.987336 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.987910 21291 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:44.988657 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:44.991506 21299 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:44.991865 21291 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:44.987110 24271 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:44.995967 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:45.006913 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.011178 21150 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.011358 24258 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.724387 24356 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.012879 21291 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:44.721503 24129 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.013481 21291 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:44.902510 21814 rpcz_store.cc:276] 0709 13:07:43.295086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.307557 (+ 12471us) service_pool.cc:224] Handling call
0709 13:07:43.340787 (+ 33230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.362801 (+ 22014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.362847 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.384267 (+ 21420us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.570495 (+186228us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:43.628213 (+ 57718us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.633607 (+  5394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.633711 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.714490 (+1080779us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:44.870210 (+155720us) raft_consensus.cc:1685] finished
0709 13:07:44.870312 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.902060 (+ 31748us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9365,"prepare.queue_time_us":630637,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":9188,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":10272,"spinlock_wait_cycles":5416704,"thread_start_us":173698,"threads_started":2,"wal-append.queue_time_us":219507}
I20260709 13:07:45.002162 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:45.020066 21294 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:45.025540 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.030135 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.004662 24439 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:07:45.031805 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.017702 21291 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.032181 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:44.736258 24194 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.297s
I20260709 13:07:44.736377 24489 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.357s
I20260709 13:07:44.718370 24262 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.295s
I20260709 13:07:45.091682 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.150779 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:45.192548 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:45.095166 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.195937 21806 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:45.111928 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.030776 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:45.105981 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.036959 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.198261 21813 raft_consensus.cc:2410] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:45.149194 21291 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.090883 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.169869 21224 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:45.199594 21810 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 5 LEARNER]: Advancing to term 7
I20260709 13:07:45.199909 21225 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:45.149588 21812 raft_consensus.cc:2376] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6. Re-sending same reply.
I20260709 13:07:45.032606 21218 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.094461 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.195211 21807 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:45.164445 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 132318us
I20260709 13:07:45.159077 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.124750 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.103199 24370 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.093597 24510 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.001s
I20260709 13:07:45.017609 24356 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.217670 21809 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:45.225080 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.226272 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.005359 24324 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 13:07:45.229084 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.151942 24405 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.225915 21143 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:45.228322 21806 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:45.237355 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.237922 21805 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.103582 24400 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.240016 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:45.244029 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:45.029850 24420 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.112339 24371 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.090410 24221 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:45.253783 21291 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:45.254228 21291 pending_rounds.cc:85] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 3
I20260709 13:07:45.254492 21291 pending_rounds.cc:107] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:45.254762 21291 raft_consensus.cc:2889] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.256726 21807 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:45.226971 21811 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:45.105136 24390 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:45.228050 24510 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.249089 21810 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.229797 21814 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:45.093266 24530 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 13:07:45.224568 24509 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:45.279567 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:45.280546 21144 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:45.228847 24356 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.259456 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.292622 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:45.261726 21150 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:45.264364 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.241695 24400 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.123874 24271 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.252660 24536 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.221776 24370 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.298890 24271 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.299513 23779 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:45.277608 21810 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:45.270815 24405 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.302379 24405 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.303807 24497 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.304467 24405 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.258607 24485 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:45.308279 21292 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:45.308660 21814 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:45.308837 21292 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:45.309077 21814 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:45.308382 21142 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
I20260709 13:07:45.309933 21814 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.310535 21142 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:45.310859 21814 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:45.250497 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 243625us
W20260709 13:07:45.287820 24552 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:07:45.288823 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.295871 24400 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.313632 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.314777 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.315215 24370 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.309952 21292 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.317220 21292 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.293440 21149 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:45.319959 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:45.320082 24536 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.320990 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.321657 21149 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:45.322201 24536 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.322320 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:45.323150 24551 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:45.323891 21292 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:45.297880 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:45.299850 21808 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.324787 21145 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.325986 21145 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:45.311918 21151 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.323124 21149 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:45.260433 24371 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.333930 24371 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.284061 24510 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.258080 24420 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.338402 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.339514 21812 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:45.260413 24221 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.278939 24480 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.344939 21142 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:45.340791 21805 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.278771 24509 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:45.281556 24530 consensus_queue.cc:1243] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:45.367544 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.368237 21805 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:45.348721 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.369107 21143 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:45.364327 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:45.356009 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.370189 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.373311 21808 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.374676 21144 raft_consensus.cc:2368] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
W20260709 13:07:45.348369 24248 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:45.377341 21809 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:45.378336 21778 leader_election.cc:400] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9.
I20260709 13:07:45.387416 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.388259 21805 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.389213 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.294901 24390 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.364948 24419 raft_consensus.cc:2764] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:45.408607 24509 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.409312 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:45.410317 21143 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:45.410511 21778 leader_election.cc:400] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:45.410780 21778 leader_election.cc:403] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.365264 24370 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:45.410698 21143 pending_rounds.cc:85] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 8
I20260709 13:07:45.430675 21143 pending_rounds.cc:107] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:45.431012 21143 raft_consensus.cc:2889] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.431686 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.437258 21805 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:45.438520 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:45.442390 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.442902 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.445387 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.446162 21224 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:45.447445 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.454123 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:45.454927 21221 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.457969 21222 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:45.463236 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.428762 24390 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.470715 24221 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:45.472160 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.481878 21217 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:45.486706 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 236540us
I20260709 13:07:45.447168 24371 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:45.454161 21218 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.522643 21221 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:45.521229 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:45.520308 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:45.491313 24420 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:45.528606 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.491174 24562 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
W20260709 13:07:45.533442 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 275332us
I20260709 13:07:45.551878 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1504) took 1135 ms. Trace:
I20260709 13:07:45.526103 24258 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.532833 24371 consensus_queue.cc:1243] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:45.551524 24421 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.000s
I20260709 13:07:45.574680 21300 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
W20260709 13:07:45.576984 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43740.1us
I20260709 13:07:45.578461 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:45.519639 24400 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:45.582079 24556 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:45.582444 24572 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:45.582975 24572 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.561031 24559 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.570581 24390 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.575335 24429 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.576519 24371 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.598667 24559 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:45.599663 24559 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.602981 24565 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.603458 24570 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.603557 24565 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.604024 24570 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.605831 24565 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.606117 24570 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.584319 24420 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:45.619488 24420 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.607219 24566 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:45.628490 24400 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.567003 24129 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:45.629313 21293 raft_consensus.cc:1217] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-10.6]   Dedup: 6.4->[8.5-10.6]
I20260709 13:07:45.629829 21293 pending_rounds.cc:85] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 4
I20260709 13:07:45.630052 21293 pending_rounds.cc:107] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:45.630283 21293 raft_consensus.cc:2889] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.631657 24262 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:45.632398 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2422) took 1797 ms. Trace:
I20260709 13:07:45.632941 21300 rpcz_store.cc:276] 0709 13:07:43.834572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.834686 (+   114us) service_pool.cc:224] Handling call
0709 13:07:45.632180 (+1797494us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400327b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:45.632325 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3991454976}
I20260709 13:07:45.637355 24536 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:45.592497 24562 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.616130 21226 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:45.612779 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.604379 24424 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:45.641196 24424 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:45.609489 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:45.608652 24456 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:07:45.642179 24424 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.642583 24456 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.643527 24424 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.644275 24261 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.644567 21296 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:45.644840 24456 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.645859 21296 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:45.646281 24572 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.646739 21147 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.616088 24530 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:45.639650 24562 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:45.632246 24262 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.609434 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:45.661101 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 104930us
I20260709 13:07:45.661463 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:45.661840 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:45.662189 21297 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:45.662449 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 219644us
I20260709 13:07:45.663130 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:45.647496 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69118us
I20260709 13:07:45.668570 21114 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:45.640854 24429 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.653760 21814 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:45.670897 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:45.700830 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.703769 21218 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:45.690660 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.707048 21226 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.714175 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.715830 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.719404 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.685497 24356 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:45.609089 24509 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.699368 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.688376 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.729882 24390 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:45.730355 24390 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:45.727994 21221 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:45.687716 24536 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.698242 24405 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.736554 24405 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.739185 24420 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.561581 21220 rpcz_store.cc:276] 0709 13:07:44.416255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.416419 (+   164us) service_pool.cc:224] Handling call
0709 13:07:45.304914 (+888495us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:45.305132 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.305374 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:45.305723 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.551511 (+245788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.551570 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.551627 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.551696 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.551820 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1840,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":29128,"spinlock_wait_cycles":2490112,"thread_start_us":224932,"threads_started":1}
I20260709 13:07:45.738973 24405 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.746927 24536 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:45.748109 24536 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.687510 24371 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.731050 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.661363 24423 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:45.752488 21144 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.752959 24480 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.724980 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.679760 24456 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:45.753829 21148 raft_consensus.cc:2368] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 4. Current term is 5.
I20260709 13:07:45.754431 24423 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:45.751446 24371 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.755059 24423 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:45.755234 24371 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.756042 24423 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.721225 24571 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.758436 21226 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.768774 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2462) took 1079 ms. Trace:
W20260709 13:07:45.765937 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 346641us
W20260709 13:07:45.769922 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.770627 24248 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.761989 24571 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:45.771358 24571 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.771382 24248 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.774106 24248 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.753860 24356 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:45.769284 21225 rpcz_store.cc:276] 0709 13:07:44.689234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.958782 (+269548us) service_pool.cc:224] Handling call
0709 13:07:45.199699 (+240917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.211602 (+ 11903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.768511 (+556909us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000cfdd0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:45.768704 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553347456}
W20260709 13:07:45.778355 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.725489 24572 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:45.803573 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:45.823616 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 152758us
I20260709 13:07:45.825284 21114 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:45.827980 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.831550 21142 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:45.833367 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 132340us
I20260709 13:07:45.834533 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:45.834790 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.836066 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.828812 21147 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:45.842003 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:45.842705 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.856287 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1505) took 1064 ms. Trace:
I20260709 13:07:45.843541 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:45.856329 21226 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.846724 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:45.857682 21145 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:45.857992 24324 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.850456 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:45.853595 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:45.859098 21225 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:45.856611 21221 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:45.854501 24553 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.038s	user 0.007s	sys 0.000s
I20260709 13:07:45.856673 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:45.861322 21147 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:45.847908 21144 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:45.863585 21218 raft_consensus.cc:2368] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:45.856734 21148 rpcz_store.cc:276] 0709 13:07:44.791953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.817405 (+ 25452us) service_pool.cc:224] Handling call
0709 13:07:45.856094 (+1038689us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400065754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:45.856231 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954231168}
I20260709 13:07:45.864002 21114 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:45.865162 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.871482 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:45.852547 24285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.007s	sys 0.007s
I20260709 13:07:45.872272 21219 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:45.884275 24285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.007s	sys 0.007s
I20260709 13:07:45.884843 21220 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:45.884310 21226 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:45.884011 24530 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:45.832629 24356 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.831372 24371 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.902519 24420 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.904912 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.839247 24261 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.907362 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:45.928045 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.929992 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.938388 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:45.939664 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:45.939739 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 240368us
I20260709 13:07:45.946398 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:45.946714 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79733.2us
I20260709 13:07:45.950407 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.899644 24578 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.898496 24221 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.904449 24356 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.965859 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:45.785514 24562 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:45.976825 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 140830us
I20260709 13:07:45.977577 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:45.977965 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:45.971560 21814 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:45.983690 21807 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:45.963188 24560 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.953560 24262 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.970484 24356 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.936864 24261 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:45.927357 24420 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.045902 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.981819 23779 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:46.066610 21814 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:46.068734 24262 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:46.071024 24558 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:46.064817 24597 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:46.071955 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:46.072986 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:46.073611 21805 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:46.075531 24370 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.079944 24420 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:45.973630 24129 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:46.131819 24530 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.096305 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.103149 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 125048us
I20260709 13:07:46.022379 24529 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:46.081692 24575 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 13:07:46.044548 24423 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.080677 24285 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.212888 24285 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.213555 24285 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.106190 24262 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:45.973878 24578 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.109503 23779 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:46.114570 24597 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.210268 24529 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.156028 24524 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.222294 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.241691 24579 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:46.243355 24529 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.243139 24262 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.245244 24580 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:07:46.246730 24583 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 13:07:46.250502 24584 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.205s	user 0.004s	sys 0.000s
I20260709 13:07:46.246930 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1028) took 1021 ms. Trace:
W20260709 13:07:46.220707 24582 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:07:46.255424 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63718.6us
I20260709 13:07:46.254846 21811 rpcz_store.cc:276] 0709 13:07:45.225138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.279940 (+ 54802us) service_pool.cc:224] Handling call
0709 13:07:45.307932 (+ 27992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.549005 (+241073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.549042 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.549524 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.779428 (+229904us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:45.779467 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.779573 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.246651 (+467078us) raft_consensus.cc:1685] finished
0709 13:07:46.246677 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.246858 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30873,"raft.queue_time_us":71631,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6365,"thread_start_us":413921,"threads_started":2,"wal-append.queue_time_us":361550}
I20260709 13:07:46.131286 24595 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:07:46.195667 24588 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:46.302275 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45892.2us
W20260709 13:07:46.379930 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.383579 24423 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:46.386008 24423 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:46.390002 21223 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:46.264591 24524 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:46.393177 21219 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.508s	user 0.016s	sys 0.003s
I20260709 13:07:46.399485 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:46.399572 21219 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:46.399704 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:46.390328 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 318425us
W20260709 13:07:46.397953 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 709451us
W20260709 13:07:46.386942 24509 consensus_meta.cc:287] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.001s
I20260709 13:07:46.401578 21778 leader_election.cc:400] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:46.401844 21778 leader_election.cc:403] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.401873 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:46.404067 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 453712us
I20260709 13:07:46.404831 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:46.391677 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 88490.5us
I20260709 13:07:46.405961 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:46.410609 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 429010us
I20260709 13:07:46.412118 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:46.390086 24591 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.284s	user 0.000s	sys 0.004s
W20260709 13:07:46.397635 24424 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 13:07:46.422442 21145 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:46.414017 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:46.416124 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.423444 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.417224 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.417491 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:46.417840 24480 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:46.413585 24370 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 5. Current term is 6.
I20260709 13:07:46.418258 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:46.388919 24588 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:46.428421 24370 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:46.420979 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:46.428964 24370 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:46.428874 24588 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.430140 24370 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.421593 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1033) took 1130 ms. Trace:
I20260709 13:07:46.424414 24593 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:46.428524 21146 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:46.427150 24601 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:46.434545 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:46.435287 21146 raft_consensus.cc:2368] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:46.435995 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.431613 24587 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.203s
I20260709 13:07:46.429102 21300 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.433048 24419 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.440026 24578 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.444587 21300 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:46.448802 24593 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.456836 24593 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:46.458102 24371 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:46.431429 21806 rpcz_store.cc:276] 0709 13:07:45.291573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.309590 (+ 18017us) service_pool.cc:224] Handling call
0709 13:07:45.309896 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.492575 (+182679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.492604 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.610098 (+117494us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c0004cf78. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:45.610673 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.827742 (+217069us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:45.886620 (+ 58878us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.896517 (+  9897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.896627 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.421309 (+524682us) raft_consensus.cc:1685] finished
0709 13:07:46.421402 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.421528 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39602,"prepare.queue_time_us":56716,"prepare.run_wall_time_us":22648,"raft.queue_time_us":103626,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":50482,"spinlock_wait_cycles":29606400,"thread_start_us":361009,"threads_started":2,"wal-append.queue_time_us":320598}
I20260709 13:07:46.457789 24593 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.465440 24599 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.465867 24587 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.466404 24587 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.467669 24599 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.468093 24599 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.468408 24599 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.468490 24587 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.404422 23779 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.469956 24595 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.470738 24595 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.473125 24261 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.475428 24595 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.424582 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.484032 21145 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:46.451953 24571 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.004s
W20260709 13:07:46.553607 21190 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.612s (SENT)
I20260709 13:07:46.542402 24420 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:46.565769 24420 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.566609 24409 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.506280 24261 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:46.567247 24409 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.567787 24261 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.562803 24129 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.570132 24409 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.570292 24129 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.497949 24424 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:46.564872 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 158984us
I20260709 13:07:46.596172 24424 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.562700 24601 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:46.504776 24571 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.576125 24261 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.577090 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1528) took 1143 ms. Trace:
I20260709 13:07:46.577448 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.597751 21812 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:46.598038 21298 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:46.598268 24424 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.578119 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.598644 24571 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.599054 21296 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:46.505308 24456 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:07:46.567301 24285 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.601544 21148 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:46.602787 24285 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.580492 24324 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.592690 24524 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:46.580051 24420 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.597558 21143 rpcz_store.cc:276] 0709 13:07:45.433557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.433704 (+   147us) service_pool.cc:224] Handling call
0709 13:07:45.456294 (+ 22590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.456555 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.456585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.457129 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.576545 (+1119416us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b180035cc80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1
0709 13:07:46.576679 (+   134us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.576713 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.576783 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.576820 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:46.576829 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.577008 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35008768,"thread_start_us":264050,"threads_started":1,"wal-append.queue_time_us":264176}
W20260709 13:07:46.620368 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 66812.4us
W20260709 13:07:46.621924 21190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.638s (SENT) [suppressed 13 similar messages]
W20260709 13:07:46.627955 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.658548 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.590502 24356 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.675807 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 95526.6us
I20260709 13:07:46.677211 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:46.679904 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 82985us
W20260709 13:07:46.691283 21809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.011s
I20260709 13:07:46.600334 24601 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.693133 21809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.011s
I20260709 13:07:46.695343 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.696177 21295 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:46.696730 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:46.690834 24480 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:46.697283 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:46.702131 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 290071us
W20260709 13:07:46.706306 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 288114us
I20260709 13:07:46.820387 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.820828 24480 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.822892 24598 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:07:46.823071 24285 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:46.823342 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.823658 24285 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.825474 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:46.812094 21300 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:46.830936 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.706468 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:46.763707 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 58213.4us
W20260709 13:07:46.853801 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 52641us
I20260709 13:07:46.849952 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:46.854975 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 157788us
W20260709 13:07:46.786828 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.871754 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.872970 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:46.826218 21218 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:46.873919 21300 raft_consensus.cc:2410] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:46.854847 21226 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:46.874607 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:46.870755 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.869467 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:46.749234 24533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.773s	user 0.017s	sys 0.034s
I20260709 13:07:46.701769 24405 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:46.695375 24129 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.872541 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.824838 24356 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:46.881294 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.881901 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:46.716290 24607 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:46.874570 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.09157e+06us
I20260709 13:07:46.875816 21143 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:46.870936 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:46.887387 21219 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:46.876935 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.888347 21299 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:46.704329 24524 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.867579 21296 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 5: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:46.884490 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:46.885466 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:46.872735 21264 connection.cc:256] RPC call timeout handler was delayed by -1.1959573200000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 13:07:46.888983 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:46.892566 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:46.893221 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:46.898048 21807 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:46.894218 21811 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:46.894544 24619 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:46.897234 21808 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:46.896083 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:46.904816 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.905787 21145 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:46.910374 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:46.699608 24608 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.190s
W20260709 13:07:46.882797 24533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.907s	user 0.017s	sys 0.040s
I20260709 13:07:46.705022 24536 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 13:07:46.916601 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:46.924945 21219 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:46.926127 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:46.927618 21220 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:46.882829 24617 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.886075 24607 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:46.931926 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:46.871744 24370 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:46.896039 24371 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:46.919507 24619 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.906374 24530 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:46.917616 24423 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.923390 24129 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:46.936702 21300 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:46.917448 24623 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.959784 24619 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:46.959968 24623 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:46.960418 24623 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.961256 24390 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.962288 24390 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:46.963714 24620 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:07:46.964193 24554 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.696s	user 0.009s	sys 0.012s
I20260709 13:07:46.940681 24612 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.968604 24612 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.968959 24612 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.969648 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:46.970271 21145 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:46.941165 24371 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.971235 24480 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.971695 24621 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:46.971792 24480 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.950105 24530 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:46.974089 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.975410 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.935175 24261 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.975941 24261 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.918432 24571 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.915313 24405 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:46.926113 24536 consensus_queue.cc:1243] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:46.947327 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:46.957623 24607 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:46.976109 21298 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:46.983593 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.984424 21298 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:46.933969 24356 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.934537 24617 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.947338 24423 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.987083 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:46.994771 21298 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.995975 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:46.996740 21806 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:46.959800 24370 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:46.999694 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52488us
I20260709 13:07:46.984726 24261 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.009084 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:46.996938 24423 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.994256 24617 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.996049 24420 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.011046 21806 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:47.012917 24594 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.640s	user 0.008s	sys 0.000s
W20260709 13:07:47.002247 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 79877.9us
I20260709 13:07:46.976308 24129 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:46.936476 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 314578us
I20260709 13:07:47.000728 24370 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:47.021793 24370 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.023640 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:47.023670 24370 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.024552 21144 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:47.027556 21190 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.780s (SENT)
I20260709 13:07:47.027417 24405 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:47.028236 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:47.031495 24424 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.031884 21813 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:47.033193 21190 leader_election.cc:336] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.978s (SENT)
I20260709 13:07:47.034505 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 631) took 1340 ms. Trace:
W20260709 13:07:47.034875 21190 leader_election.cc:336] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.002s (SENT)
I20260709 13:07:47.035473 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:47.037408 24586 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.921s	user 0.006s	sys 0.014s
I20260709 13:07:47.037663 21291 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:47.038576 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2441) took 1485 ms. Trace:
I20260709 13:07:47.041069 24129 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.004909 24607 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.038933 21292 rpcz_store.cc:276] 0709 13:07:45.553572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.556847 (+  3275us) service_pool.cc:224] Handling call
0709 13:07:45.557210 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.574108 (+ 16898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.574142 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.590313 (+ 16171us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.866562 (+276249us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.866652 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.866719 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.036820 (+1170101us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:47.038284 (+  1464us) raft_consensus.cc:1685] finished
0709 13:07:47.038303 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.038517 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16254,"raft.queue_time_us":19368,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":27020032,"thread_start_us":219022,"threads_started":1,"wal-append.queue_time_us":431419}
I20260709 13:07:47.056054 21298 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:47.006723 24371 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:46.994083 24356 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:47.034896 21150 rpcz_store.cc:276] 0709 13:07:45.694060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.694271 (+   211us) service_pool.cc:224] Handling call
0709 13:07:47.034313 (+1340042us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54001ddb54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:47.034447 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266150144}
I20260709 13:07:47.067114 24533 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:07:47.088614 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53775.6us
I20260709 13:07:47.063476 24424 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.099651 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.062106 24480 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:47.102850 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.121803 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.122509 21805 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
W20260709 13:07:47.125852 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 120670us
I20260709 13:07:47.125865 21190 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.134413 24529 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.143915 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:47.086557 24420 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:47.153846 24529 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.131568 24480 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.162029 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.172608 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:47.130990 24631 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.179497 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.190109 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.190734 21805 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:47.174229 24530 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.177261 24529 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:47.184357 24599 consensus_meta.cc:287] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.000s
W20260709 13:07:47.194554 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 68718.4us
I20260709 13:07:47.196240 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.195019 24420 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:47.201836 24420 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:47.202400 24589 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.157s	user 0.005s	sys 0.008s
I20260709 13:07:47.202653 24420 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.203990 24420 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:47.207736 24629 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:07:47.208068 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.208837 21805 raft_consensus.cc:2393] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:47.214659 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:47.210597 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.207619 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2443) took 1580 ms. Trace:
W20260709 13:07:47.217959 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.218333 21264 connection.cc:256] RPC call timeout handler was delayed by -1.0681573199999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 13:07:47.219141 21805 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.220968 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:47.218618 21264 connection.cc:256] RPC call timeout handler was delayed by -1.0492573200000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:07:47.231889 21264 connection.cc:256] RPC call timeout handler was delayed by -1.0015573199999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:07:47.233898 21806 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:47.216792 21293 rpcz_store.cc:276] 0709 13:07:45.627618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.628768 (+  1150us) service_pool.cc:224] Handling call
0709 13:07:45.629099 (+   331us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:45.630903 (+  1804us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:45.631176 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.831801 (+200625us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.832388 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:07:45.832546 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:45.832583 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.832650 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.158306 (+1325656us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:47.207319 (+ 49013us) raft_consensus.cc:1685] finished
0709 13:07:47.207422 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.207564 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":321,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":8779,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":12754,"spinlock_wait_cycles":26359168,"thread_start_us":116432,"threads_started":1,"wal-append.queue_time_us":286229}
I20260709 13:07:47.193698 24258 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:47.181103 24480 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.241998 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:47.239405 24570 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:07:47.314541 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.246363 21805 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:47.258471 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.264089 24642 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:47.264256 24648 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.276921 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:47.321823 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44985.1us
I20260709 13:07:47.322566 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:47.278167 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:47.323625 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45550.7us
I20260709 13:07:47.278662 24221 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:47.284305 21814 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:47.287523 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 859) took 1375 ms. Trace:
I20260709 13:07:47.238051 24420 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.291934 21813 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:47.236034 24429 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.257984 24258 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.237430 24485 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:47.234146 24599 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.324676 21812 rpcz_store.cc:276] 0709 13:07:45.908447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.908602 (+   155us) service_pool.cc:224] Handling call
0709 13:07:47.283896 (+1375294us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54006c02d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:47.284058 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513972480}
I20260709 13:07:47.312177 24356 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.372215 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.360013 24600 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:47.328153 24639 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.379334 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.364333 24566 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.365471 24571 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.438021 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:47.441484 21143 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:47.441679 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:47.446977 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:47.457801 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 65772.4us
I20260709 13:07:47.469655 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.470973 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:47.475224 21150 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.476958 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:47.497635 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 176751us
I20260709 13:07:47.478578 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.382771 24600 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:47.527177 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:47.441056 24485 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:47.370323 24642 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.528205 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.529793 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.423655 24530 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.423861 24619 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:47.531446 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.535723 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:47.536614 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.540287 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:47.510149 24566 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.537802 21812 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:47.546589 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.547951 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.548810 21812 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:47.390611 24221 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.425355 24356 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:07:47.509286 24654 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:47.529527 24647 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:47.552139 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.557741 21812 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:47.380764 24648 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.532343 24600 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:47.554011 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 130399us
W20260709 13:07:47.565076 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 90343us
I20260709 13:07:47.563197 21150 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:47.564358 21146 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:47.510377 24617 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.570329 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:47.570549 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 398105us
I20260709 13:07:47.571205 21812 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:47.573467 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:47.558660 24623 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:07:47.578469 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:47.581522 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.557126 24647 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:47.586649 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:47.550300 24619 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.590237 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.585404 24656 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:47.585711 24623 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.511168 24639 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:07:47.588439 24649 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:07:47.603834 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 281080us
I20260709 13:07:47.584810 24657 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:47.609161 24624 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.640s	user 0.003s	sys 0.000s
W20260709 13:07:47.610131 24650 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:47.594134 24647 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.589847 24429 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:47.617678 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77443.6us
I20260709 13:07:47.619078 24662 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:47.652083 24656 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.652590 24648 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.677507 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:47.616382 24480 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:47.655372 24607 consensus_meta.cc:287] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
W20260709 13:07:47.655993 24423 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
W20260709 13:07:47.657675 24612 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 13:07:47.677404 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.690412 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:47.635891 24658 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.601624 24566 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:47.603578 24424 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:47.666320 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:47.694073 21298 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:47.679026 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.678241 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.674304 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:47.696061 21297 raft_consensus.cc:2410] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:47.683013 21222 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.653307 24221 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.677994 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:47.668253 24637 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:07:47.611299 24661 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:47.691926 21144 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:47.697870 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:47.676782 24572 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.675241 21049 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:47.689725 24648 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.700536 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:47.701198 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 133739us
I20260709 13:07:47.708478 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.698443 24658 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.724809 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 158069us
I20260709 13:07:47.692854 24424 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:47.699616 24639 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:47.725840 21047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46294 (request call id 378) took 35847 ms (client timeout 15000 ms). Trace:
I20260709 13:07:47.727159 21222 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:47.713933 24221 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:47.728468 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.734710 21049 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.693569 24612 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.691124 24423 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:47.728207 24658 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.701593 24566 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.725513 24667 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:47.626524 24485 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:47.741896 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 155335us
I20260709 13:07:47.702119 24258 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.732534 24424 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:47.726359 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 284177us
I20260709 13:07:47.750156 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:47.743101 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 123018us
I20260709 13:07:47.745030 21049 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 5 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } } }
W20260709 13:07:47.754653 21264 leader_election.cc:336] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.513s (SENT)
I20260709 13:07:47.737408 24221 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:47.755198 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:47.723364 24572 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.759896 21148 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.760094 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:47.761222 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.727492 24648 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.743733 24642 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.758761 24221 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:47.765321 24390 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.003s
I20260709 13:07:47.765646 24611 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.744469 24670 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.766433 21049 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 7, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 7 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.767603 24669 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:47.824698 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.770177 24423 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.770840 21150 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:47.852070 21150 pending_rounds.cc:85] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 7
I20260709 13:07:47.852449 21150 pending_rounds.cc:107] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:47.852689 21150 raft_consensus.cc:2889] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.766100 24480 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:47.772797 24572 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.773002 24419 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:07:47.773500 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.859503 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.775183 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:47.732354 21047 rpcz_store.cc:269] 0709 13:07:11.866956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.867210 (+   254us) service_pool.cc:224] Handling call
0709 13:07:47.714316 (+35847106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:43.627430 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:43.687662 (+ 60232us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:43.687734 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:07:43.687751 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:43.688404 (+   653us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:43.688472 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:43.688498 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:43.688957 (+   459us) tablet.cc:701] Row locks acquired
0709 13:07:43.689008 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:43.689185 (+   177us) write_op.cc:270] Start()
0709 13:07:43.689327 (+   142us) write_op.cc:276] Timestamp: P: 1783602463689120 usec, L: 0
0709 13:07:43.689349 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:43.718187 (+ 28838us) log.cc:844] Serialized 1303 byte log entry
0709 13:07:44.092039 (+373852us) op_driver.cc:464] REPLICATION: finished
0709 13:07:44.201149 (+109110us) write_op.cc:301] APPLY: starting
0709 13:07:44.201288 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:44.201477 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:44.201630 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:44.202272 (+   642us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:44.213513 (+ 11241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:07:44.213581 (+    68us) write_op.cc:312] APPLY: finished
0709 13:07:44.213902 (+   321us) log.cc:844] Serialized 35 byte log entry
0709 13:07:44.215429 (+  1527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.215528 (+    99us) write_op.cc:454] Released schema lock
0709 13:07:44.215582 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:44.218530 (+  2948us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.218561 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1376724,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":108703,"apply.run_cpu_time_us":2715,"apply.run_wall_time_us":17383,"num_ops":3,"prepare.queue_time_us":131330,"prepare.run_cpu_time_us":24042,"prepare.run_wall_time_us":173342,"raft.queue_time_us":70569,"raft.run_cpu_time_us":43106,"raft.run_wall_time_us":120078,"replication_time_us":391364,"spinlock_wait_cycles":77568,"thread_start_us":201863,"threads_started":4,"wal-append.queue_time_us":90412,"wal-append.run_cpu_time_us":45619,"wal-append.run_wall_time_us":1413694}]]}
I20260709 13:07:47.777979 21263 leader_election.cc:400] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
W20260709 13:07:47.861115 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 83273.1us
I20260709 13:07:47.778512 24675 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:47.755434 24617 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.749595 24667 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.780128 24324 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:47.780037 24424 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:47.781865 24596 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.386s	user 0.008s	sys 0.006s
I20260709 13:07:47.782021 21264 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:47.876772 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 94811.3us
I20260709 13:07:47.877224 21263 leader_election.cc:400] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:47.877560 21263 leader_election.cc:403] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:47.782796 21219 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.788646 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.764328 24656 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.856721 21223 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:47.860446 24566 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:47.860502 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 132137us
I20260709 13:07:47.821034 24619 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.866482 21049 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 5 to 6, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.868623 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:47.875501 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 122009us
W20260709 13:07:47.864256 24261 consensus_meta.cc:287] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.852s	user 0.007s	sys 0.004s
W20260709 13:07:47.877759 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.865145 24661 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:47.874466 24324 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.855790 24480 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.883049 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:47.888163 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.893468 21222 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
W20260709 13:07:47.875847 24597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.484s	user 0.022s	sys 0.031s
I20260709 13:07:47.896662 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:47.896361 21049 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 5 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.894712 24656 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:47.864051 24419 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.886983 24662 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:47.903784 24673 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:47.904047 24648 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.904462 24678 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.885145 24647 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.887549 24663 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:47.892835 24675 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.889688 24661 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.952308 24612 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:47.907191 24658 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.970276 24600 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.894919 24480 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.972675 24600 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.931641 24258 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.977228 24669 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.977447 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:47.901228 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.980125 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.981125 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:47.982105 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:47.928850 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:47.982839 21812 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:47.889900 24572 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:47.915313 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:47.984689 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 69499.9us
I20260709 13:07:47.984797 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:47.931782 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:47.880249 24674 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:07:47.948096 24597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.560s	user 0.022s	sys 0.031s
I20260709 13:07:47.951066 24611 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.977310 24599 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.996428 24258 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.996151 24611 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.996968 24258 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.998656 24611 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.932374 24424 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.998945 24258 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.954952 24662 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:47.995862 24480 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.000483 24530 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.000928 24530 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.001268 24530 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.001524 24647 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.000003 24662 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.002764 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:47.955482 24656 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.958156 21049 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:47.931047 24646 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.653s	user 0.000s	sys 0.007s
I20260709 13:07:47.892443 24261 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:47.947783 24619 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.927206 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:47.949385 24566 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.027951 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3585d99c303e453c8c3762b294caba4e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:47.967764 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 90651.4us
I20260709 13:07:48.029165 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:47.974659 24419 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:47.961954 24678 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:48.011883 24622 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.120s	user 0.003s	sys 0.003s
I20260709 13:07:47.992992 24639 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:47.981122 24529 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.003s
W20260709 13:07:47.959942 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 74839.6us
I20260709 13:07:47.999986 24667 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:47.983459 24572 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.995852 24657 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.007294 24480 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:48.009933 21049 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:47.966667 24679 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:48.016899 24221 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:47.967720 24661 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.024274 21814 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:48.027804 24566 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:47.951829 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 68909.5us
I20260709 13:07:47.992244 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.033910 24619 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.040481 24658 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.201292 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:48.040591 24324 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.047636 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.049878 24675 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:48.050695 24428 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.052117 21223 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.061796 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 604) took 1210 ms. Trace:
I20260709 13:07:48.172874 24590 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.190801 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.189953 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.077425 24674 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:48.185812 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:48.232016 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46291.7us
I20260709 13:07:48.191164 21049 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 5 to 6, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.233444 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.234263 21049 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:48.235440 24480 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:48.235971 24480 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:48.236694 24613 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.352s	user 0.002s	sys 0.003s
I20260709 13:07:48.236840 24480 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:48.237589 21147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1532) took 1824 ms (client timeout 1876 ms). Trace:
W20260709 13:07:48.237991 21147 rpcz_store.cc:269] 0709 13:07:46.413403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.413661 (+   258us) service_pool.cc:224] Handling call
0709 13:07:48.237404 (+1823743us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400066154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:48.237535 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606327552}
I20260709 13:07:48.239050 24566 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.239410 24611 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.239840 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.241726 24619 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.243242 21809 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.243484 24324 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.244067 24285 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.245158 24221 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.246165 21146 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.195039 24639 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:48.200124 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.202373 21807 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:48.205509 21263 connection.cc:256] RPC call timeout handler was delayed by -2.1933952399999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:07:48.190551 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:48.250558 21263 connection.cc:256] RPC call timeout handler was delayed by -1.8729952400000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:07:48.250586 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:48.250982 21263 connection.cc:256] RPC call timeout handler was delayed by -1.8729952400000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:07:48.250690 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
W20260709 13:07:48.251410 21263 connection.cc:256] RPC call timeout handler was delayed by -1.6155952400000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:07:48.209096 21292 rpcz_store.cc:276] 0709 13:07:46.851189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.043795 (+192606us) service_pool.cc:224] Handling call
0709 13:07:47.044095 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.082368 (+ 38273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.082401 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.082930 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.118536 (+ 35606us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:47.319118 (+200582us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.433412 (+114294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.433494 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.059895 (+626401us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b180007f240. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:48.061510 (+  1615us) raft_consensus.cc:1685] finished
0709 13:07:48.061603 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.061735 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":408869,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3383,"raft.queue_time_us":207477,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":27422,"spinlock_wait_cycles":12771712,"thread_start_us":353740,"threads_started":4,"wal-append.queue_time_us":103064}
I20260709 13:07:48.053807 24419 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:48.192467 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.212117 21299 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:48.212551 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.199147 24593 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.255275 21812 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:48.256331 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.256691 21809 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:48.257153 21812 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:48.188402 24656 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.209290 24679 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:07:48.196866 24529 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.274358 24661 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.275557 21222 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:48.246676 24590 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.278000 24590 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.260587 24419 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.254683 24639 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.280462 24419 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.283617 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.284196 21807 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.284567 21299 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:48.286413 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.287115 21291 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.288813 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.289618 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.291415 24657 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.291808 24657 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.292136 24657 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.260973 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.292883 21812 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:48.293720 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.294680 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.275068 24529 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.295444 24651 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:48.295879 24651 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.221956 24678 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.223542 24642 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:48.223843 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2476) took 1398 ms. Trace:
W20260709 13:07:48.219245 24655 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.665s	user 0.001s	sys 0.001s
I20260709 13:07:48.199714 24572 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.225545 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1044) took 1135 ms. Trace:
I20260709 13:07:48.227224 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:48.306493 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 79347.2us
I20260709 13:07:48.228293 24654 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.305497 21813 rpcz_store.cc:276] 0709 13:07:47.090313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.120073 (+ 29760us) service_pool.cc:224] Handling call
0709 13:07:48.225374 (+1105301us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5400789954. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:48.225477 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4041984}
I20260709 13:07:48.308382 24654 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:48.308943 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.309690 21813 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.310460 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.310981 21813 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:48.229377 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.234843 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:48.317042 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82255.9us
I20260709 13:07:48.317737 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.239634 24566 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:48.066623 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.318989 21224 raft_consensus.cc:2410] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:48.094769 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.295706 24529 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:48.267422 24682 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:48.299383 21297 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:48.331759 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.299829 21223 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:48.300617 21807 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:48.296248 24651 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.333295 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.307931 24635 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:48.309010 24654 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.337476 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.229004 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.339184 21811 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:48.321421 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.339924 21813 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.064459 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:48.323055 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:48.325580 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 230912us
I20260709 13:07:48.319543 24419 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.261720 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.328223 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.328217 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.326499 24221 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.330425 21142 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.300668 21221 rpcz_store.cc:276] 0709 13:07:46.825652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.856915 (+ 31263us) service_pool.cc:224] Handling call
0709 13:07:46.867950 (+ 11035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.880157 (+ 12207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.880219 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.881293 (+  1074us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.090016 (+208723us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:47.131046 (+ 41030us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.182850 (+ 51804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.182947 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.221601 (+1038654us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b180041b5a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:48.223571 (+  1970us) raft_consensus.cc:1685] finished
0709 13:07:48.223664 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.223788 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9057,"prepare.queue_time_us":66351,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":43182,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9719,"spinlock_wait_cycles":6308736,"thread_start_us":193921,"threads_started":2,"wal-append.queue_time_us":230931}
I20260709 13:07:48.334131 21148 raft_consensus.cc:2410] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:48.332366 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.301785 24642 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:48.335716 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:48.335872 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 186555us
I20260709 13:07:48.212595 24428 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.321728 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:48.352741 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:48.368433 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 106788us
I20260709 13:07:48.356528 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.369367 21221 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:48.357164 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.365064 21814 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:48.319945 24566 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:48.367508 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.329082 24590 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:48.371488 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:48.372489 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50858.6us
I20260709 13:07:48.376993 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.331228 24682 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.379357 21147 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.369429 24687 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.380556 24687 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:48.380664 24428 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.354491 24679 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:48.381963 21811 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:48.382611 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 967) took 1161 ms. Trace:
I20260709 13:07:48.382905 21811 rpcz_store.cc:276] 0709 13:07:47.221534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.354393 (+1132859us) service_pool.cc:224] Handling call
0709 13:07:48.381649 (+ 27256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.382392 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.382562 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.385788 21808 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.386368 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 970) took 1121 ms. Trace:
I20260709 13:07:48.320526 24424 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:48.389017 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.389292 24261 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.389812 21150 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.390659 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.391808 24674 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:48.392371 24674 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.393190 24657 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.394577 24674 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.381503 24687 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.404265 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:48.397147 21217 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:48.397552 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.405297 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:48.398890 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.406469 21297 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.400920 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.407559 21263 leader_election.cc:400] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:48.408303 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:48.386668 21808 rpcz_store.cc:276] 0709 13:07:47.264689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.385363 (+1120674us) service_pool.cc:224] Handling call
0709 13:07:48.385615 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.386170 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.386320 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.409021 24663 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:48.399459 21189 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:48.402768 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.353513 24423 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:07:48.380764 24682 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:48.409757 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.445868 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 960) took 1292 ms. Trace:
I20260709 13:07:48.452440 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.444859 21808 raft_consensus.cc:1217] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-8.9]   Dedup: 5.7->[6.8-8.9]
W20260709 13:07:48.451040 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 51661.3us
I20260709 13:07:48.453784 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.365513 24656 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:48.471400 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.418596 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.448509 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.402878 21813 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:48.472940 21811 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.398578 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:48.459270 21297 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:48.464146 21808 pending_rounds.cc:85] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
I20260709 13:07:48.474967 21808 pending_rounds.cc:107] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:48.475342 21808 raft_consensus.cc:2889] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.467342 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.468124 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:48.470275 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45895.9us
I20260709 13:07:48.470718 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.463070 21806 rpcz_store.cc:276] 0709 13:07:47.153939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.235566 (+ 81627us) service_pool.cc:224] Handling call
0709 13:07:47.259042 (+ 23476us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:47.259451 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.259482 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:47.260039 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:07:47.442729 (+182690us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.583437 (+140708us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.583656 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.584971 (+  1315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.218515 (+633544us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:48.410537 (+192022us) raft_consensus.cc:1685] finished
0709 13:07:48.445671 (+ 35134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.445798 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159294,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3205,"raft.queue_time_us":7103,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":3810,"spinlock_wait_cycles":6994816,"thread_start_us":242426,"threads_started":2,"wal-append.queue_time_us":220507}
I20260709 13:07:48.405330 21143 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:48.477494 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:48.478873 21221 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:48.461841 21150 raft_consensus.cc:2368] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:48.485011 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.480248 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:48.476647 21220 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:48.485569 21296 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.483992 24675 raft_consensus.cc:2764] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:48.448352 24688 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
I20260709 13:07:48.412820 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:48.404069 24400 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:48.548306 21147 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:48.397146 24578 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.484516 24657 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.372527 24635 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:07:48.494064 21224 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:48.572588 21224 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:48.573827 21224 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:48.574380 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.574952 21148 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:48.549465 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72068.6us
I20260709 13:07:48.539726 21221 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:48.551992 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 71825.1us
I20260709 13:07:48.410549 24419 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:48.450345 24530 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.488137 21813 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:48.488498 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:48.555037 21806 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.448165 24661 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.397251 24590 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:48.450789 24221 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:07:48.457023 24129 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:48.548954 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 150447us
I20260709 13:07:48.374332 24566 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.588454 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.589879 21147 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:48.449846 24662 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.593590 21296 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:48.386878 24639 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.596029 21221 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.568893 23779 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.570075 24683 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.578325 24656 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.444700 24429 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:07:48.599198 24590 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.609665 24674 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:48.627669 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44014.9us
I20260709 13:07:48.450205 24642 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.626617 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.640102 24562 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.641481 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2477) took 1814 ms. Trace:
I20260709 13:07:48.594424 24480 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:48.641960 23779 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:48.641880 24419 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:48.568310 24400 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.672226 24654 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.672729 24400 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.595009 24570 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:48.659814 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:48.630985 24661 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.664031 21298 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.661779 21806 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.664959 21225 rpcz_store.cc:276] 0709 13:07:46.827899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.852581 (+ 24682us) service_pool.cc:224] Handling call
0709 13:07:46.852899 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.926917 (+ 74018us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:46.926947 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.936629 (+  9682us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.081327 (+144698us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:47.081383 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.641116 (+1559733us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b54002391d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:48.641163 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.641208 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:48.641222 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.641424 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3533,"raft.queue_time_us":14057,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8805,"spinlock_wait_cycles":139477248,"thread_start_us":98431,"threads_started":1,"wal-append.queue_time_us":337813}
I20260709 13:07:48.676695 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.673199 24651 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.677750 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.680258 21218 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:48.673295 21224 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.673569 24570 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.684446 24570 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.685339 24698 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.685938 24698 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.686311 24698 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.660813 24682 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.667308 24656 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:48.669652 23779 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.685462 24600 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:48.689498 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:48.675575 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2087) took 1434 ms. Trace:
I20260709 13:07:48.703694 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.704609 21809 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.636132 24663 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:48.692349 21806 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:48.707707 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.708235 21220 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.709273 21806 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.695617 21300 rpcz_store.cc:276] 0709 13:07:47.241305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.241416 (+   111us) service_pool.cc:224] Handling call
0709 13:07:47.241661 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.390228 (+148567us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:47.603445 (+213217us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.726678 (+123233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.726744 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:47.726808 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.675368 (+948560us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540001b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:48.675410 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.675523 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7346,"prepare.queue_time_us":162018,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":12336,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7837,"spinlock_wait_cycles":341155200,"thread_start_us":274469,"threads_started":2,"wal-append.queue_time_us":134307}
W20260709 13:07:48.675064 24681 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.711s	user 0.000s	sys 0.008s
I20260709 13:07:48.719153 21806 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:48.722785 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1049) took 1054 ms. Trace:
I20260709 13:07:48.723399 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.723567 21147 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:48.723167 21813 rpcz_store.cc:276] 0709 13:07:47.668024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.601743 (+933719us) service_pool.cc:224] Handling call
0709 13:07:48.609155 (+  7412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.609355 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:48.643426 (+ 34071us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.722324 (+ 78898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.722375 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.722421 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.722483 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.722710 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1672,"prepare.queue_time_us":38610,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":76693,"threads_started":1}
I20260709 13:07:48.726953 21806 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:48.728440 21190 leader_election.cc:336] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.638s (SENT)
I20260709 13:07:48.728905 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:48.729077 21809 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:48.731655 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.732611 21813 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.732899 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.676399 24662 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.740552 21806 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:48.736727 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.741843 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.737738 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.738451 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.738878 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.696439 24651 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.744094 21297 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:48.688413 24656 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.707123 24600 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:48.741914 21264 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:48.745177 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:48.746950 21226 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:48.713883 24642 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:48.748953 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.752948 21813 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:48.687150 24572 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.673990 24661 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.753777 21806 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.737550 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1050) took 1052 ms. Trace:
I20260709 13:07:48.761475 24566 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.762564 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.764746 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:48.745623 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:48.689491 24674 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.742867 24695 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.745944 24262 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.771539 21813 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:48.705312 24480 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.774060 21297 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:48.830452 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.769224 21809 rpcz_store.cc:276] 0709 13:07:47.684867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.736602 (+1051735us) service_pool.cc:224] Handling call
0709 13:07:48.736883 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.737246 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.737281 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.737323 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.737353 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.737407 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.737500 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.746130 24390 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.647853 24683 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.893131 21297 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:48.747094 24682 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:48.748072 24612 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.817054 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.755887 24662 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.769423 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:07:48.885242 24681 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.008s
W20260709 13:07:48.923449 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 154126us
I20260709 13:07:48.926504 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:48.927563 21809 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:48.884985 24607 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.929630 21809 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.815582 24578 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:48.747202 24423 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:48.772755 24639 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.901916 24682 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:48.772305 24530 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.885658 21812 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:48.886624 21294 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.887530 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:48.941027 21295 raft_consensus.cc:2410] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:48.888533 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:48.890560 24693 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:48.836905 24262 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.884302 24600 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.935547 24611 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:48.816926 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75083.4us
W20260709 13:07:48.919831 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 175821us
I20260709 13:07:48.827883 21148 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:48.931778 21225 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:48.890607 24566 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:48.937356 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 121399us
I20260709 13:07:48.939294 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:48.954586 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:48.959491 24611 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:48.818949 24658 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.963385 24262 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:48.963598 24658 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:48.940752 24682 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:48.935348 24607 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.955135 21150 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:07:48.775499 24684 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.923671 24390 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:48.958875 24639 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.962320 24654 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:48.954903 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:48.972865 24616 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 2.082s	user 0.005s	sys 0.000s
W20260709 13:07:48.974072 24700 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.145s	user 0.000s	sys 0.007s
I20260709 13:07:48.892894 24663 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:48.992662 21264 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.997776 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:48.949955 24707 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:07:48.963999 24611 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.004446 21807 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:07:49.149642 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 188351us
W20260709 13:07:49.287267 21263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.024s	sys 0.026s
W20260709 13:07:49.414366 21263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.028s	sys 0.026s
W20260709 13:07:49.414654 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 725937us
I20260709 13:07:49.416306 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:48.985914 24420 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:49.212842 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1914) took 2149 ms. Trace:
I20260709 13:07:49.424619 21149 rpcz_store.cc:276] 0709 13:07:46.969616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.970102 (+   486us) service_pool.cc:224] Handling call
0709 13:07:46.970358 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.973764 (+  3406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.973794 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.973838 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.973875 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.118320 (+2144445us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b540017b954. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:49.118389 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.118558 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7405312}
I20260709 13:07:49.115156 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:49.413563 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:49.426640 21221 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:49.093084 24370 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.215729 24700 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:07:49.001191 24423 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.274314 24661 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.242348 24572 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:49.473004 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 59550.9us
W20260709 13:07:49.279579 24693 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:48.988250 24639 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.386734 24674 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.049932 24708 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.428853 24420 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:48.998121 24658 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:49.495729 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 492884us
W20260709 13:07:49.453863 21226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.022s
W20260709 13:07:49.496721 21226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.004s	sys 0.026s
I20260709 13:07:49.472361 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:49.090780 24429 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.248795 24702 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.415493 24480 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.482664 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:49.487129 24562 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.010s
I20260709 13:07:49.498107 21221 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:49.475797 24710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.013s
W20260709 13:07:49.484164 24590 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.003s
I20260709 13:07:49.481323 24423 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:49.521996 21810 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:49.504297 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:49.485831 24262 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.480432 24530 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:49.501300 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.010s	sys 0.041s
I20260709 13:07:49.481182 24623 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.520160 21221 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
W20260709 13:07:49.521112 21300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.016s	sys 0.047s
I20260709 13:07:49.501405 24420 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:49.512044 24710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.013s
W20260709 13:07:49.525669 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.011s	sys 0.042s
W20260709 13:07:49.540014 21300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.016s	sys 0.047s
W20260709 13:07:49.576241 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 621686us
I20260709 13:07:49.504523 24674 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:49.577934 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:49.481595 24370 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.524034 24262 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:49.523636 24571 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.583930 24708 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:49.584647 24712 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:07:49.598392 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2107) took 1145 ms. Trace:
I20260709 13:07:49.537382 24683 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.598964 21298 rpcz_store.cc:276] 0709 13:07:48.453270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.453466 (+   196us) service_pool.cc:224] Handling call
0709 13:07:48.453795 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.674175 (+220380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.598072 (+923897us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400328554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:49.598306 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483078912}
W20260709 13:07:49.610795 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 649) took 1633 ms (client timeout 1832 ms). Trace:
I20260709 13:07:49.612049 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.614948 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 508) took 1938 ms. Trace:
I20260709 13:07:49.617316 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2486) took 1676 ms. Trace:
I20260709 13:07:49.624398 21220 rpcz_store.cc:276] 0709 13:07:47.940838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.565574 (+624736us) service_pool.cc:224] Handling call
0709 13:07:48.696621 (+131047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.713468 (+ 16847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.617087 (+903619us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400116a50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.617246 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274189568}
I20260709 13:07:49.618356 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1548) took 1232 ms. Trace:
I20260709 13:07:49.625878 21150 rpcz_store.cc:276] 0709 13:07:48.386247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.602298 (+216051us) service_pool.cc:224] Handling call
0709 13:07:48.954902 (+352604us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.978530 (+ 23628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.618130 (+639600us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540017dc50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.618286 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810024704}
I20260709 13:07:49.505877 24702 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.623451 21219 rpcz_store.cc:276] 0709 13:07:47.676568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.677547 (+   979us) service_pool.cc:224] Handling call
0709 13:07:47.677818 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.878109 (+200291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.614658 (+1736549us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002382d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:49.614874 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241029376}
I20260709 13:07:49.524946 24590 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:49.621260 21146 rpcz_store.cc:269] 0709 13:07:47.977067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.977188 (+   121us) service_pool.cc:224] Handling call
0709 13:07:49.610542 (+1633354us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540031bfd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.610721 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615952128}
I20260709 13:07:49.587025 24623 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:49.636236 24578 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.605563 24639 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:49.580489 24716 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:49.664746 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 179887us
I20260709 13:07:49.674655 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:49.676159 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:49.678563 21223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.035s	sys 0.087s
W20260709 13:07:49.678972 21223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.035s	sys 0.087s
I20260709 13:07:49.619835 24571 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.685140 21147 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:49.665520 24721 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.673733 24716 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.660892 24710 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:49.684625 24674 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:49.688513 24572 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.685214 24480 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:49.685532 24639 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:49.704281 24480 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:49.704717 24480 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.707413 24639 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.708381 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 969) took 2468 ms. Trace:
I20260709 13:07:49.709076 21811 rpcz_store.cc:276] 0709 13:07:47.239906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.383738 (+1143832us) service_pool.cc:224] Handling call
0709 13:07:48.472760 (+ 89022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.473386 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.708190 (+1234804us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b54006a04d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.708326 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204071808}
I20260709 13:07:49.709650 24639 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:49.710839 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 977) took 1058 ms. Trace:
W20260709 13:07:49.711890 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 858) took 3803 ms (client timeout 1513 ms). Trace:
W20260709 13:07:49.712324 21810 rpcz_store.cc:269] 0709 13:07:45.908049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.908194 (+   145us) service_pool.cc:224] Handling call
0709 13:07:49.711603 (+3803409us) spinlock_profiling.cc:243] Waited 3.58 s on lock 0x7b54005136d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.711805 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8236140288}
I20260709 13:07:49.713941 21810 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEARNER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:49.714516 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 979) took 1021 ms. Trace:
I20260709 13:07:49.716504 24480 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.716985 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1934) took 1048 ms. Trace:
I20260709 13:07:49.717327 21147 rpcz_store.cc:276] 0709 13:07:48.668955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.730441 (+ 61486us) service_pool.cc:224] Handling call
0709 13:07:48.749239 (+ 18798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.688962 (+939723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.716788 (+ 27826us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540017c354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:49.716932 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148929792}
I20260709 13:07:49.718641 24480 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.719988 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 882) took 1856 ms. Trace:
I20260709 13:07:49.720430 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.644636 24423 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.722852 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.722983 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:49.724222 21812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1057) took 1536 ms (client timeout 1943 ms). Trace:
I20260709 13:07:49.724529 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:49.724756 21812 rpcz_store.cc:269] 0709 13:07:48.187782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.294481 (+106699us) service_pool.cc:224] Handling call
0709 13:07:49.724007 (+1429526us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540035aa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.724160 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234591104}
I20260709 13:07:49.726112 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.726490 21809 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:49.726644 21300 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:49.727010 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.727682 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 891) took 1075 ms. Trace:
I20260709 13:07:49.728722 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.729554 24597 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.729912 24597 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:49.728006 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:49.729456 21291 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:49.731333 21294 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:49.732563 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.733301 21292 raft_consensus.cc:2410] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:49.738601 24390 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.696904 24716 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.740185 24658 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.746618 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1052) took 1574 ms. Trace:
I20260709 13:07:49.669850 24262 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.747905 24262 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.749753 24371 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.750164 24698 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.063s	user 0.005s	sys 0.005s
I20260709 13:07:49.750375 24371 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.751293 24356 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.751854 24356 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:49.753037 24371 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:49.756801 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.757141 24370 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.730666 24597 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:49.760872 21217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 513) took 1968 ms (client timeout 1714 ms). Trace:
W20260709 13:07:49.761353 21217 rpcz_store.cc:269] 0709 13:07:47.792499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.850954 (+ 58455us) service_pool.cc:224] Handling call
0709 13:07:49.760651 (+1909697us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540038c054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.760792 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234938624}
W20260709 13:07:49.762183 24682 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.778s	user 0.004s	sys 0.002s
I20260709 13:07:49.762574 24682 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.672607 24623 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.764413 24524 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.764918 24524 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:49.674433 24578 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.766861 24578 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.708513 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1517) took 1387 ms. Trace:
I20260709 13:07:49.767762 21224 rpcz_store.cc:276] 0709 13:07:48.320802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.589218 (+268416us) service_pool.cc:224] Handling call
0709 13:07:48.589531 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.681852 (+ 92321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.708264 (+1026412us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54000ed3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:49.708456 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192263552}
I20260709 13:07:49.683722 24562 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:49.772481 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 885) took 1906 ms. Trace:
I20260709 13:07:49.728163 21809 rpcz_store.cc:276] 0709 13:07:48.652128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.930830 (+278702us) service_pool.cc:224] Handling call
0709 13:07:49.726323 (+795493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.726845 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.727453 (+   608us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540035aa50. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.727617 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828702976}
I20260709 13:07:49.772979 21806 rpcz_store.cc:276] 0709 13:07:47.865751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.741551 (+875800us) service_pool.cc:224] Handling call
0709 13:07:48.753551 (+ 12000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.768782 (+ 15231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.772279 (+1003497us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54004fa1d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.772413 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26927360}
I20260709 13:07:49.752764 24356 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.720463 21807 rpcz_store.cc:276] 0709 13:07:47.863064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.337171 (+474107us) service_pool.cc:224] Handling call
0709 13:07:49.719779 (+1382608us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400788cd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.719924 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530962176}
I20260709 13:07:49.711190 21811 rpcz_store.cc:276] 0709 13:07:48.652724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.710083 (+1057359us) service_pool.cc:224] Handling call
0709 13:07:49.710386 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.710559 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.710584 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.710621 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:49.710652 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.710702 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.710788 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.747146 21813 rpcz_store.cc:276] 0709 13:07:48.172680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.837272 (+664592us) service_pool.cc:224] Handling call
0709 13:07:48.893573 (+ 56301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.903401 (+  9828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.903517 (+   116us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.920762 (+ 17245us) log.cc:844] Serialized 52 byte log entry
0709 13:07:49.150175 (+229413us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:49.239711 (+ 89536us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.745629 (+505918us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b180020dd00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:07:49.745868 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.746107 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.746201 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.746348 (+   147us) raft_consensus.cc:1685] finished
0709 13:07:49.746367 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.746545 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":511396,"prepare.queue_time_us":597070,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":118,"raft.queue_time_us":21786,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":12503,"spinlock_wait_cycles":166543104,"thread_start_us":207790,"threads_started":1,"wal-append.queue_time_us":662170}
I20260709 13:07:49.787392 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.785972 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:49.784900 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:49.714835 21810 rpcz_store.cc:276] 0709 13:07:48.693718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.713307 (+1019589us) service_pool.cc:224] Handling call
0709 13:07:49.713628 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.714276 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.714458 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.788239 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:49.788834 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:49.790239 21806 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:49.788002 21293 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:49.791206 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:49.792783 21298 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:49.738663 24662 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.806s	user 0.005s	sys 0.003s
I20260709 13:07:49.795392 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.796046 21298 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:49.700577 24674 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:49.797374 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.764763 24623 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:49.798872 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:49.750591 24698 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } }
W20260709 13:07:49.792508 24695 consensus_meta.cc:287] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.000s
I20260709 13:07:49.765906 24524 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.832113 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:49.789775 24647 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.787079 24723 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.786885 24648 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.838819 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:49.840047 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 343048us
I20260709 13:07:49.792500 24639 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.795096 24572 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:49.820323 24480 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:49.851188 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 434960us
I20260709 13:07:49.794790 24258 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.797034 24530 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:49.819737 24662 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.871778 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:49.835451 24562 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.832372 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:49.881309 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49038.3us
I20260709 13:07:49.882184 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:49.838754 24695 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.894804 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:49.896410 21263 leader_election.cc:400] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:07:49.901096 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:49.902451 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:49.903083 21226 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:07:49.867316 24524 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.874872 24642 consensus_meta.cc:287] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.119s	user 0.010s	sys 0.001s
I20260709 13:07:49.909796 21299 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.910068 21298 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:49.908124 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:49.912673 21224 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:49.914274 21217 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:49.918835 21809 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:49.920022 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:49.920547 21295 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:49.921056 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:49.845297 24647 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.891600 24562 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.906349 24623 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:49.926213 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.892256 24725 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.894227 24258 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:49.924710 24726 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:49.925127 24727 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:49.866320 24723 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.869766 24639 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.927170 24642 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.867561 24648 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:49.953619 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.912477 24695 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.919703 24662 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:49.931562 24635 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:49.944804 24480 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.927390 24623 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:49.927642 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:49.964820 24623 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.931608 24572 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.942538 24420 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.940424 24698 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.942483 24590 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:49.964114 24662 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:49.941509 24639 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:49.944588 24701 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.054s	user 0.004s	sys 0.024s
I20260709 13:07:49.941026 24642 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:49.969210 24662 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.930632 24258 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.969537 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 968) took 2733 ms. Trace:
I20260709 13:07:49.970392 24642 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.970826 24420 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:49.926817 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 44750.1us
I20260709 13:07:49.951619 24530 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.929970 24725 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:49.992264 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:49.994102 24725 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:49.994904 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:49.874328 24674 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:49.995882 24674 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.996436 21143 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:49.997581 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:49.998126 21146 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.998461 24607 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.000900 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.001618 21150 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:49.991123 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1524) took 1246 ms. Trace:
W20260709 13:07:50.003911 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3585d99c303e453c8c3762b294caba4e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:50.003720 21222 rpcz_store.cc:276] 0709 13:07:48.744439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.745236 (+   797us) service_pool.cc:224] Handling call
0709 13:07:49.762483 (+1017247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.762701 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.762737 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.762791 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.762844 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.762915 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.990940 (+228025us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b540038c050. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:49.991063 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296921856}
I20260709 13:07:50.005373 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.005986 21151 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:49.934478 24702 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:50.012679 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1516) took 1693 ms. Trace:
I20260709 13:07:49.970005 21814 rpcz_store.cc:276] 0709 13:07:47.236113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.374854 (+1138741us) service_pool.cc:224] Handling call
0709 13:07:48.459214 (+ 84360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.459621 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.459661 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.485220 (+ 25559us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.665239 (+180019us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.665280 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.665347 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.944071 (+1278724us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:49.969252 (+ 25181us) raft_consensus.cc:1685] finished
0709 13:07:49.969273 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.969481 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":507,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":15039,"spinlock_wait_cycles":5575936,"thread_start_us":69135,"threads_started":1,"wal-append.queue_time_us":221824}
I20260709 13:07:50.014360 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:50.013051 21218 rpcz_store.cc:276] 0709 13:07:48.320508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.471105 (+150597us) service_pool.cc:224] Handling call
0709 13:07:50.012480 (+1541375us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540039b2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:50.012621 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478190464}
W20260709 13:07:50.015062 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 370329us
I20260709 13:07:49.919724 24656 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.017730 21146 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:50.027515 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:49.934288 24724 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:50.030618 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.031337 21222 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:50.032215 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.032457 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:49.927481 24562 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.942922 24682 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.021404 21218 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:50.034730 21223 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:50.023008 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 499706us
I20260709 13:07:50.024461 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:50.018273 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.028326 21217 raft_consensus.cc:2393] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:50.020043 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.032950 21219 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:50.069423 21219 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:50.033699 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 455814us
I20260709 13:07:49.933795 24723 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:50.019469 24587 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.024s	sys 0.022s
I20260709 13:07:50.037861 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.042816 21226 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:50.042913 21151 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.043540 21150 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:50.045274 21145 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:50.154884 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.155682 21145 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:50.158279 21143 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:50.043186 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 982) took 1311 ms. Trace:
I20260709 13:07:50.045855 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.045938 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:50.162416 21146 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.041950 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.033938 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2460) took 1297 ms. Trace:
W20260709 13:07:50.082435 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 58048.8us
I20260709 13:07:50.163594 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:50.020817 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:50.030525 24566 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:50.148307 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56655.6us
W20260709 13:07:50.172562 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 151874us
I20260709 13:07:50.173365 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:50.174036 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.148202 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 93937.6us
I20260709 13:07:50.163081 21296 rpcz_store.cc:276] 0709 13:07:48.736741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.738181 (+  1440us) service_pool.cc:224] Handling call
0709 13:07:48.750526 (+ 12345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.750710 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:48.857141 (+106431us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.033427 (+1176286us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.033632 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.033675 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:50.033724 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.033791 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.033883 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183455,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":217896,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":32211,"thread_start_us":1233470,"threads_started":4,"wal-append.queue_time_us":644508}
I20260709 13:07:50.178818 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:50.042105 24732 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.022521 24702 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.129s
W20260709 13:07:50.096704 24712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.025s
I20260709 13:07:50.182936 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.017314 24716 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:50.152411 24587 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.518s	user 0.024s	sys 0.023s
I20260709 13:07:50.198428 24578 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:50.199048 24578 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.201196 24578 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.202586 24611 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.202917 24717 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:50.207571 24648 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.196799 24658 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.208683 24658 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:50.209641 24658 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.148118 24370 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.213827 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:50.182355 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.218154 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.157881 24371 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.223953 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.224563 21146 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.226658 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.229801 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:50.230540 21296 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:50.236542 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 52933us
I20260709 13:07:50.239547 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:50.238657 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 304833us
I20260709 13:07:50.243399 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:50.181123 24631 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.245491 24648 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:50.215626 24715 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:07:50.216305 24712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.000s	sys 0.028s
I20260709 13:07:50.187197 24683 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.149276 24721 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:50.160125 24607 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:50.202953 24611 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.157747 24428 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:07:50.262897 21296 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:50.240125 24702 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.296767 21805 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:50.238346 24717 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.286062 24524 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:50.236963 24370 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.296536 24611 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.347510 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.352679 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:50.326617 24635 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:50.215905 24732 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.349761 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:50.354159 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.161166 21812 rpcz_store.cc:276] 0709 13:07:48.731379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.725719 (+994340us) service_pool.cc:224] Handling call
0709 13:07:49.725998 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.726183 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:49.792418 (+ 66235us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.042862 (+250444us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.042912 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:50.042957 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.043029 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.043137 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48965,"prepare.queue_time_us":68103,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":16572,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":76184,"thread_start_us":244015,"threads_started":1}
I20260709 13:07:50.377554 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:50.348914 24667 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:50.379528 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:50.380224 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.377116 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:50.380797 21296 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:50.375353 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.381584 21297 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:50.298818 24702 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:50.382584 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.385224 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.385375 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:50.383464 21296 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:07:50.383720 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 356055us
I20260709 13:07:50.382687 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:50.390182 21148 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.390342 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:50.390602 21145 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.391170 21814 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:50.392269 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:50.392714 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.393766 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:50.394129 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 230640us
I20260709 13:07:50.394848 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:50.395962 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.396312 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:50.396863 21151 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.400075 21296 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:50.402047 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:50.405802 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:50.405920 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.406405 21219 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.413643 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:50.414353 21222 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.378978 24572 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:50.384959 24736 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:50.379830 24524 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:50.413635 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.418637 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.419394 21148 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.386682 24683 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.335727 24717 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.439059 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:50.440558 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:50.441840 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:50.442559 21222 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.416739 24664 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:50.386335 24667 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.378731 24635 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.421277 24578 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.466020 21219 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:50.422220 24736 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:50.483661 21145 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:07:50.484987 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 75225.1us
I20260709 13:07:50.455777 24664 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:50.415127 21225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
W20260709 13:07:50.504081 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 117780us
I20260709 13:07:50.505549 21225 raft_consensus.cc:606] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:50.425356 24572 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.513784 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:50.518999 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:50.519731 24742 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:50.414379 24721 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.527644 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:50.508383 24730 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:07:50.496835 24371 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:50.528353 21812 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:50.536230 21225 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.523830 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2467) took 1767 ms. Trace:
W20260709 13:07:50.531206 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 127711us
I20260709 13:07:50.470609 24631 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:50.506615 24258 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.541086 21812 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:50.506744 24664 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.544844 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:50.537926 21299 rpcz_store.cc:276] 0709 13:07:48.756227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.756384 (+   157us) service_pool.cc:224] Handling call
0709 13:07:48.756707 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.911912 (+1155205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.523508 (+611596us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001a77d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:50.523752 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651456384}
I20260709 13:07:50.517643 24390 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.556484 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:50.558022 21219 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:50.556371 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:50.564769 21812 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.562674 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:50.496053 24754 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:50.484536 24702 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.542098 24371 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.572371 21299 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:50.573701 24745 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:50.553437 24716 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.587911 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:50.588081 21812 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:50.588636 21297 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.520987 24524 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:50.594148 24750 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:50.566970 24390 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:50.597689 21297 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:50.600971 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 980) took 1892 ms. Trace:
I20260709 13:07:50.601516 21805 rpcz_store.cc:276] 0709 13:07:48.708620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.715849 (+1007229us) service_pool.cc:224] Handling call
0709 13:07:49.716125 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.298926 (+582801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.600684 (+301758us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54001b5654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:50.600899 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334902528}
I20260709 13:07:50.612195 24667 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.612993 24754 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.613330 21805 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:50.614097 24746 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:07:50.583750 24371 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.597143 24678 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:50.582439 24370 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.616420 24758 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:50.624428 24760 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:50.625092 24370 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.626183 24751 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:07:50.625732 24370 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.628043 24572 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:50.561466 24258 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.544220 24736 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.628278 24370 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:50.721802 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:50.617741 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 61245.6us
I20260709 13:07:50.915035 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:50.721031 24600 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.623888 24758 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:50.614964 24754 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:50.599792 24390 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.890758 24669 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.911161 24480 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.932426 21219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:50.720057 24631 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:50.715493 24763 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:07:50.945155 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:50.752171 24623 consensus_meta.cc:287] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.003s
I20260709 13:07:50.904536 24635 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.729946 24756 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.717458 24743 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:07:50.694038 24759 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:50.958400 24759 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.960536 24759 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:50.731272 24717 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.944012 24736 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.961733 24371 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.962908 21814 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:50.964684 24562 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.002s
I20260709 13:07:50.965129 24562 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.967744 24623 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.969329 21810 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:50.969473 24773 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.970167 24773 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:50.971513 24678 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:50.951748 24480 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.620045 24732 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.924940 24370 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:50.977437 24370 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.978533 24371 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.955140 24765 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.955726 24756 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:50.691890 24766 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.275s
W20260709 13:07:50.951188 24674 consensus_meta.cc:287] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.955s	user 0.010s	sys 0.003s
I20260709 13:07:50.981727 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2120) took 1048 ms. Trace:
W20260709 13:07:50.982337 24611 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
I20260709 13:07:50.983479 24759 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.987669 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:50.929967 24758 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.976711 24480 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.979485 24370 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:50.999037 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:51.028939 24258 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:50.966776 24664 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:51.031453 21299 rpcz_store.cc:276] 0709 13:07:49.933281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.581925 (+648644us) service_pool.cc:224] Handling call
0709 13:07:50.582210 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.582590 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.582637 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.589435 (+  6798us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.693345 (+103910us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.693385 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.693454 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.981533 (+288079us) raft_consensus.cc:1685] finished
0709 13:07:50.981551 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.981667 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21832,"raft.queue_time_us":1099,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10996,"thread_start_us":99346,"threads_started":1,"wal-append.queue_time_us":386388}
I20260709 13:07:50.946125 24631 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:50.976787 24623 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.046296 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:51.040117 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 107624us
W20260709 13:07:51.040799 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53462.6us
I20260709 13:07:51.026130 24765 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.040823 21297 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:50.992915 24572 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.938661 24754 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.054513 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:51.058519 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:51.069293 21297 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:51.071084 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:51.085350 21299 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:51.077700 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:51.097534 24623 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.035447 24611 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.071828 21297 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:51.039474 24759 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.078516 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2108) took 1158 ms. Trace:
I20260709 13:07:51.101646 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:51.101701 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:51.102351 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:51.100159 24623 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:51.110934 21299 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:51.109856 21300 rpcz_store.cc:276] 0709 13:07:49.920317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.921082 (+   765us) service_pool.cc:224] Handling call
0709 13:07:49.921329 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.994890 (+ 73561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.994941 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.995005 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:49.995058 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.078267 (+1083209us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b540001e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:51.078316 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.078447 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168612224}
I20260709 13:07:51.111673 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:51.112404 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:51.080617 21114 connection.cc:256] RPC call timeout handler was delayed by -1.6847294210000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
I20260709 13:07:51.053733 24780 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.060859 24765 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:51.190459 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 88843.2us
I20260709 13:07:51.185153 21300 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.111145 24623 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.201651 21299 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:51.061498 24261 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:07:51.161715 24779 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:51.185678 24675 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.201525 24258 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.162853 24778 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.174674 24647 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:51.134593 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.191828 24664 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.111435 24572 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.317188 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:51.363826 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 286195us
W20260709 13:07:51.314005 24683 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.000s
W20260709 13:07:51.401096 21114 connection.cc:256] RPC call timeout handler was delayed by -1.6064294210000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:07:51.408612 21114 connection.cc:256] RPC call timeout handler was delayed by -1.5911294210000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:07:51.402340 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.363027 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2478) took 1179 ms. Trace:
I20260709 13:07:51.280226 24772 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:51.280465 24370 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:51.409577 21300 rpcz_store.cc:276] 0709 13:07:50.184017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.184564 (+1000547us) service_pool.cc:224] Handling call
0709 13:07:51.184959 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.200051 (+ 15092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.362946 (+162895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.325668 24258 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.405224 24778 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.321955 24779 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:51.076797 24631 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.430099 24767 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:51.412343 24706 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.429675 24480 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:51.417537 24780 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:07:51.496922 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.461167 24782 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:07:51.466892 24784 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:51.511022 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 533) took 1107 ms. Trace:
I20260709 13:07:51.424130 24683 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.472935 24664 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.511474 21221 rpcz_store.cc:276] 0709 13:07:50.403502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.403742 (+   240us) service_pool.cc:224] Handling call
0709 13:07:50.404044 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.491660 (+ 87616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.491775 (+   115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.507550 (+ 15775us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.669692 (+162142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.669911 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.670139 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.510781 (+840642us) raft_consensus.cc:1685] finished
0709 13:07:51.510800 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.510954 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612,"raft.queue_time_us":20951,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5371,"thread_start_us":235386,"threads_started":2,"wal-append.queue_time_us":551601}
I20260709 13:07:51.471673 24480 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.423621 24572 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:51.343134 24675 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:51.498870 24781 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:51.467200 24756 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.471379 24778 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.460175 24258 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.458232 24370 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:51.550802 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.551249 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 985) took 1027 ms. Trace:
I20260709 13:07:51.515523 24674 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:51.557364 24703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.067s	user 0.049s	sys 0.101s
I20260709 13:07:51.468322 24779 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.431701 24772 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.587751 24729 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.588171 24729 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:51.589056 24703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.097s	user 0.049s	sys 0.101s
I20260709 13:07:51.586165 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:51.590230 24674 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.470876 24706 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.597620 24706 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.519835 24664 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.526963 24781 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.563603 21297 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:51.584177 21809 rpcz_store.cc:276] 0709 13:07:50.524465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.524612 (+   147us) service_pool.cc:224] Handling call
0709 13:07:50.525023 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.632743 (+107720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.632785 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.670029 (+ 37244us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.993069 (+323040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.993104 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.993177 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.550952 (+557775us) raft_consensus.cc:1685] finished
0709 13:07:51.550981 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.551178 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88282,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":88,"thread_start_us":415524,"threads_started":2,"wal-append.queue_time_us":677558}
W20260709 13:07:51.603739 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 194611us
W20260709 13:07:51.610106 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 170004us
I20260709 13:07:51.612303 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.606552 24703 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.606232 24371 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.608873 24710 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:51.611299 24772 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:51.613747 24767 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:51.616879 24390 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
I20260709 13:07:51.614995 24261 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.614885 24647 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:51.622843 24754 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.617899 24790 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:51.605224 24572 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:51.662467 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 48628.3us
I20260709 13:07:51.639379 24261 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:51.639529 24390 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.618445 24729 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:51.672843 24786 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:51.673950 24781 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.645790 24647 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:51.623677 24371 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.640973 24767 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.677027 24258 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.651576 24480 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:51.697989 21778 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.916s (SENT) [suppressed 27 similar messages]
W20260709 13:07:51.702335 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 87896.2us
I20260709 13:07:51.702567 21812 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.703181 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.704197 21114 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.688499 24703 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:51.709785 24797 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.710024 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.712808 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.714847 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.706815 24710 consensus_queue.cc:1243] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:51.703089 24675 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:51.728056 24796 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.707340 24790 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.694415 24683 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:51.734369 24261 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.738852 24390 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.740594 24371 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.714232 24794 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.741328 24258 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.741276 24703 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.741649 24778 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.730257 24797 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.725720 24635 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:07:51.713099 24729 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.745927 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 991) took 1214 ms. Trace:
I20260709 13:07:51.756387 21805 rpcz_store.cc:276] 0709 13:07:50.532016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.695283 (+163267us) service_pool.cc:224] Handling call
0709 13:07:50.708473 (+ 13190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.996523 (+288050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.996593 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:51.028476 (+ 31883us) log.cc:844] Serialized 582 byte log entry
0709 13:07:51.404656 (+376180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:51.404698 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.404832 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.745641 (+340809us) raft_consensus.cc:1685] finished
0709 13:07:51.745669 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.745849 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235329,"raft.queue_time_us":251951,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":375733,"threads_started":1,"wal-append.queue_time_us":556357}
I20260709 13:07:51.749130 21189 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:51.760105 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:51.761292 21805 raft_consensus.cc:2376] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9. Re-sending same reply.
I20260709 13:07:51.731851 24370 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.762039 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1072) took 1065 ms. Trace:
W20260709 13:07:51.755527 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 57577.3us
I20260709 13:07:51.762513 21805 rpcz_store.cc:276] 0709 13:07:50.697017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.758473 (+1061456us) service_pool.cc:224] Handling call
0709 13:07:51.761964 (+  3491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.735090 24623 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.764747 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:51.766477 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:51.767431 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:51.769023 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1069) took 1074 ms. Trace:
I20260709 13:07:51.768044 21807 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:51.769448 21805 rpcz_store.cc:276] 0709 13:07:50.695167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.763607 (+1068440us) service_pool.cc:224] Handling call
0709 13:07:51.768947 (+  5340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.770623 21809 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:51.771513 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:51.777371 21809 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:51.778163 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1070) took 1082 ms. Trace:
I20260709 13:07:51.778565 21809 rpcz_store.cc:276] 0709 13:07:50.695934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.776739 (+1080805us) service_pool.cc:224] Handling call
0709 13:07:51.777136 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.777863 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.778100 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.760154 24390 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.781662 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 993) took 1249 ms. Trace:
I20260709 13:07:51.783878 21805 rpcz_store.cc:276] 0709 13:07:50.532583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.779636 (+1247053us) service_pool.cc:224] Handling call
0709 13:07:51.781054 (+  1418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.781292 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.781328 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.781378 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:51.781423 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.781489 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.781597 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:51.786966 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72214.4us
W20260709 13:07:51.780807 24600 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.000s
I20260709 13:07:51.786976 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:51.794045 21145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1556) took 1399 ms (client timeout 1639 ms). Trace:
W20260709 13:07:51.811626 21145 rpcz_store.cc:269] 0709 13:07:50.395047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.395693 (+   646us) service_pool.cc:224] Handling call
0709 13:07:51.793886 (+1398193us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b540031ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:51.793987 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169554688}
I20260709 13:07:51.807842 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:51.813228 21146 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:51.814281 24261 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.814707 24261 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.815070 24261 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.822472 24261 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:51.790963 24765 consensus_meta.cc:287] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.002s
W20260709 13:07:51.798120 24758 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.000s
I20260709 13:07:51.824844 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 992) took 1292 ms. Trace:
I20260709 13:07:51.825176 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:51.845342 21809 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:51.793212 24667 raft_consensus.cc:993] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
W20260709 13:07:51.849274 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.790441 24702 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.852656 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:51.786834 24799 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:51.812199 24683 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:51.853152 21291 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:51.795044 24695 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:51.852952 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:51.813895 24736 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.843783 24658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.026s	sys 0.036s
I20260709 13:07:51.791651 24794 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:07:51.874734 24710 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:51.875737 24808 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:51.876140 24802 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:51.876386 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 990) took 1346 ms. Trace:
I20260709 13:07:51.893057 21814 rpcz_store.cc:276] 0709 13:07:50.531690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.567125 (+ 35435us) service_pool.cc:224] Handling call
0709 13:07:51.876198 (+1309073us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400391f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:51.876332 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860566912}
I20260709 13:07:51.877239 24721 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:51.879155 24674 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.881405 24356 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.851408 24530 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:07:51.788031 24390 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.872846 24635 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.855731 24664 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.812337 24790 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:51.861155 24683 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.852346 24600 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:51.854457 24723 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.864202 24647 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.862838 24695 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:07:51.868086 24658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.028s	sys 0.038s
I20260709 13:07:51.898123 24356 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:51.895864 24721 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:51.906445 21809 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.884256 24767 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.851575 24765 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.855158 24758 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:51.898969 24791 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:51.986155 24261 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.896579 24799 raft_consensus.cc:1081] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:07:51.897197 24801 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.899525 24802 consensus_queue.cc:1243] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:51.871898 24736 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.916424 24683 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.987900 24801 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.990087 24801 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:51.905421 24599 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:51.991726 24695 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.993005 24695 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.921962 24635 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:51.996896 24635 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.000023 24356 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.001873 24356 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.003858 24721 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.005061 24758 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:52.005402 24721 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.006577 24390 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:52.008984 24597 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:52.011745 21295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 623) took 2152 ms (client timeout 1916 ms). Trace:
W20260709 13:07:52.012264 21295 rpcz_store.cc:269] 0709 13:07:49.785053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.792677 (+  7624us) service_pool.cc:224] Handling call
0709 13:07:51.936981 (+2144304us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b54004001d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:51.937094 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194369280}
I20260709 13:07:52.013289 24765 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:51.935623 24571 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:51.943496 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.984700 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 624) took 2151 ms (client timeout 1947 ms). Trace:
W20260709 13:07:52.015813 21298 rpcz_store.cc:269] 0709 13:07:49.785315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.836521 (+ 51206us) service_pool.cc:224] Handling call
0709 13:07:51.936526 (+2100005us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b540029ed54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:51.936628 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146601344}
I20260709 13:07:51.921553 24723 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.020210 24723 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:52.049136 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 174796us
I20260709 13:07:52.050227 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.051452 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:52.054926 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.055545 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.057667 21114 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.059096 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.064121 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.065876 21222 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:07:52.063125 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:52.067296 21224 raft_consensus.cc:2410] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:52.063733 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.074889 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:52.073177 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.075860 21218 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 4.
I20260709 13:07:52.060143 24675 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:52.077152 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 252051us
I20260709 13:07:52.066037 24796 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.060668 24600 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.066030 24674 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.065838 24429 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.069123 24794 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.068255 24790 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.070629 24729 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:52.076637 24675 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.077194 24572 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.085306 24729 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.082603 24674 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.102658 24674 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.082829 24429 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.107800 24562 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.110327 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.110985 21299 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:52.111568 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.111718 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.111954 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.112318 21298 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.112574 21291 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:52.100613 24675 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.113137 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.113864 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.116149 21293 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:52.112593 21299 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:52.113404 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.116742 21291 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:52.116971 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.117570 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.118245 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.118315 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.118911 21293 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.119726 21291 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:52.117552 21299 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:52.120215 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.122304 21300 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.124082 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.125515 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.115025 24723 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.115077 24572 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.128163 24571 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.130681 24390 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.130991 24571 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.131148 24390 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.131503 24571 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.131605 24390 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.132432 24762 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.225s	user 0.005s	sys 0.016s
I20260709 13:07:52.124526 24562 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:52.128238 24429 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.135522 24562 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:52.136056 24562 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.136890 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 986) took 1611 ms. Trace:
I20260709 13:07:52.141251 24390 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:51.847052 21807 rpcz_store.cc:276] 0709 13:07:50.532273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.776263 (+1243990us) service_pool.cc:224] Handling call
0709 13:07:51.776599 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.776808 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:51.815241 (+ 38433us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.824373 (+  9132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.824447 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.824518 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.824605 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.824772 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37808,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":763,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":20506,"thread_start_us":46007,"threads_started":2,"wal-append.queue_time_us":7576}
I20260709 13:07:52.144331 24390 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.145288 24723 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.146446 24759 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.137270 21812 rpcz_store.cc:276] 0709 13:07:50.526008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.590532 (+ 64524us) service_pool.cc:224] Handling call
0709 13:07:50.590860 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.703103 (+1112243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.136605 (+433502us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540012edd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:52.136804 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556159744}
I20260709 13:07:52.149400 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 971) took 4884 ms. Trace:
I20260709 13:07:52.149822 21808 rpcz_store.cc:276] 0709 13:07:47.265009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.409547 (+1144538us) service_pool.cc:224] Handling call
0709 13:07:48.444663 (+ 35116us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:48.509222 (+ 64559us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:48.567346 (+ 58124us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.714876 (+147530us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800428b60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d522 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:50.292842 (+1577966us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b1800428b60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a 00007f2b6dd84a2a
0709 13:07:50.468292 (+175450us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.468957 (+   665us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.469137 (+   180us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:50.477910 (+  8773us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.700208 (+222298us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.854501 (+154293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.854738 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.131845 (+1277107us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:52.149200 (+ 17355us) raft_consensus.cc:1685] finished
0709 13:07:52.149222 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.149347 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198707,"prepare.queue_time_us":49453,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2829,"raft.queue_time_us":454388,"raft.run_cpu_time_us":539,"raft.run_wall_time_us":47718,"spinlock_wait_cycles":462511872,"thread_start_us":371680,"threads_started":2,"wal-append.queue_time_us":2119637}
I20260709 13:07:52.152004 24684 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.152402 24684 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:52.127429 24765 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:52.122426 24683 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.153160 24684 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.212755 21149 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:52.213999 21149 pending_rounds.cc:85] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 4
I20260709 13:07:52.214440 21149 pending_rounds.cc:107] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:52.214951 21149 raft_consensus.cc:2889] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.224606 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.226248 21292 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:52.226495 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.227638 21291 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:52.228909 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:52.232998 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:52.239220 24822 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.248612 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.254565 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:52.266546 24684 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.267824 24429 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:52.268453 21219 raft_consensus.cc:606] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:52.269765 24572 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.270476 24683 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.271315 24675 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.312103 24723 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.312894 24675 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.313421 24675 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:52.313633 21299 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.275651 24480 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:52.277072 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.270944 24356 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:52.302340 24778 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:52.315835 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 50788.9us
I20260709 13:07:52.315675 24480 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.316464 24778 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:52.282559 24702 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.316854 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.310034 24721 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:52.317806 24721 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:52.317495 24702 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.318267 24721 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.314785 24675 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.316959 24778 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:52.305529 24796 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:52.309041 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54926.8us
I20260709 13:07:52.312822 24429 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:52.321717 24702 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.307114 24773 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.323654 24729 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:52.342476 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 109828us
I20260709 13:07:52.345299 21298 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.346246 21299 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
W20260709 13:07:52.346431 21151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 660) took 2292 ms (client timeout 1913 ms). Trace:
I20260709 13:07:52.347579 24766 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.325675 24778 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.348217 24766 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.338284 24429 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.350596 24766 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.359727 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.360597 21298 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.360875 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.347113 21151 rpcz_store.cc:269] 0709 13:07:50.053757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.153768 (+100011us) service_pool.cc:224] Handling call
0709 13:07:52.345894 (+2192126us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540040cc54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:52.346109 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412033280}
I20260709 13:07:52.374322 24480 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:52.374823 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 894) took 2459 ms (client timeout 1639 ms). Trace:
W20260709 13:07:52.375361 21810 rpcz_store.cc:269] 0709 13:07:49.915721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.916865 (+  1144us) service_pool.cc:224] Handling call
0709 13:07:52.374356 (+2457491us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54005c5b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:52.374560 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309444992}
I20260709 13:07:52.377027 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.378086 21292 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:52.379822 24258 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.348634 24683 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.380402 24258 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:52.380892 24683 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.382133 24258 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.382877 21220 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:52.386229 24529 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.386829 24529 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:52.388616 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.371029 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.394541 21295 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.394742 24566 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.395196 24566 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:52.396374 24258 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.396727 21218 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:52.396531 24566 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.397651 21224 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.411420 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.407658 24356 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:52.411593 21224 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:52.413578 24611 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.396735 24796 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:52.417098 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.418735 24529 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.421617 24529 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.424887 21293 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.425631 24822 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.426671 21806 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:52.425069 21295 raft_consensus.cc:2410] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:52.398331 24566 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.426579 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.426527 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:52.431404 24356 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.432636 24771 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.720s	user 0.010s	sys 0.023s
I20260709 13:07:52.433287 24599 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.433473 24794 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:52.434527 24813 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:52.436810 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.437891 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35736 (request call id 93) took 1006 ms. Trace:
I20260709 13:07:52.438740 24371 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.443041 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.444032 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 666) took 1901 ms. Trace:
W20260709 13:07:52.444561 21806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1071) took 1748 ms (client timeout 1564 ms). Trace:
W20260709 13:07:52.444986 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44007.2us
I20260709 13:07:52.448196 24623 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:52.446982 24675 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.449868 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2123) took 2150 ms. Trace:
I20260709 13:07:52.452868 24571 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.455479 21293 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:52.456265 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.464432 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 104199us
I20260709 13:07:52.466084 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:52.466496 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.467528 21297 rpcz_store.cc:276] 0709 13:07:50.299326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.116691 (+817365us) service_pool.cc:224] Handling call
0709 13:07:51.362699 (+246008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.600681 (+237982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.449260 (+848579us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54003d3bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:52.449613 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433724288}
I20260709 13:07:52.459208 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2114) took 2525 ms. Trace:
I20260709 13:07:52.465997 24356 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:52.469213 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 75858.9us
W20260709 13:07:52.462504 21806 rpcz_store.cc:269] 0709 13:07:50.696544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.721531 (+ 24987us) service_pool.cc:224] Handling call
0709 13:07:52.444307 (+1722776us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54006626d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:52.444471 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151992704}
I20260709 13:07:52.471002 21298 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:52.475171 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.461782 21144 rpcz_store.cc:276] 0709 13:07:51.431699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.436928 (+  5229us) service_pool.cc:224] Handling call
0709 13:07:52.437344 (+1000416us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540026acd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd80735 00007f2b6dd789fa 00007f2b72d404c9 00007f2b6c2bcc54 00007f2b6c2bcbe2 00007f2b6c2bcb11 00007f2b6c2bca8c 00007f2b6c2bbd42 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:52.437636 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807723776}
I20260709 13:07:52.470120 21296 rpcz_store.cc:276] 0709 13:07:49.925699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.401051 (+475352us) service_pool.cc:224] Handling call
0709 13:07:50.401350 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.536634 (+1135284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.536693 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.536751 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.536793 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.450776 (+913983us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540029de54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:52.450849 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.451082 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610372992}
I20260709 13:07:52.462127 21146 rpcz_store.cc:276] 0709 13:07:50.542654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.542837 (+   183us) service_pool.cc:224] Handling call
0709 13:07:52.443602 (+1900765us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000857d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:52.443847 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2867732864}
I20260709 13:07:52.487497 21220 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 4.
W20260709 13:07:52.488085 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.488742 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.488973 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.490059 24723 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.468987 24599 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.518702 24599 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:52.491448 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63703.1us
I20260709 13:07:52.520411 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.521919 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:52.463570 24813 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:52.497380 21299 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:52.474867 24371 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.501101 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.502370 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50268 (request call id 16) took 1570 ms. Trace:
I20260709 13:07:52.530274 21217 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:52.530153 21219 rpcz_store.cc:276] 0709 13:07:50.932185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.932308 (+   123us) service_pool.cc:224] Handling call
0709 13:07:52.502084 (+1569776us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000ebad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:52.502233 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054378368}
I20260709 13:07:52.531580 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.531864 24356 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.531934 24813 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.502454 21292 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:52.503134 24817 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.503571 24683 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.503719 24578 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.504334 21300 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.482995 24794 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.509101 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:52.508915 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:52.474494 24823 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.510138 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.515082 21806 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:52.515612 21811 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:52.515812 24597 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:52.523962 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 97703.7us
I20260709 13:07:52.496104 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.545840 21297 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:52.545008 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.649952 21148 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260709 13:07:52.539602 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:52.575137 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.653041 21220 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:07:52.538978 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.654666 21148 pending_rounds.cc:85] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 9
I20260709 13:07:52.664538 21148 pending_rounds.cc:107] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260709 13:07:52.665133 21148 raft_consensus.cc:2889] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.559013 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:52.562820 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:52.657995 21263 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:52.582541 24524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.832s	user 0.014s	sys 0.030s
I20260709 13:07:52.571573 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:52.674230 21033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 165462us
I20260709 13:07:52.678406 24480 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.680161 24480 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.682828 24480 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.585646 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:52.539636 24752 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.846s	user 0.006s	sys 0.022s
I20260709 13:07:52.696137 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:52.696381 24371 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.697216 21147 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:52.698396 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 136946us
I20260709 13:07:52.538167 24562 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.699610 24578 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:52.700806 24578 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.552942 24356 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:52.702004 24356 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.703570 24572 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.704206 24572 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:52.704663 21299 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:52.705716 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.705425 24572 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.706404 21299 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:52.706773 24802 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:52.707530 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.707979 24674 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.708153 21220 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:52.708516 24674 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:52.709306 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.709589 24674 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.712608 24732 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:52.716308 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.717077 21300 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:52.718282 21300 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:52.718382 24766 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.719403 24790 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:52.708021 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.534663 24623 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.719980 24790 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.720481 24623 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:52.685464 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 163686us
I20260709 13:07:52.672300 24736 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.693800 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1942) took 2699 ms. Trace:
I20260709 13:07:52.694420 24631 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.703745 21225 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:52.704284 21222 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:52.559495 21812 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:52.552721 24822 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.534104 24571 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.685228 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.722820 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:52.535424 24695 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.721917 21149 rpcz_store.cc:276] 0709 13:07:49.993932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.994059 (+   127us) service_pool.cc:224] Handling call
0709 13:07:49.994367 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.219286 (+2224919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.672293 (+453007us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b5400066154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:52.693708 (+ 21415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5098513664}
I20260709 13:07:52.723701 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:52.728791 21291 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.728888 21299 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:52.662663 24813 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:52.673676 24524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.045s	user 0.019s	sys 0.035s
I20260709 13:07:52.701381 24562 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:52.648708 24429 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:52.478006 24778 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.774223 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:53.004132 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 281319us
I20260709 13:07:52.791195 24717 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:53.237253 24833 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.543s	user 0.003s	sys 0.000s
I20260709 13:07:52.830263 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:52.872905 24824 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:07:52.865869 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 158686us
I20260709 13:07:52.553228 24600 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.303339 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.771124 21295 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.789012 21807 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:53.038514 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.965785 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.867329 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:52.731500 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:52.859704 21145 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:53.334438 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.334856 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.859891 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:53.236840 24823 consensus_meta.cc:287] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.004s
I20260709 13:07:53.302439 21148 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:52.831079 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.771693 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:53.301206 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.840914 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:52.711061 24674 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:53.334971 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.556588 24797 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:53.300277 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 792957us
I20260709 13:07:52.771130 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:52.888428 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2480) took 1023 ms. Trace:
I20260709 13:07:52.823706 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:52.789094 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:52.859869 24729 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:52.939754 24529 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:07:52.894033 24721 consensus_meta.cc:287] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.000s
W20260709 13:07:53.379182 21298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.027s
I20260709 13:07:52.757922 24822 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:53.386909 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:52.791217 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:52.830332 24675 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:53.389895 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.393308 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.386993 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:53.389022 21298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.011s	sys 0.027s
W20260709 13:07:53.090350 24723 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:07:52.704293 24356 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:52.873211 24766 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.396152 21142 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:53.396539 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 665108us
I20260709 13:07:52.790628 24794 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:53.076656 24599 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:53.398391 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.033s	sys 0.036s
W20260709 13:07:53.405455 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.033s	sys 0.036s
I20260709 13:07:53.382460 24823 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.381548 24797 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:53.407302 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:53.400513 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 642036us
I20260709 13:07:53.404140 21811 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:07:53.399962 21144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.006s
I20260709 13:07:53.408110 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:53.411041 21144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.012s	sys 0.006s
I20260709 13:07:53.413698 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.396260 24571 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:53.415890 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.419327 21149 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.418550 21150 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.412817 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.346591 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a837dff96224f8b8795bace63448d84"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:53.402606 24736 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.718456 21293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:07:53.379832 21294 rpcz_store.cc:276] 0709 13:07:51.851788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.853856 (+  2068us) service_pool.cc:224] Handling call
0709 13:07:51.856968 (+  3112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.857151 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:51.861798 (+  4647us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.366821 (+505023us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b1800445b40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a 00007f2b6dd84a2a
0709 13:07:52.679097 (+312276us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.812145 (+133048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.822445 (+ 10300us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.839672 (+ 17227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.847190 (+  7518us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.875569 (+ 28379us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3089,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":586487,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":6498560,"thread_start_us":306236,"threads_started":2,"wal-append.queue_time_us":1335071}
I20260709 13:07:53.403613 24723 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.427923 24562 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.407397 24529 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.432011 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:53.423753 21224 raft_consensus.cc:606] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:53.433669 21224 raft_consensus.cc:614] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.394469 24721 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.452571 21806 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:53.453537 21221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.009s
W20260709 13:07:53.502646 21221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.002s	sys 0.009s
W20260709 13:07:53.453991 21049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 254) took 19641 ms (client timeout 15000 ms). Trace:
I20260709 13:07:53.455703 24429 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:53.467034 24729 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:53.468102 24827 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:53.475983 24797 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.478701 24794 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:53.417279 24600 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:52.780277 24623 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.404917 24717 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:53.551155 21151 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:53.487416 24790 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.491828 24778 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.492471 21147 raft_consensus.cc:2376] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9. Re-sending same reply.
I20260709 13:07:53.450587 24571 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.499130 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.499473 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:53.565379 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.435616 21293 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.445256 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.406800 24599 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:53.425741 24736 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.520354 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 539) took 1188 ms. Trace:
I20260709 13:07:53.579345 21293 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:53.527899 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:53.529569 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.530032 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.436847 24562 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:53.519349 24683 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:07:53.503403 21049 rpcz_store.cc:269] 0709 13:07:33.746411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.751508 (+  5097us) service_pool.cc:224] Handling call
0709 13:07:53.381648 (+19630140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:48.639703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:48.640245 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:48.640282 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:07:48.640300 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:48.641326 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:48.641387 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:48.641414 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:48.642200 (+   786us) tablet.cc:701] Row locks acquired
0709 13:07:48.642218 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:48.642355 (+   137us) write_op.cc:270] Start()
0709 13:07:48.642461 (+   106us) write_op.cc:276] Timestamp: P: 1783602468642312 usec, L: 0
0709 13:07:48.642482 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:48.657830 (+ 15348us) log.cc:844] Serialized 4016 byte log entry
0709 13:07:50.341592 (+1683762us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b54003e3ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd75e28 00007f2b717b0581 00007f2b717afd58 00007f2b717b49f1 00007f2b717b49a9 00007f2b717b4939 00007f2b717b4901 00007f2b717b3b2d 000000000038f354 000000000038f199
0709 13:07:50.386893 (+ 45301us) op_driver.cc:464] REPLICATION: finished
0709 13:07:50.697337 (+310444us) write_op.cc:301] APPLY: starting
0709 13:07:50.701268 (+  3931us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:50.727940 (+ 26672us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:50.727973 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:50.959876 (+231903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:50.960178 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:50.960241 (+    63us) write_op.cc:312] APPLY: finished
0709 13:07:50.960548 (+   307us) log.cc:844] Serialized 77 byte log entry
0709 13:07:50.960732 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:50.960874 (+   142us) write_op.cc:454] Released schema lock
0709 13:07:50.960931 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:50.961358 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:50.961394 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1564598,"reported_tablets":39,"spinlock_wait_cycles":790400,"child_traces":[["op",{"apply.queue_time_us":281161,"apply.run_cpu_time_us":4460,"apply.run_wall_time_us":269534,"num_ops":10,"prepare.queue_time_us":182827,"prepare.run_cpu_time_us":55946,"prepare.run_wall_time_us":1702120,"raft.queue_time_us":705474,"raft.run_cpu_time_us":35153,"raft.run_wall_time_us":279809,"replication_time_us":1688654,"spinlock_wait_cycles":33751936,"thread_start_us":1304471,"threads_started":4,"wal-append.queue_time_us":750771,"wal-append.run_cpu_time_us":33476,"wal-append.run_wall_time_us":2573344}]]}
I20260709 13:07:53.538669 24837 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.539448 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 528) took 3154 ms (client timeout 1857 ms). Trace:
I20260709 13:07:53.545447 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2485) took 1165 ms. Trace:
I20260709 13:07:53.548349 24600 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:53.550458 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:53.553922 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 43670.4us
W20260709 13:07:53.562650 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 131365us
I20260709 13:07:53.563395 21142 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:53.564456 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.566968 21146 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:53.517128 24729 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.570740 21807 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:07:53.601984 21226 rpcz_store.cc:269] 0709 13:07:50.384469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.384984 (+   515us) service_pool.cc:224] Handling call
0709 13:07:53.538970 (+3153986us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b540039b2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:53.539183 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6706415488}
I20260709 13:07:53.574344 21220 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:53.574826 21811 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:53.519925 24794 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:53.600378 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 203195us
I20260709 13:07:53.601173 21295 rpcz_store.cc:276] 0709 13:07:52.380006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.435345 (+ 55339us) service_pool.cc:224] Handling call
0709 13:07:52.730622 (+295277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.346086 (+615464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.545174 (+199088us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54001a81d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:53.545367 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657401728}
I20260709 13:07:53.609400 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.621421 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:53.584947 24736 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.623912 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.579308 21221 rpcz_store.cc:276] 0709 13:07:52.328493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.340800 (+ 12307us) service_pool.cc:224] Handling call
0709 13:07:52.375097 (+ 34297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.399447 (+ 24350us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:52.660276 (+260829us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.513013 (+852737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.513091 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:53.513177 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.513283 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.513447 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127652,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":14035,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15753,"thread_start_us":1017336,"threads_started":2,"wal-append.queue_time_us":889806}
I20260709 13:07:53.564577 24796 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:53.645288 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.636027 21148 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:53.639493 21116 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:53.634341 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:53.609464 24356 raft_consensus.cc:2764] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:53.647643 21149 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:53.553542 24529 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.652010 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.653194 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.655637 21142 raft_consensus.cc:2376] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8. Re-sending same reply.
I20260709 13:07:53.659511 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.623196 24578 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.660769 21806 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:53.691661 21811 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:53.662173 21293 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:53.692225 24578 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.692677 24578 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.694281 21293 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:53.646819 24797 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.694875 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.694949 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57074 (request call id 2141) took 1151 ms. Trace:
I20260709 13:07:53.696910 24571 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.697293 21293 rpcz_store.cc:276] 0709 13:07:52.600746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.718296 (+117550us) service_pool.cc:224] Handling call
0709 13:07:53.694843 (+976547us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":260}
I20260709 13:07:53.697791 24571 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:53.698335 24571 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:53.699512 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.705456 21222 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:53.708333 21147 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:53.689849 21150 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:53.665792 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.664803 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.619762 24600 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:53.619567 24837 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:53.710412 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.768388 21219 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
W20260709 13:07:53.767752 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.132s	sys 0.219s
I20260709 13:07:53.781073 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.781754 21805 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:53.783500 24562 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.787194 21145 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:53.788820 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 673) took 1209 ms. Trace:
I20260709 13:07:53.789816 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.729514 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.789215 21145 rpcz_store.cc:276] 0709 13:07:52.579432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.585171 (+  5739us) service_pool.cc:224] Handling call
0709 13:07:53.788762 (+1203591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.793381 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.779745 21221 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:07:53.795027 21189 leader_election.cc:336] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.506s (SENT)
I20260709 13:07:53.702792 24578 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.843554 21300 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:53.849479 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.798630 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.901665 21143 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:53.769479 24813 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:53.794709 24631 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.032s	user 0.003s	sys 0.011s
I20260709 13:07:53.699247 24571 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.884402 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:53.885412 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.883432 24703 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:53.792537 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.132s	sys 0.219s
I20260709 13:07:53.904193 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:53.905196 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 292091us
I20260709 13:07:53.918996 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:53.921079 21217 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:53.797992 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.777303 24717 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.797369 24839 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.902663 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:53.770875 24822 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:53.810387 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.911422 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:53.928036 21148 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:53.928331 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 553) took 1103 ms. Trace:
I20260709 13:07:53.930375 21805 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:53.709558 24599 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.932538 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:53.918275 24732 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:53.754652 24794 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.934609 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.931895 24801 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.937986 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 669) took 1387 ms. Trace:
I20260709 13:07:53.939122 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 676) took 1149 ms. Trace:
W20260709 13:07:53.932226 21263 connection.cc:256] RPC call timeout handler was delayed by -3.37402990399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 13:07:53.941119 24796 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.942121 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 548) took 1441 ms. Trace:
W20260709 13:07:53.961835 21263 connection.cc:256] RPC call timeout handler was delayed by -3.3565583589999051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:07:53.961509 21143 rpcz_store.cc:276] 0709 13:07:52.789534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.815641 (+ 26107us) service_pool.cc:224] Handling call
0709 13:07:53.938968 (+1123327us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b540026b6d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:53.939074 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208424320}
I20260709 13:07:53.944645 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.965209 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.920702 24721 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:53.947661 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.948879 24631 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:53.949612 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 177828us
I20260709 13:07:53.958390 24732 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:53.954517 24529 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:53.934720 24703 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:53.976629 24703 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.959575 21221 raft_consensus.cc:2410] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:53.935034 21218 rpcz_store.cc:276] 0709 13:07:52.831727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.902533 (+1070806us) service_pool.cc:224] Handling call
0709 13:07:53.928250 (+ 25717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.963177 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.960809 21146 rpcz_store.cc:276] 0709 13:07:52.550668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.582386 (+ 31718us) service_pool.cc:224] Handling call
0709 13:07:52.582743 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.610057 (+1027314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.937754 (+327697us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54000ac654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:53.937909 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263007616}
I20260709 13:07:53.964041 21217 rpcz_store.cc:276] 0709 13:07:52.501164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.537465 (+ 36301us) service_pool.cc:224] Handling call
0709 13:07:53.941934 (+1404469us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400116554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:53.942044 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862912256}
I20260709 13:07:53.945488 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 671) took 1383 ms. Trace:
I20260709 13:07:53.978974 21151 rpcz_store.cc:276] 0709 13:07:52.562382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.562537 (+   155us) service_pool.cc:224] Handling call
0709 13:07:53.945298 (+1382761us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400215054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:53.945433 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021294976}
I20260709 13:07:53.980178 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.981341 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.982156 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:53.982844 21217 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:53.983829 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:53.984702 21146 raft_consensus.cc:2410] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:53.985092 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 688) took 1145 ms. Trace:
W20260709 13:07:53.953320 24674 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.005s
I20260709 13:07:53.964888 24801 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.987826 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:53.969901 24842 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 13:07:53.970507 24841 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:07:53.999330 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:53.933385 24790 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:54.006392 24790 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.006747 24790 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:53.934257 24813 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:54.007633 24790 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.007887 24813 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.008980 24790 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.010157 24813 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:54.010739 21151 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:53.985625 21145 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:54.012140 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.013155 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:53.999408 24845 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:07:54.015177 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.015796 21226 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:54.016446 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.016891 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 667) took 1467 ms. Trace:
I20260709 13:07:54.017004 21223 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:54.017397 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.017884 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.018174 24723 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.018658 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.018989 24723 consensus_queue.cc:1243] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:54.019495 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:53.965023 24796 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.020465 24796 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.021639 24801 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.023509 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2146) took 1260 ms. Trace:
I20260709 13:07:54.023716 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.024317 21218 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.023981 21300 rpcz_store.cc:276] 0709 13:07:52.762911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.865521 (+102610us) service_pool.cc:224] Handling call
0709 13:07:53.522061 (+656540us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:07:53.522312 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.900347 (+378035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.023203 (+122856us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400160dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:54.023425 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777936000}
I20260709 13:07:53.956584 24839 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.027572 24631 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.027993 24631 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.028326 24631 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.028944 24794 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.935829 24717 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.031579 21147 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:54.031780 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.032603 24529 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:54.033228 24529 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.034189 24529 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:53.995846 21263 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.574s (SENT)
I20260709 13:07:53.984105 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.035104 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.035288 21150 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 4.
I20260709 13:07:54.035512 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:54.036103 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57475.9us
I20260709 13:07:54.036563 21150 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:54.037099 21150 pending_rounds.cc:85] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 6
I20260709 13:07:54.036898 24524 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:53.998799 21220 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.037375 21150 pending_rounds.cc:107] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:54.037683 21150 raft_consensus.cc:2889] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.037626 24524 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.003700 24674 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:54.039556 24674 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.041487 24674 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:54.000277 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.017259 21144 rpcz_store.cc:276] 0709 13:07:52.549969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.566664 (+ 16695us) service_pool.cc:224] Handling call
0709 13:07:52.567121 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.567731 (+   610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.567771 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.698396 (+130625us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:07:52.698904 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.416456 (+717552us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:53.416511 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.416605 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.016626 (+600021us) raft_consensus.cc:1685] finished
0709 13:07:54.016644 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.016838 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14915,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":201973120,"thread_start_us":712221,"threads_started":1,"wal-append.queue_time_us":965362}
I20260709 13:07:54.005358 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.044185 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.019586 24723 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:54.045135 24723 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:54.046027 24723 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.044836 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.044842 21226 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:54.048725 24840 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:54.049075 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.051779 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.047163 24723 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.053285 24524 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.049590 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.056046 24674 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.056123 24736 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.056751 24674 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:54.057402 24674 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.058924 21142 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:54.051580 24840 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:54.059310 21142 pending_rounds.cc:85] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 9
I20260709 13:07:54.059608 24840 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.050277 24837 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:54.060402 24837 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.060911 24837 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:53.985387 21146 rpcz_store.cc:276] 0709 13:07:52.843197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.978455 (+1135258us) service_pool.cc:224] Handling call
0709 13:07:53.985021 (+  6566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.056792 24578 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:53.994414 21143 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:54.036749 21263 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.622s (SENT)
I20260709 13:07:54.065181 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.065546 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.064668 21146 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:54.066515 21263 connection.cc:256] RPC call timeout handler was delayed by -3.3389299039999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 13:07:54.029090 24839 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.034531 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.067405 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.059605 21142 pending_rounds.cc:107] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:54.005010 24732 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.068475 21142 raft_consensus.cc:2889] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.075309 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 681) took 1280 ms. Trace:
I20260709 13:07:54.075825 21225 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.075835 21150 rpcz_store.cc:276] 0709 13:07:52.791283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.035961 (+1244678us) service_pool.cc:224] Handling call
0709 13:07:54.036240 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.038359 (+  2119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.071842 (+ 33483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.072054 21220 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:53.999928 21148 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:54.081779 21191 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.006s
W20260709 13:07:54.082180 21191 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.006s
I20260709 13:07:54.073158 21149 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
W20260709 13:07:54.082468 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 677686us
I20260709 13:07:54.098974 21145 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:54.099304 21143 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:54.106653 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:54.095325 21298 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.029s	sys 0.054s
I20260709 13:07:54.050962 24599 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.036613 24836 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:54.108191 21298 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.029s	sys 0.055s
I20260709 13:07:54.108320 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 685) took 1315 ms. Trace:
W20260709 13:07:54.074560 24572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.009s
I20260709 13:07:54.108762 21149 rpcz_store.cc:276] 0709 13:07:52.792445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.694607 (+902162us) service_pool.cc:224] Handling call
0709 13:07:54.108108 (+413501us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400085cd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:54.108245 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629028608}
I20260709 13:07:54.109578 21146 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.031147 24717 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.111702 21143 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:54.074702 24766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.007s
I20260709 13:07:54.120815 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.122143 21226 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:54.113481 24572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.003s	sys 0.009s
W20260709 13:07:54.119099 24766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.007s
I20260709 13:07:54.153798 21218 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:54.114140 24732 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.176635 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:54.185117 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.126650 24837 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:54.186388 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.026s
W20260709 13:07:54.193992 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.026s
W20260709 13:07:54.202069 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 580717us
W20260709 13:07:54.203426 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 285669us
I20260709 13:07:54.176201 24801 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.192088 21812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.030s
W20260709 13:07:54.246300 21812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.008s	sys 0.031s
I20260709 13:07:54.207496 24836 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:54.248240 24623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.002s	sys 0.023s
I20260709 13:07:54.265673 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.266290 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:54.268564 21293 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.191831 24631 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.247463 24611 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:54.273301 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1006) took 1691 ms. Trace:
I20260709 13:07:54.252319 24524 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:54.274111 21300 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:07:54.244378 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.267925 24623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.002s	sys 0.023s
I20260709 13:07:54.193869 24796 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:54.276557 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 479521us
W20260709 13:07:54.285348 24846 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:54.285939 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.286671 21225 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.289925 21293 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:54.291201 24611 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.293772 21225 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:54.293751 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.297444 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.298002 24571 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.298141 24572 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.298666 24572 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.298641 24571 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.299834 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.300410 21226 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:54.300846 24571 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:54.301036 24572 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:54.301860 24572 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:54.302076 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:54.302934 21226 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:54.302656 24572 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:54.304441 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:54.301859 24840 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.305991 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.306608 21226 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.307433 24840 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.251820 24801 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.309038 24631 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:54.310729 24801 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.311942 24572 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:54.313112 24796 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.313476 21226 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:54.316272 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.317003 21805 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
W20260709 13:07:54.317409 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.317521 21300 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:54.317906 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.318933 21805 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:54.320423 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 393958us
I20260709 13:07:54.322952 21144 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:54.323671 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.276939 21812 rpcz_store.cc:276] 0709 13:07:52.556067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.558355 (+  2288us) service_pool.cc:224] Handling call
0709 13:07:52.558783 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.559159 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:53.199600 (+640441us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.246853 (+1047253us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.247170 (+   317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.247231 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.247313 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.247560 (+   247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.247708 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81754,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":3326,"thread_start_us":919287,"threads_started":2,"wal-append.queue_time_us":640600}
I20260709 13:07:54.332440 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:54.333124 21293 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.351402 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.353747 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.355103 21145 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.358958 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.360826 21143 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:54.359716 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.350649 24836 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.362653 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1956) took 1198 ms. Trace:
I20260709 13:07:54.366700 21144 rpcz_store.cc:276] 0709 13:07:53.159478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.043412 (+883934us) service_pool.cc:224] Handling call
0709 13:07:54.043711 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.323363 (+279652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.357305 (+ 33942us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400065c54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:54.357534 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634002304}
W20260709 13:07:54.336130 24729 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:07:54.368678 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.369272 21292 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:54.370014 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.370571 21295 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:07:54.370687 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 110810us
W20260709 13:07:54.370584 21263 connection.cc:256] RPC call timeout handler was delayed by -3.1099583589999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
W20260709 13:07:54.371650 21263 connection.cc:256] RPC call timeout handler was delayed by -3.0568583589999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
I20260709 13:07:54.337106 24736 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.375718 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:54.378762 21294 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.382051 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.382400 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.383044 21151 raft_consensus.cc:2410] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:54.383190 21144 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:54.382090 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:54.384603 21143 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:54.396961 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.407980 21148 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:54.408638 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1958) took 1248 ms. Trace:
I20260709 13:07:54.412210 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.408993 21148 rpcz_store.cc:276] 0709 13:07:53.160085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.973367 (+813282us) service_pool.cc:224] Handling call
0709 13:07:54.408580 (+435213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.422181 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:54.422870 21295 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.423112 21293 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:07:54.368288 24840 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.426854 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.424889 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.428380 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.429807 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:54.431180 21300 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.429926 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.433221 21146 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:54.433301 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:54.431701 21263 connection.cc:256] RPC call timeout handler was delayed by -2.0319978189999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:07:54.433763 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:54.433980 21263 connection.cc:256] RPC call timeout handler was delayed by -1.8186978189999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:07:54.434018 21297 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:54.434644 21263 connection.cc:256] RPC call timeout handler was delayed by -1.7835978189999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 13:07:54.434712 21149 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:54.434981 21263 connection.cc:256] RPC call timeout handler was delayed by -1.5801978189998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:07:54.427028 24837 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:54.403880 24822 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.426817 24736 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.420733 24855 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:54.376425 24729 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:54.454046 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.454172 21812 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:54.454519 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.454847 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.458168 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:54.460057 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.440106 24840 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.460858 21149 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:54.462149 24611 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:54.466104 21299 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:54.465899 24674 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.466481 21299 pending_rounds.cc:85] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:07:54.466737 21299 pending_rounds.cc:107] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:54.467031 21299 raft_consensus.cc:2889] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.444711 24717 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.450913 24736 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.436172 24723 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.467895 24736 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.468400 24723 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.469465 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2133) took 1928 ms. Trace:
I20260709 13:07:54.469506 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.466799 21300 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:54.470044 21298 rpcz_store.cc:276] 0709 13:07:52.540662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.637954 (+ 97292us) service_pool.cc:224] Handling call
0709 13:07:52.662544 (+ 24590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.395018 (+732474us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:54.109645 (+714627us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.336164 (+226519us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.370138 (+ 33974us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.370287 (+   149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:54.370319 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.370383 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.469279 (+ 98896us) raft_consensus.cc:1685] finished
0709 13:07:54.469301 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.469411 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22891,"prepare.queue_time_us":31736,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":55507,"raft.queue_time_us":581583,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":48742,"thread_start_us":1565916,"threads_started":3,"wal-append.queue_time_us":306926}
I20260709 13:07:54.471911 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.472808 21151 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:54.474918 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:54.475126 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.476840 24729 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:54.477423 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:54.478359 24631 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:54.376204 24836 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.479547 24524 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.479935 24524 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.480769 24836 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:54.462222 24840 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.480959 24524 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.482059 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.482295 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.479890 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.483206 21806 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:54.484184 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.484656 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:54.482182 24524 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.485949 21809 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.487540 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:54.451527 24837 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.487924 21807 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:54.484776 21808 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:54.488787 21292 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:07:54.486114 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.489718 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.489722 24855 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:54.490471 21806 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:54.491029 24855 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.493765 24717 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:54.494957 24717 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.484596 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.503304 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.504226 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:54.505983 21148 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:54.478360 21151 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.506387 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.510150 21294 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:54.505395 21150 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:54.480814 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.516650 24674 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.517656 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.518666 24631 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:54.521286 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:54.446149 24822 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.528909 21264 leader_election.cc:336] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.639s (SENT)
I20260709 13:07:54.546104 21297 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:54.552416 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:54.560317 21190 connection.cc:256] RPC call timeout handler was delayed by -2.18957458400007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:07:54.560812 21190 connection.cc:256] RPC call timeout handler was delayed by -2.1096073110001043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:07:54.561147 21190 connection.cc:256] RPC call timeout handler was delayed by -1.0762745840000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
I20260709 13:07:54.561800 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:54.536676 24683 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:07:54.563791 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 111187us
I20260709 13:07:54.565349 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.567560 24674 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:54.532825 24822 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:54.581274 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 662353us
I20260709 13:07:54.594588 24866 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:54.597381 21811 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:54.536489 24801 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:54.599911 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.600567 21297 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:07:54.600857 24801 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:54.601362 24801 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.601683 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.602543 21295 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:54.602254 24801 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.599408 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.552259 24529 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:07:54.615454 24599 consensus_meta.cc:287] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 13:07:54.616629 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:54.617085 21145 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:54.617298 21810 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:54.635684 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.638688 21295 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:54.639146 21295 pending_rounds.cc:85] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:07:54.639406 21295 pending_rounds.cc:107] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:54.639671 21295 raft_consensus.cc:2889] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.640988 21297 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.639479 24529 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.642544 24723 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.642588 24529 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.644207 24529 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.652498 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.653287 21292 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.653678 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.653301 21297 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:54.654268 21295 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:54.654520 21298 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:07:54.657029 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.658409 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.659165 24674 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.659603 24837 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.659878 24674 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.660141 21294 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:54.613067 24856 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:07:54.681965 21151 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:07:54.683346 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 165838us
I20260709 13:07:54.693826 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.695153 21189 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.716176 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.716359 24844 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.716957 24844 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:54.717139 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.717433 24844 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.717975 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.719461 24623 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.719595 24571 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.719895 24623 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.720183 24571 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.720360 24623 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.720690 24571 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.715445 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.725879 21298 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:54.726752 21295 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.727840 21294 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:54.729462 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45427.8us
I20260709 13:07:54.719141 24572 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:54.731060 21049 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 6, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 6 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.735019 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.737551 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.738183 21297 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:54.739367 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.742714 21049 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 9, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.749536 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.736917 24732 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.769408 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.770253 21297 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 5: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:54.761919 21049 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:54.755575 24631 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.785595 24631 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.757027 24854 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:54.797133 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 103659us
I20260709 13:07:54.745201 24717 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:54.739773 24736 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:54.801123 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 232861us
I20260709 13:07:54.802496 21049 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:54.836932 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:54.839430 21297 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:54.797685 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 78941us
W20260709 13:07:54.804440 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 205104us
I20260709 13:07:54.842360 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:54.810068 24874 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.813359 24611 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.817595 24524 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:54.747926 24853 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:54.783829 24599 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:54.776580 24797 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.821498 24873 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.758587 24530 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:54.842361 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:54.852047 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 156935us
I20260709 13:07:54.859660 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.852149 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:54.853822 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.860543 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.862825 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.839231 24572 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:54.845616 21049 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 4, term changed from 4 to 7, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted, no longer has a pending config: VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:54.800288 24732 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.845371 24874 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.858122 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.851603 24529 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.871023 24529 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:54.871475 24529 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.856444 24801 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:54.870519 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.877049 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.877868 24836 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.877998 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:54.878284 24836 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:54.878726 24836 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.879451 24729 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.879302 24882 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:54.879652 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.879908 24729 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.880313 24882 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.880527 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:54.880709 24882 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.880326 24729 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.881892 24611 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.882401 24611 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:54.882843 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.883309 24611 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.883831 24888 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:54.887506 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.856048 24797 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.889987 21049 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 7, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 7 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.894050 24683 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.894593 24683 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.895538 24683 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.899901 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.901399 21116 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:54.902806 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.862802 24887 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:54.913376 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:54.917995 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.863111 24524 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.868558 24674 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.926433 24530 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.921397 24529 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.931216 24572 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.879288 24861 raft_consensus.cc:2764] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:54.933442 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:54.933374 24836 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:54.911538 24801 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.934435 24801 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:54.881191 24882 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:54.947811 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 94926.7us
I20260709 13:07:54.949179 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:54.898295 24717 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.899080 24797 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.935375 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.906586 24873 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:54.914947 24796 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.935714 24674 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:54.891932 24883 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
W20260709 13:07:54.983549 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 50180.7us
I20260709 13:07:54.965386 24717 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:54.987855 24717 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.988335 24529 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:54.989696 24524 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:54.991477 24836 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:54.991891 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 56640.2us
I20260709 13:07:54.974977 24578 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.971793 24861 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.971009 24873 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:54.972065 24796 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:07:54.981177 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 79845.1us
I20260709 13:07:55.010594 21049 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:54.973199 24884 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.013176 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 64109.4us
I20260709 13:07:55.021186 21049 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 8, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 8 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:54.998124 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 128864us
I20260709 13:07:55.025992 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.016530 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:54.921144 24840 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:07:55.013244 24877 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:54.936044 24887 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.033515 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.034408 24852 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:55.034593 24572 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:55.035085 24572 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:55.035547 24572 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:55.035143 24852 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.037077 24852 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.034420 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.046769 24885 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.047528 24885 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.048786 24885 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.029399 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:55.055687 24895 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.981787 24674 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.058609 21049 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:55.057283 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:55.063548 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77760.2us
I20260709 13:07:55.064276 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:54.982245 24878 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.067040 21218 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:55.070364 24571 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.073369 24571 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:55.075451 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:55.077237 24571 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:55.077782 24571 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:54.936941 24801 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.079960 24801 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.068190 21049 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:55.078696 24571 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.014540 24873 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.021687 24796 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.092514 21298 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:55.057957 24599 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.030436 24877 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:55.107244 21226 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:55.119738 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 201828us
I20260709 13:07:55.122296 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:55.086547 24723 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:55.129678 21049 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.098191 24883 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:55.107009 24599 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:55.144446 24530 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:55.120684 24736 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.124176 24877 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:55.103380 24855 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:07:55.178828 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 89807.9us
W20260709 13:07:55.218871 24890 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:54.992978 24874 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.159760 21049 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 8, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 8 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:55.223733 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 137520us
I20260709 13:07:55.135094 24683 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:55.227111 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82925.9us
I20260709 13:07:55.221693 24572 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.230427 21049 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:07:55.230984 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 166760us
I20260709 13:07:55.142763 24599 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.313448 24874 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.300076 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 177271us
I20260709 13:07:55.147681 24883 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.130602 24844 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.137882 24723 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.437999 24723 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.438859 24572 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:55.340711 24729 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.440944 24729 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:55.351495 24797 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.442076 21145 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:55.443012 24797 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:55.352734 24887 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:55.443661 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.309585 24703 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:07:55.334365 24896 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:07:55.445927 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.446521 21298 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.451813 24861 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:55.452242 24861 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:55.453090 24861 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.454075 24861 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.458871 24844 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:55.353821 24623 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.000s
I20260709 13:07:55.418435 24854 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.460337 24623 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.460896 24854 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.462481 24623 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:55.462939 24854 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.361610 24882 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.366039 24674 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:55.368561 24822 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.000s
I20260709 13:07:55.494500 24882 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.494771 24822 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.496867 24822 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.369072 24873 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.498852 24873 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.233855 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:55.491128 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.499783 24836 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.499894 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 266106us
I20260709 13:07:55.500697 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:55.501379 24836 raft_consensus.cc:2764] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:55.501418 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:55.502323 24873 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:55.381065 21049 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.504118 21049 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 7, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:55.505615 21049 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 9, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:55.284593 24899 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.298656 24736 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:55.228066 24732 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.463999 24875 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:55.511065 24875 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:55.488627 24877 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.494503 24674 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.467860 24883 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.515931 24877 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:55.468837 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:55.519361 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50613.4us
I20260709 13:07:55.521971 24887 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:55.522428 24887 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.523216 24887 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.526472 24888 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:55.527659 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.528220 21219 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:55.528506 21219 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:55.528687 24888 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:55.529243 21219 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.475507 24856 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:55.476032 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 197780us
I20260709 13:07:55.530040 24856 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:55.530977 24856 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.469585 24721 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.532320 24721 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:55.532738 21219 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:55.533134 24721 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.476958 24866 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:55.477229 24881 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.479862 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:55.534910 21292 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:07:55.536553 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.537220 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.537637 24703 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:55.537999 24703 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:55.539419 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.539906 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:07:55.540736 24891 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:55.541289 24891 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.541857 21151 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:55.542120 24891 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:55.543689 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.543929 24866 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.544286 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 64868.7us
I20260709 13:07:55.544454 24866 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.545763 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.546496 24866 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:55.548439 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:55.550319 21292 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:55.544286 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.529631 24778 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:55.576758 21218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
W20260709 13:07:55.476466 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58180.3us
I20260709 13:07:55.578285 21190 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:55.578574 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.531963 24856 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.476611 24901 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.577349 21218 raft_consensus.cc:606] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:55.536384 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 76307us
I20260709 13:07:55.507079 21049 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 6, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:07:55.540831 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.357833 24717 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:55.483522 24886 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.384s	user 0.005s	sys 0.000s
I20260709 13:07:55.599639 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:55.555444 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:55.583420 24578 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.002s
I20260709 13:07:55.555721 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.623427 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.624142 21222 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:55.579195 21147 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.579520 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:55.534091 24721 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.583101 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.574851 24866 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:55.538785 24703 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.597008 24877 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.598220 21143 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.603152 21151 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:55.604736 21146 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:55.611577 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:55.605829 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:55.606465 21150 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:55.575021 24736 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.665406 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.617089 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:55.620595 21049 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 7, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:55.614215 21220 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:55.557030 21298 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:55.618752 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.670699 21144 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:55.659088 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.660488 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.671484 21217 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.671717 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.576257 24778 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:07:55.659824 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 60253.5us
I20260709 13:07:55.676923 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.677541 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:55.669934 21049 catalog_manager.cc:5697] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:07:55.679658 21049 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:07:55.686493 21033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74974.1us
I20260709 13:07:55.687706 21148 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:55.673673 21808 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:55.607085 24907 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:55.675398 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.008s	sys 0.012s
W20260709 13:07:55.703483 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.008s	sys 0.012s
W20260709 13:07:55.703840 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 647374us
I20260709 13:07:55.699852 21806 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:55.693547 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:55.701996 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.634137 24853 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:55.661415 24899 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:55.675239 24736 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.737337 24736 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.687382 24822 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.720201 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:55.722626 21218 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.746471 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.631995 24854 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.671114 24578 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:55.692953 24674 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:55.676982 24794 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.599202 24796 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.733888 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:55.701483 24881 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.703413 24907 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:55.738443 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.739142 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.777498 21810 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:55.704506 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.741777 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.742673 21291 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:55.742710 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.778467 21299 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.742923 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.688135 24892 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:55.739030 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:55.790743 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 86307.9us
I20260709 13:07:55.741508 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:55.791433 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:55.752765 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:55.725689 21147 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:55.756880 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.758309 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:55.760192 21296 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:55.796353 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.798161 21296 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:07:55.760619 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:55.799633 21297 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:55.801856 21297 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:55.807183 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.768788 21808 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:55.761117 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:55.811555 21298 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:55.770591 21142 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
I20260709 13:07:55.618713 24901 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.742899 24836 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.678107 24866 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.813846 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:55.818998 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:55.821614 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.759759 24823 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.823758 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 130274us
I20260709 13:07:55.845768 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:55.824608 21145 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.826907 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:55.827491 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:55.838585 21300 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:55.846724 21142 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:55.847564 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.771083 24873 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.843137 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.763813 24899 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.843752 21220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:07:55.852739 21220 raft_consensus.cc:606] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:55.853055 21220 raft_consensus.cc:614] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:55.853153 21812 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:55.844899 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.767752 24530 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.847683 21299 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:07:55.838783 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 139318us
I20260709 13:07:55.848414 21292 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.771713 24822 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:55.792171 24907 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.790310 24892 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:55.859710 21291 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:55.867391 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.816921 24578 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:55.768249 24674 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.879873 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:55.886160 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.733333 24853 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.886906 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:55.889284 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:55.892261 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:55.892786 21300 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.897040 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.762639 24854 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:55.850958 24683 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.902081 21812 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.903753 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:55.971248 21812 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:55.774595 24794 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.923980 21219 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 5.
W20260709 13:07:55.880959 24904 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:55.963178 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.956001 21300 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:07:55.840229 24836 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:56.022784 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 158520us
I20260709 13:07:55.888482 24892 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:55.893556 24797 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.906803 24683 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.024020 21812 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.125223 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:56.124951 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:55.938525 24881 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.805951 24778 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.128901 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:56.128772 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:55.878754 24882 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:07:55.862571 24873 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.936996 24909 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.252s
I20260709 13:07:56.175844 21151 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:55.857869 24823 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.133287 21813 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:56.029181 24886 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:56.136705 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:56.137547 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 115714us
I20260709 13:07:55.895398 24884 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.235s
I20260709 13:07:56.066725 24889 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.163561 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.152379 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:56.167675 21808 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:56.167804 24912 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:07:56.133008 24891 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:56.164997 21811 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:55.870328 24530 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.855180 24875 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:55.888053 24877 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
W20260709 13:07:56.155792 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 310095us
I20260709 13:07:56.172187 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:56.155637 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.179567 21812 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:56.184176 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.148273 24867 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.161301 24683 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.149514 24717 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:56.163879 24887 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.227075 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:56.202353 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.240764 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:56.148187 24797 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:56.198855 21142 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.190255 24909 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.175449 24888 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:56.257838 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:56.273999 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2498) took 1548 ms. Trace:
I20260709 13:07:56.274605 21293 rpcz_store.cc:276] 0709 13:07:54.725918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.726067 (+   149us) service_pool.cc:224] Handling call
0709 13:07:54.732854 (+  6787us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:54.733221 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.733247 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.733874 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:07:54.842077 (+108203us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:54.862028 (+ 19951us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.864304 (+  2276us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.868653 (+  4349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.868771 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.441587 (+572816us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b1800107bc0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b72ca3328 00007f2b72c9a901 00007f2b72c9a8a7 00007f2b72d92288 00007f2b72d91f37 00007f2b72da655c 00007f2b72da6508
0709 13:07:56.273687 (+832100us) raft_consensus.cc:1685] finished
0709 13:07:56.273723 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.273919 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26155,"prepare.queue_time_us":25597,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1790,"raft.queue_time_us":6374,"raft.run_cpu_time_us":3820,"raft.run_wall_time_us":598921,"spinlock_wait_cycles":18128768,"thread_start_us":106991,"threads_started":1,"wal-append.queue_time_us":259257}
I20260709 13:07:56.242004 24571 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.289875 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:56.197511 24889 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:56.296317 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123338us
I20260709 13:07:56.292392 21151 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:56.229491 24891 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.295790 21814 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:56.257337 24796 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:56.179185 24822 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:56.185335 24898 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.464s
I20260709 13:07:56.319620 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:56.319847 21146 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:56.252804 24910 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.327078 21223 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:56.318488 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.328830 21225 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:56.281064 24717 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:56.321322 21293 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:56.333117 21142 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:56.272225 24875 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.176477 24881 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:56.338117 24599 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.903s	user 0.008s	sys 0.001s
I20260709 13:07:56.338544 24599 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:56.340719 24599 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:56.343137 21812 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:07:56.343511 21812 pending_rounds.cc:85] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 9
I20260709 13:07:56.343722 21812 pending_rounds.cc:107] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:07:56.343978 21812 raft_consensus.cc:2889] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.344651 21149 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.346781 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.348206 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.348867 21224 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:07:56.351743 21144 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
I20260709 13:07:56.352362 21144 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:56.294966 24840 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.298239 24529 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.354280 21226 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
W20260709 13:07:56.315801 24861 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.004s
W20260709 13:07:56.324085 24874 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.001s
W20260709 13:07:56.398660 21217 consensus_meta.cc:287] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.000s
I20260709 13:07:56.422961 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:07:56.355683 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.357684 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:56.357754 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:07:56.361090 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 134086us
W20260709 13:07:56.363286 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.280974 24882 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:07:56.465178 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 179017us
I20260709 13:07:56.319787 24901 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.482340 21293 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:56.477035 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:56.475219 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:56.484889 21291 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:56.490576 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.347434 24717 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:56.361958 24908 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.495s	user 0.000s	sys 0.001s
I20260709 13:07:56.242301 24867 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.498405 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:56.545625 21805 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.294062 24909 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:56.363667 24529 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:56.512846 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:56.540346 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:56.480144 21776 connection.cc:256] RPC call timeout handler was delayed by -2.2699854309998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:07:56.475225 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:56.479930 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.600095 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:56.312300 24571 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.491782 21297 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:56.604249 21297 pending_rounds.cc:85] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 3
I20260709 13:07:56.604539 21297 pending_rounds.cc:107] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:56.604804 21297 raft_consensus.cc:2889] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.616921 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.476177 24674 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:56.618117 21217 raft_consensus.cc:2410] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:56.669981 21296 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:56.358271 24578 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:56.617010 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:56.500478 24854 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:56.627022 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.726150 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:56.726944 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.582829 24916 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.453s	user 0.000s	sys 0.001s
I20260709 13:07:56.624787 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:56.589738 24914 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.578s	user 0.001s	sys 0.000s
I20260709 13:07:56.543316 24881 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.599861 24901 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.622696 24882 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:56.727447 21291 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:56.691327 21146 raft_consensus.cc:2376] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8. Re-sending same reply.
I20260709 13:07:56.689668 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:56.775460 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 347157us
I20260709 13:07:56.776168 21223 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:56.771376 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:56.620846 24910 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:56.783041 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:56.784183 21146 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:56.670308 24866 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.783562 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.686972 24861 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.786736 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 192442us
W20260709 13:07:56.799386 21298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.009s	sys 0.000s
I20260709 13:07:56.803818 21291 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:56.784965 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.687237 24836 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.806243 21217 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 6: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:56.814177 21298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.000s
I20260709 13:07:56.860404 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2158) took 1103 ms. Trace:
I20260709 13:07:56.914839 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:56.914983 21297 rpcz_store.cc:276] 0709 13:07:55.757339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.802609 (+ 45270us) service_pool.cc:224] Handling call
0709 13:07:55.802902 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.617478 (+814576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.860050 (+242572us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54003d3454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:56.860319 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583500032}
I20260709 13:07:56.915694 21146 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:07:56.860947 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.008s	sys 0.001s
I20260709 13:07:56.813788 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:56.916939 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 140733us
I20260709 13:07:56.917600 21263 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:56.916277 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.008s	sys 0.005s
I20260709 13:07:56.873039 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:56.929551 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.933459 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:56.874577 24732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.017s	sys 0.058s
W20260709 13:07:56.936662 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 122961us
I20260709 13:07:56.785856 24873 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:56.951534 21292 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.050s	user 0.011s	sys 0.000s
I20260709 13:07:56.952046 21292 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
W20260709 13:07:56.804765 24922 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.647s	user 0.001s	sys 0.000s
I20260709 13:07:56.912474 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1984) took 1374 ms. Trace:
I20260709 13:07:56.790560 24882 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.967569 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 669) took 1131 ms. Trace:
I20260709 13:07:56.785620 24853 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.972342 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:56.974746 21144 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
W20260709 13:07:56.863193 24921 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.687s	user 0.000s	sys 0.001s
I20260709 13:07:56.807641 24901 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:56.958477 21149 rpcz_store.cc:276] 0709 13:07:55.538448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.542864 (+  4416us) service_pool.cc:224] Handling call
0709 13:07:55.543158 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.345059 (+801901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.912125 (+567066us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540017be54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:56.912390 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842879744}
I20260709 13:07:56.790084 24854 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.960773 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2506) took 1897 ms. Trace:
I20260709 13:07:56.989758 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:07:56.934886 24732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.017s	sys 0.059s
I20260709 13:07:56.992340 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:56.961304 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:56.873911 24823 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:56.992780 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:56.997411 21814 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.989542 21295 rpcz_store.cc:276] 0709 13:07:55.063111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.063615 (+   504us) service_pool.cc:224] Handling call
0709 13:07:55.091793 (+ 28178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.103778 (+ 11985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.103822 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.125568 (+ 21746us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.630856 (+505288us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:55.630892 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.630955 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.960480 (+1329525us) raft_consensus.cc:1685] finished
0709 13:07:56.960510 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.960699 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317804,"raft.queue_time_us":15478,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":320390,"thread_start_us":485645,"threads_started":1,"wal-append.queue_time_us":613806}
I20260709 13:07:56.981027 21114 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:56.977380 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1582) took 1213 ms. Trace:
I20260709 13:07:56.999635 21151 rpcz_store.cc:276] 0709 13:07:55.764072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.176861 (+412789us) service_pool.cc:224] Handling call
0709 13:07:56.177143 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.316017 (+138874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.977128 (+661111us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001f7a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:56.977323 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264524672}
I20260709 13:07:57.001022 21151 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:57.001137 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.804591 24940 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:57.004670 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.049s	sys 0.136s
I20260709 13:07:57.005038 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2505) took 1942 ms. Trace:
W20260709 13:07:57.006038 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 88515.1us
I20260709 13:07:57.006763 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:56.991469 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.005488 21294 rpcz_store.cc:276] 0709 13:07:55.062834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.063543 (+   709us) service_pool.cc:224] Handling call
0709 13:07:55.098662 (+ 35119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.107983 (+  9321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.108030 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.123672 (+ 15642us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.695854 (+572182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:55.867099 (+171245us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.887052 (+ 19953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.887118 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.004830 (+1117712us) raft_consensus.cc:1685] finished
0709 13:07:57.004852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.004985 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181510,"prepare.queue_time_us":459991,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":148867,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":250215,"thread_start_us":581658,"threads_started":2,"wal-append.queue_time_us":680159}
W20260709 13:07:57.008875 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 390300us
I20260709 13:07:57.009064 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2561) took 1260 ms. Trace:
I20260709 13:07:57.011375 21144 raft_consensus.cc:2410] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:56.976130 24909 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:56.991209 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1014) took 1436 ms. Trace:
I20260709 13:07:56.989820 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.015700 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:57.005146 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.049s	sys 0.136s
I20260709 13:07:57.009544 21218 rpcz_store.cc:276] 0709 13:07:55.749086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.760243 (+ 11157us) service_pool.cc:224] Handling call
0709 13:07:55.760534 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.849857 (+ 89323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.849900 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.866045 (+ 16145us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.228898 (+362853us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:56.229047 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.989206 (+760159us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400116a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:56.989255 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.995805 (+  6550us) raft_consensus.cc:1685] finished
0709 13:07:56.995832 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.008992 (+ 13160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51922,"raft.queue_time_us":11754,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":31240,"spinlock_wait_cycles":177765248,"thread_start_us":199832,"threads_started":1,"wal-append.queue_time_us":1011692}
I20260709 13:07:56.940433 24881 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:07:57.017066 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 697467us
I20260709 13:07:56.952869 24874 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:56.970829 24882 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:56.996192 24910 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:56.960788 24797 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:56.968207 21292 rpcz_store.cc:276] 0709 13:07:55.821658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.842906 (+ 21248us) service_pool.cc:224] Handling call
0709 13:07:56.952598 (+1109692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.874687 24861 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.036957 21776 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.857s (SENT)
I20260709 13:07:57.040143 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:57.055576 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.008387 24940 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:56.974825 24530 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.042526 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.033396 24853 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.015275 21813 rpcz_store.cc:276] 0709 13:07:55.554355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.554471 (+   116us) service_pool.cc:224] Handling call
0709 13:07:55.616743 (+ 62272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.180422 (+563679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.990956 (+810534us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54004ea054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:56.991147 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534955904}
I20260709 13:07:56.807538 24717 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.019981 24836 raft_consensus.cc:2764] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:07:57.063489 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56784.9us
I20260709 13:07:57.036325 24909 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:57.087729 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.088451 24901 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.088954 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.089555 21813 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:57.072253 24936 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:57.090529 21813 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:57.090276 24936 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.081596 24797 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:57.091689 24797 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:57.092520 24936 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.080837 24889 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.092660 24797 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.093840 24856 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.487s	user 0.007s	sys 0.001s
I20260709 13:07:57.094429 21145 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:57.057428 24891 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.066344 24766 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:57.097946 24721 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.424s	user 0.005s	sys 0.003s
I20260709 13:07:57.100035 24867 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.100189 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:57.100509 24907 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.202s	user 0.009s	sys 0.001s
W20260709 13:07:57.102030 24736 consensus_meta.cc:287] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.364s	user 0.011s	sys 0.000s
I20260709 13:07:57.102501 24867 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.102449 24736 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.103806 24571 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:57.107857 24882 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.014268 24578 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.111537 24736 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.100912 24907 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.114423 24939 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:57.115072 24907 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.115664 24882 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:57.116024 24892 consensus_meta.cc:287] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.984s	user 0.003s	sys 0.007s
I20260709 13:07:57.116401 24892 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.119500 24932 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.120572 24683 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.000s
I20260709 13:07:57.120223 24932 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.120967 24683 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.122135 21223 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:57.123607 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.124716 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.125335 24887 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:57.039813 24881 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.068192 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1017) took 1492 ms. Trace:
I20260709 13:07:57.125770 24887 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.126196 21217 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:57.126078 21807 rpcz_store.cc:276] 0709 13:07:55.575887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.577570 (+  1683us) service_pool.cc:224] Handling call
0709 13:07:55.617182 (+ 39612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.617552 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.617580 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.618070 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.775662 (+157592us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:55.775698 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.775761 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.067916 (+1292155us) raft_consensus.cc:1685] finished
0709 13:07:57.067955 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.068122 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5305,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":26772,"spinlock_wait_cycles":19840,"thread_start_us":157242,"threads_started":1,"wal-append.queue_time_us":320005}
W20260709 13:07:57.127694 24927 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.608s	user 0.001s	sys 0.000s
I20260709 13:07:57.128669 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1019) took 1525 ms. Trace:
I20260709 13:07:57.045008 21144 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:07:57.040642 24874 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.129031 21809 rpcz_store.cc:276] 0709 13:07:55.602916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.604060 (+  1144us) service_pool.cc:224] Handling call
0709 13:07:55.632439 (+ 28379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.673764 (+ 41325us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:55.673793 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.704707 (+ 30914us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.156365 (+451658us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:56.156392 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.156450 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.128465 (+972015us) raft_consensus.cc:1685] finished
0709 13:07:57.128482 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.128611 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16355,"raft.queue_time_us":43316,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5096,"thread_start_us":335484,"threads_started":1,"wal-append.queue_time_us":544528}
I20260709 13:07:57.071866 24866 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:57.130635 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2162) took 1293 ms. Trace:
I20260709 13:07:57.072700 24938 raft_consensus.cc:993] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:07:57.131129 21809 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:57.131726 24925 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:07:57.131845 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1103) took 1002 ms. Trace:
I20260709 13:07:57.072194 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:57.132457 24938 raft_consensus.cc:1081] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:07:57.125694 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.132961 24940 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.133538 21225 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:57.133697 21223 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:57.134230 24940 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.134747 21225 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:56.989583 24854 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.101928 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:57.129022 24930 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:07:57.074029 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:57.076059 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:56.941216 24529 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.127276 24881 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.123744 21222 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:57.135522 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2559) took 1440 ms. Trace:
I20260709 13:07:57.135840 24674 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.137161 21220 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:07:57.140123 21805 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 13:07:57.140473 21805 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:57.140621 21220 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:57.140980 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1099) took 1012 ms. Trace:
I20260709 13:07:57.137738 24881 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.131131 24866 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:57.138123 21151 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:57.139165 21221 rpcz_store.cc:276] 0709 13:07:55.695030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.700294 (+  5264us) service_pool.cc:224] Handling call
0709 13:07:55.735372 (+ 35078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.744531 (+  9159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.744570 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.745012 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.054614 (+309602us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:56.054675 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.054772 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.135321 (+1080549us) raft_consensus.cc:1685] finished
0709 13:07:57.135341 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.135470 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8704,"raft.queue_time_us":9418,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":22708,"thread_start_us":247734,"threads_started":1,"wal-append.queue_time_us":728563}
I20260709 13:07:57.140975 21220 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:57.131182 24874 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.144207 24854 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.142073 24866 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:57.144513 21220 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.145586 21220 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:57.137152 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63228.6us
I20260709 13:07:57.128691 21217 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:57.131016 21293 rpcz_store.cc:276] 0709 13:07:55.837126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.330857 (+493731us) service_pool.cc:224] Handling call
0709 13:07:56.331152 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.482816 (+151664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.130435 (+647619us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540022c9d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:57.130580 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347258112}
W20260709 13:07:57.135208 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.137565 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:57.148221 21814 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:07:57.141160 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.039439 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 101542us
I20260709 13:07:57.152019 21808 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:57.132239 21809 rpcz_store.cc:276] 0709 13:07:56.128931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.130707 (+1001776us) service_pool.cc:224] Handling call
0709 13:07:57.130970 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.131643 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.131798 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.150297 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:57.156157 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.135057 21223 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:57.157459 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.178418 21223 pending_rounds.cc:85] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 7
I20260709 13:07:57.178845 21223 pending_rounds.cc:107] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:57.179390 21223 raft_consensus.cc:2889] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.148236 21805 rpcz_store.cc:276] 0709 13:07:56.128048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.458661 (+330613us) service_pool.cc:224] Handling call
0709 13:07:57.140905 (+682244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.168874 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.187093 21225 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:07:57.192221 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.192711 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.193203 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.193420 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:57.190582 21143 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:57.199322 21813 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.200215 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1098) took 1072 ms. Trace:
I20260709 13:07:57.200606 21813 rpcz_store.cc:276] 0709 13:07:56.127815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.091236 (+963421us) service_pool.cc:224] Handling call
0709 13:07:57.199092 (+107856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.199934 (+   842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.200154 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:57.143996 24875 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.000s
I20260709 13:07:57.203727 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:57.204841 21221 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:57.156919 24892 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.137712 24529 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.137444 24717 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.139146 24861 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.205911 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:57.217675 21219 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.199221 24856 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.145557 24866 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.190830 24901 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:57.207086 24889 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.204295 24877 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:07:57.242775 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.243357 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.204296 24938 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:57.215502 24873 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.157001 24867 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.205880 24524 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.213666 24894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.012s	sys 0.028s
I20260709 13:07:57.160013 24836 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:57.169404 24874 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:57.155910 24674 raft_consensus.cc:2764] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:57.215124 24907 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.301928 21116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.001s	sys 0.015s
I20260709 13:07:57.196312 24854 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:07:57.251945 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 242202us
I20260709 13:07:57.221554 24856 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:57.278128 24951 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:57.269263 24884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.012s	sys 0.036s
I20260709 13:07:57.252506 24901 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:57.274622 24866 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.249341 24877 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.249516 24938 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.300949 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:57.275640 24910 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:57.212342 21220 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:57.302657 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.302690 21116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.002s	sys 0.015s
W20260709 13:07:57.320845 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 842727us
I20260709 13:07:57.301635 21219 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:57.321677 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 566) took 1018 ms. Trace:
I20260709 13:07:57.249496 24889 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.267571 24873 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.309221 21776 connection.cc:256] RPC call timeout handler was delayed by -2.2273715979998769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:07:57.299654 24894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.012s	sys 0.028s
I20260709 13:07:57.331686 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2166) took 1199 ms. Trace:
I20260709 13:07:57.283515 24524 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.324898 21189 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.918s (SENT) [suppressed 35 similar messages]
I20260709 13:07:57.308434 24856 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.322086 21219 rpcz_store.cc:276] 0709 13:07:56.303648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.159403 (+855755us) service_pool.cc:224] Handling call
0709 13:07:57.321605 (+162202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.324154 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.326033 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:57.310290 24884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.012s	sys 0.037s
I20260709 13:07:57.332127 21291 rpcz_store.cc:276] 0709 13:07:56.132021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.869376 (+737355us) service_pool.cc:224] Handling call
0709 13:07:56.869800 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.870110 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.870151 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.914678 (+ 44527us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.033332 (+118654us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.033385 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.033485 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.331359 (+297874us) raft_consensus.cc:1685] finished
0709 13:07:57.331379 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.331616 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":98338,"threads_started":1,"wal-append.queue_time_us":282906}
W20260709 13:07:57.307950 24878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.010s	sys 0.019s
I20260709 13:07:57.337070 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:07:57.304584 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 111226us
I20260709 13:07:57.342727 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.343223 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:57.349746 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:57.350128 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.350418 21776 connection.cc:256] RPC call timeout handler was delayed by -2.1777530589999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:07:57.350813 21776 connection.cc:256] RPC call timeout handler was delayed by -2.1644682499999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:07:57.351086 21776 connection.cc:256] RPC call timeout handler was delayed by -2.0501739319998933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31360000000000005s for a response
I20260709 13:07:57.351956 24901 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.353024 24889 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.338506 24703 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.315213 24951 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:57.355480 24957 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.356003 24951 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.358130 24954 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.358551 24954 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:57.312512 24867 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.362933 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.360451 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1102) took 1231 ms. Trace:
I20260709 13:07:57.365268 21807 rpcz_store.cc:276] 0709 13:07:56.128710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.127804 (+999094us) service_pool.cc:224] Handling call
0709 13:07:57.128120 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.128317 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.128343 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.128795 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.300282 (+171487us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.300316 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.300386 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.360170 (+ 59784us) raft_consensus.cc:1685] finished
0709 13:07:57.360199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.360381 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":171168,"threads_started":1,"wal-append.queue_time_us":180555}
I20260709 13:07:57.370406 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.373762 21813 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:57.308728 24907 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.360092 24878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.011s	sys 0.019s
I20260709 13:07:57.385651 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.386312 21292 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:57.378230 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.387630 21291 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:57.379297 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.383883 21806 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:57.364817 24889 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:57.391451 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.396716 21293 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:57.393290 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.397801 21807 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:57.401590 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.402369 21300 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:57.397764 21292 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:57.406220 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:57.407567 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:57.408046 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 65414us
I20260709 13:07:57.407191 21292 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.408275 21291 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:07:57.408882 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 84019.6us
I20260709 13:07:57.391973 24836 consensus_queue.cc:1243] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:57.388891 24732 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:57.434005 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.417943 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.372432 24867 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.417531 21292 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:07:57.438009 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:57.438512 21142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1584) took 1604 ms (client timeout 1705 ms). Trace:
I20260709 13:07:57.438133 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.447575 21150 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:57.439160 21146 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.449630 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.450332 21807 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.437181 24968 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.451589 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1104) took 1322 ms. Trace:
W20260709 13:07:57.444947 21142 rpcz_store.cc:269] 0709 13:07:55.833801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.858362 (+ 24561us) service_pool.cc:224] Handling call
0709 13:07:57.438350 (+1579988us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540031ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:57.438460 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717588224}
I20260709 13:07:57.453020 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.452139 21814 rpcz_store.cc:276] 0709 13:07:56.132538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.148986 (+1016448us) service_pool.cc:224] Handling call
0709 13:07:57.149289 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.162512 (+ 13223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.162557 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.206227 (+ 43670us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.297930 (+ 91703us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:57.311963 (+ 14033us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.312275 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.312370 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.451355 (+138985us) raft_consensus.cc:1685] finished
0709 13:07:57.451377 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.451535 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14826,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":42132,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":10497,"thread_start_us":52903,"threads_started":1,"wal-append.queue_time_us":172745}
I20260709 13:07:57.453712 21142 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:07:57.451524 24964 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:57.454782 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:57.455128 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:07:57.455689 24965 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:57.454860 24964 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:57.456481 24938 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.435448 24836 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.457402 24970 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.435501 24958 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:57.457441 24964 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.440089 24967 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:57.459822 24967 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.460157 24967 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.456010 21814 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.445819 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:57.470973 21295 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:57.474946 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:57.408244 24889 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.476686 21807 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:57.481441 21293 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:57.486178 21776 connection.cc:256] RPC call timeout handler was delayed by -1.9385682499998893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:07:57.390122 24954 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.486769 21776 connection.cc:256] RPC call timeout handler was delayed by -1.9329964309999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2256s for a response
I20260709 13:07:57.487497 21805 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.448077 24874 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:07:57.489681 21776 connection.cc:256] RPC call timeout handler was delayed by -1.8560768719999032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:07:57.490068 21776 connection.cc:256] RPC call timeout handler was delayed by -1.7497854309999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2701s for a response
W20260709 13:07:57.490339 21776 connection.cc:256] RPC call timeout handler was delayed by -1.5677682499999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 13:07:57.490679 21776 connection.cc:256] RPC call timeout handler was delayed by -1.1242344789999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
I20260709 13:07:57.490520 21814 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:57.438268 24732 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.476531 24938 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:57.497264 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.480216 24797 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.481598 24529 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:57.519924 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.522509 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.525506 24955 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:07:57.527700 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.497560 24861 raft_consensus.cc:476] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:57.520977 24852 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:07:57.530555 24852 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.530874 24852 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:57.531965 24524 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.531692 24852 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.449683 24974 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:07:57.532672 24852 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.536417 24887 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.538542 24887 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.443683 24910 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.542734 21144 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:57.545158 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:57.544957 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 111037us
I20260709 13:07:57.547022 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.547640 21807 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.546610 24976 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:57.551575 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.552644 21814 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:57.553463 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.555699 24778 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:57.556218 24889 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.558073 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:57.559463 21293 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [7.7-10.8]
I20260709 13:07:57.559779 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:57.564002 24901 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:57.564441 24901 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:57.585587 21807 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:57.525115 24938 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:57.592417 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.576756 24973 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.564810 24901 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.524672 24797 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.632782 24736 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.593945 24877 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.712487 21291 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:57.592123 21147 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:07:57.580991 24976 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:07:57.796373 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.633313 24721 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.791946 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.782845 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 181686us
W20260709 13:07:57.769598 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.822669 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.818955 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.824455 21807 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:57.826725 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.794557 24973 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.821420 24969 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:07:57.791942 24889 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.824348 24915 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.634s	user 0.007s	sys 0.007s
I20260709 13:07:57.782390 24732 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.821552 24964 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.849895 21293 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:57.892060 24852 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:57.830899 24901 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.890892 24889 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.896648 24901 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:57.871978 24975 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:07:57.887859 24938 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.865620 21300 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:57.888973 24873 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.892289 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:57.898955 24889 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.890599 24964 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.821805 24958 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:57.903971 24958 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.904923 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.906139 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:57.890977 24797 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.901288 24852 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.904305 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.887428 21809 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:57.897363 21814 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:57.918730 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:57.906716 24958 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:57.910344 21300 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:07:57.921675 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:57.921972 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.920702 24867 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:57.926215 21300 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:57.931334 24852 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:57.931795 24852 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.931905 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.932195 24852 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.924587 24910 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:57.910022 24964 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:57.935753 24910 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.937885 24910 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:57.940279 24794 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.942325 24732 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.942826 24732 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.943629 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.944449 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:57.944903 24732 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:57.921089 24947 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.950454 24947 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.950965 24873 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:57.951706 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1551) took 2214 ms (client timeout 2141 ms). Trace:
I20260709 13:07:57.952374 24889 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.952157 24873 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.826023 24721 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:57.952150 21226 rpcz_store.cc:269] 0709 13:07:55.737730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.738926 (+  1196us) service_pool.cc:224] Handling call
0709 13:07:57.951529 (+2212603us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540038e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:57.951638 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332517248}
I20260709 13:07:57.955138 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 671) took 2131 ms. Trace:
I20260709 13:07:57.821946 24736 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.955648 21299 rpcz_store.cc:276] 0709 13:07:55.823366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.349324 (+525958us) service_pool.cc:224] Handling call
0709 13:07:56.349651 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:56.460668 (+111017us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:56.499151 (+ 38483us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.083542 (+584391us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.083693 (+   151us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.084228 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.084385 (+   157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:57.084434 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.940044 (+855610us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b180046c180. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:07:57.954750 (+ 14706us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540037ffd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:57.954815 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.954877 (+    62us) raft_consensus.cc:1685] finished
0709 13:07:57.954896 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.955069 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45091,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":21438,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":47836,"spinlock_wait_cycles":337069952,"thread_start_us":309672,"threads_started":1,"wal-append.queue_time_us":517844}
I20260709 13:07:57.961143 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.971422 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.972194 21300 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:57.974030 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.973143 21292 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:57.976037 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.852140 24967 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:57.843523 24973 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.978591 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.835794 24856 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:57.980238 21300 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:57.952839 24889 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:57.980428 21808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1097) took 1852 ms (client timeout 1918 ms). Trace:
I20260709 13:07:57.981119 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:58.002847 21299 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.982185 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1011) took 2430 ms. Trace:
I20260709 13:07:57.954320 24947 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:58.004017 21810 rpcz_store.cc:276] 0709 13:07:55.547596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.547700 (+   104us) service_pool.cc:224] Handling call
0709 13:07:55.596554 (+ 48854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.788003 (+191449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.977452 (+2189449us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54004be454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:57.977632 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415610752}
W20260709 13:07:58.001806 21808 rpcz_store.cc:269] 0709 13:07:56.127591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.477129 (+349538us) service_pool.cc:224] Handling call
0709 13:07:57.980279 (+1503150us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54004ee154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:57.980373 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373526272}
W20260709 13:07:57.995663 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 95757us
I20260709 13:07:57.996745 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:57.980892 24867 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.997354 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:57.997931 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:57.968997 24721 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.009737 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:58.000371 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 667) took 2181 ms. Trace:
I20260709 13:07:58.012156 21298 rpcz_store.cc:276] 0709 13:07:55.815297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.815430 (+   133us) service_pool.cc:224] Handling call
0709 13:07:55.840566 (+ 25136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.870288 (+ 29722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.870317 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.890169 (+ 19852us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.869023 (+978854us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:56.869071 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.979973 (+1110902us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b540022e2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:57.980034 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.980084 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:57.980097 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.996134 (+ 16037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45993,"raft.queue_time_us":15622,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":18364,"spinlock_wait_cycles":50930944,"thread_start_us":734155,"threads_started":1,"wal-append.queue_time_us":1063638}
I20260709 13:07:58.014856 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.013059 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.018322 21292 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:58.019582 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.020300 21300 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:58.020181 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.021277 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.021790 21142 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9. Re-sending same reply.
I20260709 13:07:58.022573 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.025372 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.026351 21142 raft_consensus.cc:2376] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10. Re-sending same reply.
I20260709 13:07:58.026854 21299 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:58.027069 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.028347 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.028803 21142 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:58.029490 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.030637 21292 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:58.015791 24873 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.027189 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.037568 21189 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.031952 21142 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:58.033272 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.023736 24888 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.039754 21191 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.040544 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.018530 24867 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.044706 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.045110 21300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:07:58.045612 21300 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.045910 21300 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.054207 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.043500 24938 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.055090 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.041188 24529 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:58.048207 24983 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:07:58.044464 24873 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:58.042392 24955 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.058439 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.058044 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.066748 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.031622 24889 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.058780 24703 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.077605 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.074831 21300 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.079988 21294 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:58.060134 24732 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:58.086905 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47226.7us
I20260709 13:07:58.059170 24989 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.087193 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.072227 24889 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.092315 24967 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:58.071821 24856 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.074254 24703 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.096066 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.096359 24703 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.097302 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.097878 21150 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:58.099304 24736 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.100206 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 706) took 1755 ms. Trace:
I20260709 13:07:58.101318 21298 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.072809 24794 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.102432 24794 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.102777 24794 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.103495 24736 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.086150 24732 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.104211 24732 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.103976 24736 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.106187 24736 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:58.107649 24959 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.672s	user 0.006s	sys 0.007s
I20260709 13:07:58.108899 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 670) took 2287 ms. Trace:
W20260709 13:07:58.110044 21143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1578) took 2419 ms (client timeout 1703 ms). Trace:
W20260709 13:07:58.110433 21143 rpcz_store.cc:269] 0709 13:07:55.690227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.769825 (+ 79598us) service_pool.cc:224] Handling call
0709 13:07:58.109879 (+2340054us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540040e554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.109972 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2967927680}
I20260709 13:07:58.109252 21296 rpcz_store.cc:276] 0709 13:07:55.821933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.226951 (+405018us) service_pool.cc:224] Handling call
0709 13:07:56.227232 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.670466 (+443234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.108704 (+1438238us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54001a77d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.108850 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906268032}
I20260709 13:07:58.111521 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.103919 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 694) took 1816 ms. Trace:
I20260709 13:07:58.112401 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1034) took 1849 ms. Trace:
I20260709 13:07:58.112792 21809 rpcz_store.cc:276] 0709 13:07:56.263345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.167548 (+904203us) service_pool.cc:224] Handling call
0709 13:07:57.206080 (+ 38532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.910269 (+704189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.112198 (+201929us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54007481d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.112348 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566053632}
I20260709 13:07:58.100589 21151 rpcz_store.cc:276] 0709 13:07:56.344794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.001697 (+656903us) service_pool.cc:224] Handling call
0709 13:07:57.001931 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.142228 (+140297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.099950 (+957722us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001f7554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.100156 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312518400}
I20260709 13:07:58.115345 24934 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:58.115731 24934 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.116554 24934 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.117555 24934 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.123184 24932 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.124178 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:58.124752 21224 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:58.126650 21148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1573) took 2459 ms (client timeout 1827 ms). Trace:
I20260709 13:07:58.126802 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.127532 21226 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:07:58.127724 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2558) took 2438 ms. Trace:
I20260709 13:07:58.128273 24801 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:58.128638 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.129068 24801 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.129431 24801 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.130203 24801 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.130934 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.128046 21222 rpcz_store.cc:276] 0709 13:07:55.689585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.689780 (+   195us) service_pool.cc:224] Handling call
0709 13:07:55.728267 (+ 38487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.138425 (+1410158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.127482 (+989057us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000fc154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.127646 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3208911616}
I20260709 13:07:58.132081 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.132195 24932 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.132236 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:07:58.133059 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.132791 24932 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.133404 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:07:58.133673 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.133972 21222 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:58.134953 24932 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.135848 24801 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:58.136137 24990 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:07:58.136822 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:58.098685 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.137650 21150 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:58.138053 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.138381 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 1999) took 1001 ms. Trace:
I20260709 13:07:58.138727 21150 rpcz_store.cc:276] 0709 13:07:57.137215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.098462 (+961247us) service_pool.cc:224] Handling call
0709 13:07:58.138322 (+ 39860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.112082 21146 rpcz_store.cc:276] 0709 13:07:56.287168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.996827 (+709659us) service_pool.cc:224] Handling call
0709 13:07:57.438890 (+442063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.465149 (+ 26259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.103751 (+638602us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b540031ced0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.103869 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961540480}
W20260709 13:07:58.127032 21148 rpcz_store.cc:269] 0709 13:07:55.666801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.818775 (+151974us) service_pool.cc:224] Handling call
0709 13:07:58.125679 (+2306904us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000c06a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7de18 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.126452 (+   773us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540017cd54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.126589 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4584646784}
I20260709 13:07:58.115746 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.141527 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.142455 21219 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:07:58.087062 21300 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.090307 21142 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:58.074913 24855 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:58.089391 24988 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:58.091219 24529 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:58.086002 24854 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:58.085736 24888 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.144124 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.147226 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2003) took 1009 ms. Trace:
I20260709 13:07:58.153095 21151 rpcz_store.cc:276] 0709 13:07:57.138248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.115520 (+977272us) service_pool.cc:224] Handling call
0709 13:07:58.147152 (+ 31632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.139976 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.073948 24873 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.071424 24938 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.150831 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.088884 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:58.166253 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 77416.6us
I20260709 13:07:58.109440 24852 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.167300 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:58.168548 21145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 700) took 1835 ms (client timeout 1678 ms). Trace:
I20260709 13:07:58.169029 24852 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:58.169056 21145 rpcz_store.cc:269] 0709 13:07:56.333092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.566127 (+233035us) service_pool.cc:224] Handling call
0709 13:07:58.168337 (+1602210us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400180bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.168468 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808313728}
I20260709 13:07:58.175282 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:58.175902 21218 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.154561 21221 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:58.154879 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 75365.7us
I20260709 13:07:58.156323 21217 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:58.178419 21217 pending_rounds.cc:85] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 6
I20260709 13:07:58.178668 21217 pending_rounds.cc:107] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:58.178985 21217 raft_consensus.cc:2889] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.178783 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:58.179217 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.179693 21226 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:58.180202 21226 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.159976 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.181463 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.160631 21222 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:58.165082 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.179817 21150 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.182405 21145 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:58.162070 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.178148 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.184620 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.153841 24888 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:58.187297 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.163812 24855 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:07:58.243744 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 65670.1us
I20260709 13:07:58.225220 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.244478 21145 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:58.245266 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.245647 21145 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:58.246886 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 712) took 1777 ms. Trace:
I20260709 13:07:58.247208 21145 rpcz_store.cc:276] 0709 13:07:56.469120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.245080 (+1775960us) service_pool.cc:224] Handling call
0709 13:07:58.245399 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.246038 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.246837 (+   799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.178707 24929 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.251796 21218 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:07:58.227913 21300 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:58.253412 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.253299 24938 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.254076 21300 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:58.255508 24873 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.258829 24884 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.259330 24884 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.260351 24884 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.254985 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.228181 24995 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.228731 24887 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.229491 21295 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [7.7-10.8]
I20260709 13:07:58.267633 21300 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
W20260709 13:07:58.226094 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.230122 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 676) took 1270 ms. Trace:
I20260709 13:07:58.263134 24929 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.230547 24941 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.231431 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:58.231778 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.233152 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.231921 21142 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:58.233702 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.233837 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.231969 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.231210 24529 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:58.232571 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.280798 21809 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:07:58.270530 21297 rpcz_store.cc:276] 0709 13:07:56.959787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.976522 (+ 16735us) service_pool.cc:224] Handling call
0709 13:07:56.976844 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.039657 (+ 62813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.039691 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.046158 (+  6467us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.268972 (+222814us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:57.269031 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.107114 (+838083us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:07:58.229752 (+122638us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54001b1f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:58.229816 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.229870 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:58.229889 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.230058 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":319,"raft.queue_time_us":163,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8063,"spinlock_wait_cycles":134018304,"thread_start_us":182480,"threads_started":1,"wal-append.queue_time_us":304327}
I20260709 13:07:58.235395 21219 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:58.235509 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:58.235744 21296 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.282146 21808 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:58.181126 21226 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.242868 24683 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.243873 24674 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:58.225937 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.252130 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.186661 24888 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.275684 21298 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:58.287547 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 101376us
I20260709 13:07:58.277333 21812 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 4.
I20260709 13:07:58.277680 21814 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:58.236423 21224 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:58.283174 21226 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:58.226071 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 81995.4us
I20260709 13:07:58.296557 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:58.284538 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 49157.2us
I20260709 13:07:58.277277 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.298421 21150 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:07:58.292439 21145 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.284235 24529 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.277995 24941 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.302906 24529 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.303114 24941 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.305258 24973 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.306295 24993 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:58.307663 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.308257 21295 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:58.309101 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.310045 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.311707 21142 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.312342 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1995) took 1176 ms. Trace:
I20260709 13:07:58.312662 21142 rpcz_store.cc:276] 0709 13:07:57.136148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.277019 (+1140871us) service_pool.cc:224] Handling call
0709 13:07:58.311528 (+ 34509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.312114 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.312288 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.319443 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.320261 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.323055 21298 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:58.325548 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:58.326874 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.327670 21190 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.332015 21226 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:07:58.332484 21300 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:58.271772 24929 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.337293 21142 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:58.338083 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1997) took 1201 ms. Trace:
I20260709 13:07:58.338497 21142 rpcz_store.cc:276] 0709 13:07:57.136733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.313425 (+1176692us) service_pool.cc:224] Handling call
0709 13:07:58.336829 (+ 23404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.337775 (+   946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.338014 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.271279 24995 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.274783 24907 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:58.336462 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 174471us
I20260709 13:07:58.244040 24855 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.344718 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:58.347893 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.350162 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 709) took 1990 ms. Trace:
W20260709 13:07:58.351241 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.350538 21149 rpcz_store.cc:276] 0709 13:07:56.412707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.034484 (+621777us) service_pool.cc:224] Handling call
0709 13:07:58.169729 (+1135245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.183956 (+ 14227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.184001 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.184044 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.184077 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.184135 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.349990 (+165855us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400180bd0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.350094 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13854,"raft.queue_time_us":14321,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":18144,"spinlock_wait_cycles":2534904576}
W20260709 13:07:58.351217 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.352680 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1585) took 1194 ms. Trace:
I20260709 13:07:58.353048 21144 rpcz_store.cc:276] 0709 13:07:57.157854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.370373 (+212519us) service_pool.cc:224] Handling call
0709 13:07:58.352527 (+982154us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540017b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.352628 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332158336}
I20260709 13:07:58.353514 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.354060 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.354836 21144 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:07:58.290113 24674 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:58.269992 24794 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.331743 24854 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:58.354110 21142 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:58.314567 24599 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.313720 24683 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.271567 24703 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:58.371528 21147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1576) took 2703 ms (client timeout 1849 ms). Trace:
I20260709 13:07:58.372587 21150 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:58.343616 24995 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.374651 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.379796 21149 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:58.384874 24703 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.385320 24997 raft_consensus.cc:2764] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:58.333966 24993 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:58.386678 24794 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.364164 24854 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.387679 21143 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:58.390573 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:58.391638 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 251729us
I20260709 13:07:58.392511 21263 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.393499 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.324649 24951 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:07:58.395139 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.365585 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1998) took 1228 ms. Trace:
I20260709 13:07:58.396703 21146 rpcz_store.cc:276] 0709 13:07:57.136984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.345460 (+1208476us) service_pool.cc:224] Handling call
0709 13:07:58.365133 (+ 19673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.365298 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.365322 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.365361 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:58.365395 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.365445 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.365534 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138624}
I20260709 13:07:58.333072 24934 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.356999 24732 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.348822 24885 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:58.398099 21293 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:58.365665 21142 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:07:58.371976 21147 rpcz_store.cc:269] 0709 13:07:55.667715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.821410 (+153695us) service_pool.cc:224] Handling call
0709 13:07:58.371370 (+2549960us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001f7f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:58.371464 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982317952}
I20260709 13:07:58.360327 24907 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.394641 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:58.384649 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.334277 24852 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:58.401697 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:07:58.404350 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.411209 24836 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.411379 24967 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.355942 24937 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:58.348477 24778 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:58.416231 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.424619 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.396329 24854 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.418956 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:58.365312 24599 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.416899 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.360041 24797 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:58.359923 24883 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:58.422797 21149 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:58.417613 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:58.415702 24968 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:58.420365 24794 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:58.413805 24907 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.447721 21147 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:58.450568 21147 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:58.383100 24529 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.373026 24683 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.420125 24967 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.461386 21146 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:58.462502 21147 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:58.442682 24938 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.440512 24599 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:58.456262 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 128632us
I20260709 13:07:58.673444 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.435894 24910 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.436245 24934 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:58.603384 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.676599 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.452469 24907 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.684233 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.435534 24674 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.691665 24933 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.692008 24674 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.692242 24933 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:58.694563 24933 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.696982 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.697642 21293 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:58.461781 24968 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:58.708281 24968 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.712941 24529 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.713739 24529 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:58.714306 24529 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:58.678139 24934 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.717100 24934 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.698182 24929 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.724704 24929 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.728946 24683 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.732365 24732 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.564024 24938 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.672782 24988 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:58.461601 24967 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.683235 24936 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:58.695116 24933 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:58.684146 24958 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.766271 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:58.781657 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:58.757360 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.747329 24973 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:58.778810 25001 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:07:58.740607 25003 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:07:58.741209 24938 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.739194 24887 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:58.778939 24936 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.844995 21297 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:58.845400 21297 pending_rounds.cc:85] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 5
I20260709 13:07:58.845623 21297 pending_rounds.cc:107] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:58.845855 21297 raft_consensus.cc:2889] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:58.846640 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.851783 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 167611us
I20260709 13:07:58.852717 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.853008 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.742715 24910 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.856956 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.848229 24936 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.847317 24973 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.857214 24955 consensus_meta.cc:287] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.791s	user 0.005s	sys 0.005s
I20260709 13:07:58.872771 21142 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.862744 21263 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:58.742556 24988 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:58.871598 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 114364us
I20260709 13:07:58.872203 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.778374 24529 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.875831 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.860885 24861 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.863034 24877 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:58.872792 24888 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.001s
I20260709 13:07:58.851684 24674 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:58.870038 24978 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:58.860657 24778 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:58.893011 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:58.885905 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:58.876976 24941 consensus_meta.cc:287] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:07:58.900504 24988 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:58.900440 24941 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.902261 24997 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:58.887797 24877 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.903219 24877 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.907565 21146 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.877883 24683 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:58.895418 25008 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:58.896497 24801 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.000s
I20260709 13:07:58.898924 24888 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.881897 24955 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.915393 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:58.920114 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 57469.3us
I20260709 13:07:58.925364 24938 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.926772 24954 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.913187 24683 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.955650 24683 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.931038 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.902686 24997 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.902653 24941 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:58.876212 24973 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.957572 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.961853 21217 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:58.912020 24951 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.963660 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.964928 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.920660 24933 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:07:58.976152 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47099.8us
W20260709 13:07:58.966187 25006 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:58.966558 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.956563 24801 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:58.969872 24995 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.000s
I20260709 13:07:58.961220 24978 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:58.962096 25008 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.971592 24778 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.932161 24861 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:58.966233 24934 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.972937 24955 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:58.973977 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:58.965843 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.957193 24970 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:58.966701 25013 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.978181 21218 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [5.6-8.7]
I20260709 13:07:58.978499 21221 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 13:07:58.962898 24854 consensus_meta.cc:287] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.006s
I20260709 13:07:58.961036 24997 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:59.007922 24980 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:59.008370 24980 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:59.009272 24980 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.010392 24980 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:58.961421 24947 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.018s	sys 0.010s
W20260709 13:07:59.011574 24947 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.018s	sys 0.010s
I20260709 13:07:59.013582 24888 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.005786 24970 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:58.987228 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:58.988333 21223 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:58.992678 21222 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:59.017369 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:58.979698 24801 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.980736 25012 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.004150 21221 pending_rounds.cc:85] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 9
I20260709 13:07:59.026439 21221 pending_rounds.cc:107] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:59.026721 21221 raft_consensus.cc:2889] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.005386 25013 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:58.989027 25008 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:58.994658 25014 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.016157 24973 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.030860 21226 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10.
I20260709 13:07:59.048482 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.052018 21221 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:59.026085 24801 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.060878 25013 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.025810 24911 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.051097 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:58.985605 24995 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.020115 24854 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.047374 25008 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.056644 24993 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:59.057838 24933 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.042891 24885 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:59.062052 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.106448 21221 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:59.112793 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:59.113444 21223 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:07:59.066939 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.118697 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:59.119311 21222 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.119534 21812 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.050829 24888 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:59.068269 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.064091 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.069746 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.069808 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.052397 24951 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.128980 24938 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.071714 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.080569 24854 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.129278 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.080446 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.130048 21809 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:59.081447 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.081527 24877 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.081872 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.083757 24599 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.087123 24674 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.086196 24801 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:59.089100 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.130631 21810 raft_consensus.cc:2376] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10. Re-sending same reply.
I20260709 13:07:59.064090 24978 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.090606 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.071383 24973 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.019898 24970 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.139196 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.139976 21810 raft_consensus.cc:2376] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10. Re-sending same reply.
I20260709 13:07:59.091763 24867 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.094519 24910 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.047021 24861 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.164855 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.051020 25014 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.176738 25014 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.047616 25012 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.127630 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.179049 21814 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.179790 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2576) took 1050 ms. Trace:
I20260709 13:07:59.179953 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.180334 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.181041 21809 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.130245 21805 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:59.134238 21222 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:07:59.182195 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.136157 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.136231 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.183436 21811 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.138149 21806 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:59.145143 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.180217 21225 rpcz_store.cc:276] 0709 13:07:58.128945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.137831 (+  8886us) service_pool.cc:224] Handling call
0709 13:07:59.179612 (+1041781us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:59.179723 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597687552}
I20260709 13:07:59.184842 21810 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:07:59.188745 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.153311 21807 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:59.190965 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.198899 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.199167 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.199851 21805 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:59.200559 21805 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:59.162693 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.096717 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 1996) took 1960 ms. Trace:
I20260709 13:07:59.201655 21150 rpcz_store.cc:276] 0709 13:07:57.136400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.298957 (+1162557us) service_pool.cc:224] Handling call
0709 13:07:58.299178 (+   221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.372999 (+ 73821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.096392 (+723393us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b540026a2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:59.096641 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168320768}
I20260709 13:07:59.166266 21144 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:59.165838 21295 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.167734 24599 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.167811 24683 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.106562 24997 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.162178 24936 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.161729 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.204092 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.221529 21300 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.204789 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.222105 21299 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:07:59.189998 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.207441 21805 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.216988 21810 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:59.217128 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.224197 21807 raft_consensus.cc:2376] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9. Re-sending same reply.
I20260709 13:07:59.218652 21814 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 5.
I20260709 13:07:59.225275 21812 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:59.232237 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.223634 21810 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:59.142575 24674 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:07:59.236181 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 145907us
I20260709 13:07:59.236516 21295 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:59.179834 24867 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:59.237995 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.143177 24973 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.239060 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:59.243677 21225 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:59.239943 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.240768 21811 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.241238 21810 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:59.252934 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.254655 21810 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.250339 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.256182 21811 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.237711 24934 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.260926 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.246675 24867 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.276065 24801 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.278975 24683 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.261471 21811 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9. Re-sending same reply.
I20260709 13:07:59.285995 21300 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:59.287763 21809 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:07:59.288492 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.288969 21809 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.291662 24910 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.291926 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.292502 24910 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:59.292852 24910 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:59.292917 24836 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.293467 24836 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.293941 24836 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.293642 24910 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.299623 24877 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.301167 24674 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:07:59.302999 24967 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.003s
I20260709 13:07:59.303433 24967 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.305344 24967 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.247848 25014 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.305932 25014 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.306281 25014 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.313409 24836 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.373245 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.417768 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.421244 21300 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:59.421422 21776 leader_election.cc:336] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.678s (SENT)
I20260709 13:07:59.372979 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.422628 21807 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:59.423473 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.424511 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.336030 24822 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.339912 24953 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.319619 24958 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:07:59.337152 24856 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.438252 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:59.438452 21146 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:59.416770 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:59.318255 24999 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.934s	user 0.000s	sys 0.007s
I20260709 13:07:59.361686 21189 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:59.281096 24968 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:59.347752 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.377393 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.442670 21292 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.346760 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.443532 21299 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.384326 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.348562 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.411538 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.445839 21148 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.436622 24721 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.395192 24910 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:59.448902 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:59.449258 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 87690.7us
I20260709 13:07:59.450068 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:59.453927 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.433835 24822 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.431133 24997 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.438099 24958 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.334563 24988 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:59.349165 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:07:59.476861 21814 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:07:59.323681 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:07:59.477720 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 154142us
I20260709 13:07:59.478363 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.478648 21810 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:07:59.479131 21810 pending_rounds.cc:85] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 6
I20260709 13:07:59.388504 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.356122 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.479364 21810 pending_rounds.cc:107] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:07:59.479566 21150 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:59.479652 21810 raft_consensus.cc:2889] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:59.479969 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 123941us
I20260709 13:07:59.481487 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.442122 24967 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.434419 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:59.434865 21147 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:59.498565 21145 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:59.435338 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.499526 21295 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.499583 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.436033 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:59.504051 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.440249 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:59.440817 21149 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:07:59.432021 24855 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.377749 24973 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.459448 21807 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:59.319715 21809 raft_consensus.cc:2410] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:59.507603 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.442369 21293 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.342234 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2009) took 1813 ms. Trace:
I20260709 13:07:59.508152 21299 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:59.466753 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.513439 24997 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.513863 24997 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.514238 24997 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.514608 25012 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:59.519615 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52941.3us
I20260709 13:07:59.497902 24941 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.521231 24936 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:59.522090 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73259.6us
I20260709 13:07:59.522189 24936 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:59.522886 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.524006 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.524202 24936 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:59.525431 24873 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:59.525810 24873 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:59.418110 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.442104 24856 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.531940 24873 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.532881 24856 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.533172 24873 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.534789 24992 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:59.535446 24885 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:59.535581 24993 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:59.467923 24934 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.536281 24934 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.438001 24953 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.536406 24993 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.538350 24953 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.468397 25013 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:59.469053 24944 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:59.494720 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.455224 25018 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.495498 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.491650 24951 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:59.476219 24947 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:59.505628 24732 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:59.553551 21149 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.554452 24997 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.556615 24997 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.534894 25008 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.542467 24683 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:59.559525 25008 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.505692 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.506553 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.563534 21145 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.564062 24967 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.564543 24954 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.565073 24954 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:59.565907 24954 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.508383 21144 rpcz_store.cc:276] 0709 13:07:57.529350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.358153 (+828803us) service_pool.cc:224] Handling call
0709 13:07:58.361298 (+  3145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.203111 (+841813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.341958 (+138847us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54001f7a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:59.342174 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850565376}
I20260709 13:07:59.568660 21813 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:07:59.568678 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63055.8us
I20260709 13:07:59.569947 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:59.455085 24801 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:59.477156 24907 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260709 13:07:59.437489 24778 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.466238 24721 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.512614 21292 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:07:59.527534 21293 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:07:59.510601 21150 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:07:59.529201 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:59.536700 24934 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:59.538901 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 1.28886e+06us
I20260709 13:07:59.592187 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:59.593382 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:59.596333 21143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1588) took 2437 ms (client timeout 2913 ms). Trace:
W20260709 13:07:59.596747 21143 rpcz_store.cc:269] 0709 13:07:57.159002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.111300 (+952298us) service_pool.cc:224] Handling call
0709 13:07:59.596154 (+1484854us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540040db54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:07:59.596276 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633414912}
I20260709 13:07:59.594931 21114 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.469110 24822 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:07:59.590060 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 60971.5us
I20260709 13:07:59.602021 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:59.531001 21295 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:59.506384 25010 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.541071 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:59.544050 21297 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:59.506506 24674 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:59.515172 25012 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.491883 24988 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:59.475539 24968 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.536293 24885 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:59.549494 24958 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.549125 24992 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:59.552073 24836 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.432971 21300 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:07:59.577592 21145 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:59.582353 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:59.583613 21776 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10.
I20260709 13:07:59.541348 24901 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:59.638870 24794 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:59.568239 24976 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:07:59.584005 24953 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.585892 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 714) took 1235 ms. Trace:
I20260709 13:07:59.672789 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:59.674678 21142 rpcz_store.cc:276] 0709 13:07:58.350088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.442039 (+ 91951us) service_pool.cc:224] Handling call
0709 13:07:58.442449 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.875930 (+433481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.585632 (+709702us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540031b5d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:59.585818 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989141248}
I20260709 13:07:59.678962 24958 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:07:59.527860 21148 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:07:59.604295 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.604305 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.590706 21299 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:59.589534 21292 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.526379 24855 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.548918 25018 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.683947 24855 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:07:59.684118 25018 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:07:59.607740 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 66769.9us
I20260709 13:07:59.667290 24889 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.638389 24683 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:07:59.613855 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:07:59.639436 21293 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:59.639308 25033 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:59.600034 24856 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:59.599287 24599 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.601322 24941 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:59.580283 24578 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:07:59.601486 24717 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:59.662446 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 80214.6us
W20260709 13:07:59.665592 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.637303 25010 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.668588 21297 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:59.669166 21225 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:59.639039 24801 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.671557 21226 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:07:59.621081 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.727319 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:59.639938 21114 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.731573 21293 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [7.7-10.8]
I20260709 13:07:59.666992 24901 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.694819 21296 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:59.686754 24889 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.697873 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:59.652863 24674 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:59.586154 24907 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.702384 21219 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:59.699347 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:07:59.728443 24599 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:59.705300 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:59.659073 24944 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.664623 24736 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.658812 24992 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:07:59.664981 25013 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.667063 24794 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:59.645413 24928 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:59.715313 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:07:59.776111 21143 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:59.716202 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 166918us
I20260709 13:07:59.778559 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.779979 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:59.722162 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:07:59.718341 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:07:59.781674 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63433us
I20260709 13:07:59.785881 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:07:59.724952 21217 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:59.690914 21292 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:59.734771 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 94917.1us
W20260709 13:07:59.694669 21291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.024s
I20260709 13:07:59.719846 24941 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:07:59.724609 25010 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.723448 24717 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.742504 21144 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:59.704041 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:07:59.732151 25014 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.744841 21221 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:59.727350 24856 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:59.738714 24909 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.753069 24944 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.821249 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:59.821691 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.707386 25033 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:59.758319 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 318124us
I20260709 13:07:59.824199 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:07:59.789017 21291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.000s	sys 0.024s
I20260709 13:07:59.793557 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:07:59.799944 21143 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:07:59.802326 21218 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:07:59.702917 24683 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:07:59.804126 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.761658 24599 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:59.791657 24941 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.837751 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:07:59.838300 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:07:59.838415 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 224675us
W20260709 13:07:59.842120 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.848443 24867 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:07:59.715669 24988 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.922055 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:59.922569 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 84885.6us
I20260709 13:07:59.922986 21298 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:07:59.854871 24936 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:07:59.856755 24951 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:59.859635 24929 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:59.860666 24796 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.869895 21292 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.871850 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.953311 21295 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:07:59.872359 21293 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:59.873072 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:07:59.874006 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:07:59.862917 24884 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.801991 24976 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.807058 24717 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:59.924845 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.924889 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.811117 24989 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.828215 24736 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.928097 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:07:59.927165 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 88934.1us
I20260709 13:07:59.878473 24578 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:59.963404 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.789914 25013 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:07:59.966841 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 130532us
I20260709 13:07:59.967828 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:07:59.964387 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 143250us
I20260709 13:07:59.969561 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:07:59.971068 21263 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.849s (SENT)
I20260709 13:07:59.969741 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:07:59.972003 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.973642 21292 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:59.973654 21299 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:59.879413 25036 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.944800 24951 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:07:59.944396 24910 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:00.005821 24929 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:07:59.944120 24778 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.970618 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:07:59.880131 24909 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:07:59.952690 24796 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.879623 24992 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.944574 24854 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:59.965636 24867 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:00.062991 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 68249.1us
I20260709 13:08:00.061954 24910 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:07:59.967610 24988 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:00.069635 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 141656us
I20260709 13:07:59.954450 24936 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.960868 24976 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.070382 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 102638us
I20260709 13:08:00.085346 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:00.087248 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:07:59.997407 25008 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:07:59.997576 24970 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.976730 25002 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:00.082715 25038 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:08:00.084298 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 121256us
I20260709 13:08:00.125259 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.126739 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:00.087755 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.128091 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:00.089349 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.069847 24796 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.130600 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.124310 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:07:59.962116 24674 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.064787 25046 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.997150 24993 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:07:59.987499 24947 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:08:00.136143 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:00.151738 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:00.152420 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 70583.6us
I20260709 13:08:00.152554 21807 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:08:00.135542 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 44675.6us
I20260709 13:07:59.966665 24794 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.026924 24989 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:08:00.147552 21808 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:00.084446 24992 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.097750 24976 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:00.163197 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.164836 21221 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:00.165318 21218 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.137548 24889 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.138993 24867 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.156673 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:00.061244 24951 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.136281 25052 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.035477 24856 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.149549 24778 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.149758 24885 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.157670 25036 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.076465 24599 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.160925 25044 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.156559 25042 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.152037 24797 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:00.226791 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.194550 25052 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.236428 21217 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:00.248040 25048 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:08:00.248265 25000 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.528s	user 0.000s	sys 0.015s
W20260709 13:08:00.250020 25043 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:08:00.250303 25040 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 13:08:00.252377 25035 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:08:00.252718 24866 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.253142 24866 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.253597 24866 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:00.253999 25047 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:00.259449 24907 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:00.260134 25034 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:08:00.263787 25059 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:00.266010 25013 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:00.266391 24873 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.000s
I20260709 13:08:00.160596 24836 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:08:00.213343 24909 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:00.216974 25039 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 13:08:00.209465 25014 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:00.196230 24901 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.192548 25058 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:00.213546 25018 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.237392 25064 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.226737 25044 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:00.292711 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 139072us
I20260709 13:08:00.319243 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:00.245991 25052 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.213702 24944 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.165071 24929 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.217213 24889 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:08:00.284093 24947 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.236773 24910 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.212374 24778 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.213275 24885 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.276183 25033 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.280642 25036 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.236577 25056 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:08:00.321328 24854 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.239277 24797 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.324795 25054 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.335882 24934 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:08:00.367708 25054 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.368971 24797 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.368587 25044 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.369454 25036 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.370100 25054 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:00.371743 25036 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.327786 25058 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:00.343549 24944 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.342984 24947 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.355394 25051 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.275244 25042 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:08:00.355892 25032 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:08:00.381620 25058 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.382889 24936 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.383073 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2537) took 2092 ms. Trace:
I20260709 13:08:00.383486 21291 rpcz_store.cc:276] 0709 13:07:58.290715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.373782 (+ 83067us) service_pool.cc:224] Handling call
0709 13:07:58.414504 (+ 40722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.117300 (+702796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.117329 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.117717 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.825117 (+707400us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:59.825165 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.866066 (+ 40901us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400160dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:07:59.866150 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.382794 (+516644us) raft_consensus.cc:1685] finished
0709 13:08:00.382813 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.383017 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5993,"raft.queue_time_us":886,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":11482,"spinlock_wait_cycles":1615470976,"thread_start_us":694833,"threads_started":1,"wal-append.queue_time_us":613941}
I20260709 13:08:00.356950 24778 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:00.325501 25018 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.325920 25064 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.377650 24944 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:00.388090 24944 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.389212 25064 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.363770 24854 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.367784 24934 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:00.350699 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 307561us
I20260709 13:08:00.377486 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.392930 21296 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:00.380735 25051 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.396464 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 239556us
I20260709 13:08:00.375730 25002 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:00.342284 25046 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:00.402897 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.414362 21296 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:00.406173 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:00.399641 21116 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:00.370136 25044 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.387054 25018 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.411494 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.415652 21299 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:00.427202 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.427771 21291 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:00.417956 24885 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:00.420905 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:00.425266 21218 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:08:00.426575 21150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.023s	sys 0.024s
W20260709 13:08:00.452945 21150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.024s	sys 0.024s
I20260709 13:08:00.452620 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.389261 24944 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:00.451282 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 364064us
I20260709 13:08:00.456248 21296 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:00.408351 25051 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.456779 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.418277 24947 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:00.358963 24976 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.424129 24953 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.387149 24796 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.472038 25008 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.472545 25008 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:00.473364 25008 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.474635 25008 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.475149 24599 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.480546 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.481369 21220 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:00.483767 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:00.484746 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.484855 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.485523 21226 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:00.485940 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.486424 21148 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.486599 21226 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.488224 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.488796 21146 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:00.490242 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:00.491470 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.461905 24674 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.492697 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:00.492574 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.494076 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.494704 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.497824 21145 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:00.497700 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.499733 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.500478 21145 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:00.500828 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.502381 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:00.503165 21145 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.505698 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:00.506213 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 317802us
I20260709 13:08:00.507148 21148 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:00.507675 21148 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:00.506762 21220 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:00.512036 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.467862 24854 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.515789 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:00.521008 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.517416 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.523312 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.523980 21217 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.524619 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.518088 21224 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.460229 25056 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:00.515838 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.528339 21226 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:00.530742 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:00.531760 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.538944 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.508622 21148 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:00.545959 25010 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.002s
I20260709 13:08:00.549549 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:00.493983 24836 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:00.553188 21226 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:00.555909 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:00.465344 25065 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:08:00.559617 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.525000 24901 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.523804 25036 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.488116 24866 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.571000 25036 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:00.571228 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.571491 25036 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:00.547145 24954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.023s	sys 0.024s
I20260709 13:08:00.567549 24947 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:00.568282 24989 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:00.569608 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.592579 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:00.519007 24967 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:00.572355 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:00.612253 21150 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:00.552050 24970 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.530650 24867 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.587138 25067 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.572855 24901 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.579730 24954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.024s	sys 0.024s
I20260709 13:08:00.567932 24885 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:00.593909 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.570847 21143 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:00.607650 25054 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:00.607971 25075 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:00.650317 21146 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:00.651643 21146 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:08:00.608039 21813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1052) took 1523 ms (client timeout 1876 ms). Trace:
W20260709 13:08:00.652384 21813 rpcz_store.cc:269] 0709 13:07:59.085102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.135833 (+ 50731us) service_pool.cc:224] Handling call
0709 13:08:00.607855 (+1472022us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400573854. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:00.607981 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887038208}
I20260709 13:08:00.608500 24721 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.609460 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:00.610530 21226 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.543711 25057 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.546507 25010 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.514329 24674 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.624677 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.640357 24901 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.511231 25002 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.581673 24978 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:00.640885 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 110216us
I20260709 13:08:00.630813 21145 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
W20260709 13:08:00.640645 24717 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.005s
I20260709 13:08:00.723308 24717 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.565913 24836 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.593320 24778 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:08:00.587791 25072 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:00.672510 21217 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:00.700091 25074 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:00.701006 25085 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:08:00.517343 25046 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.669384 24967 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:00.774005 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 122089us
W20260709 13:08:00.636379 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 111910us
I20260709 13:08:00.706295 21297 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:00.707850 25092 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:00.720093 24976 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:00.722380 24978 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:00.754776 25086 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:00.756089 21144 raft_consensus.cc:2368] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9.
W20260709 13:08:00.786919 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.781342 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.794323 21142 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.758069 24967 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:00.799614 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:00.800370 21145 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:00.801503 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:00.802017 21145 raft_consensus.cc:2376] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10. Re-sending same reply.
I20260709 13:08:00.770816 24796 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.804826 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:00.779558 24995 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.812352 25054 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:00.806834 24929 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:00.817526 24717 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.818392 21226 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.819571 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.838778 21218 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:00.831784 24976 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.832100 24888 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.832661 24778 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:00.748703 24970 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:00.758324 25052 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.795480 24978 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.793004 25074 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:00.798262 25068 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.850986 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:00.872175 21226 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.847594 25054 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.872853 21225 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.874145 25052 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.874480 25054 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:00.841888 24976 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:00.838819 24992 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:08:00.779853 24973 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:00.847460 24778 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.864180 24721 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:00.791085 24794 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:00.866343 24836 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:00.867573 24674 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.869513 21219 raft_consensus.cc:2410] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:00.870137 25010 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.847554 24888 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.855720 24970 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:00.889891 24970 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.890934 24778 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:00.891955 24888 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:00.879822 24884 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.919s	user 0.008s	sys 0.004s
I20260709 13:08:00.875679 25095 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:00.880601 24941 consensus_meta.cc:287] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.931s	user 0.005s	sys 0.006s
I20260709 13:08:00.879542 25094 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:00.875156 25067 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:00.895705 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.878247 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 227693us
I20260709 13:08:00.917419 21805 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.919202 21811 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:00.919664 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.920434 21809 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.834635 24928 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:00.862803 25036 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.922905 21811 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:00.926265 21226 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:00.932396 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.933516 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.924520 21810 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:00.936455 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:00.936643 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:00.902710 24997 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.884421 25051 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:00.947404 21809 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:00.914299 25067 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:00.954468 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.955152 21808 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.957659 25036 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.882165 24967 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.921849 24976 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:00.915179 24941 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:07:59.339288 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.096582 21224 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:01.614495 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.268090 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:01.617813 21300 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:01.134302 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.112076 21810 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.473366 21298 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:01.008831 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:00.995617 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.513291 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 694) took 1971 ms. Trace:
I20260709 13:08:01.621734 21811 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:01.248986 21292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.013s	sys 0.049s
I20260709 13:08:01.338743 21299 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:01.622514 21292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.023s	sys 0.061s
W20260709 13:08:01.613919 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 405169us
I20260709 13:08:01.003682 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 703) took 1134 ms. Trace:
I20260709 13:08:01.354266 21295 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:01.516283 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2587) took 1033 ms. Trace:
I20260709 13:08:01.623412 21297 rpcz_store.cc:276] 0709 13:07:59.869082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.870445 (+  1363us) service_pool.cc:224] Handling call
0709 13:07:59.870850 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.777825 (+906975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.003445 (+225620us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400328554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:01.003617 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915713792}
I20260709 13:08:01.521335 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 729) took 1388 ms. Trace:
I20260709 13:08:01.380331 21293 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:01.624583 21144 rpcz_store.cc:276] 0709 13:08:00.132531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.132686 (+   155us) service_pool.cc:224] Handling call
0709 13:08:01.521072 (+1388386us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540040c754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:01.521259 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386405632}
I20260709 13:08:01.603904 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:00.959580 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:01.007541 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.017163 21808 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
W20260709 13:08:01.629060 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.625373 21291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.003s	sys 0.019s
W20260709 13:08:01.629650 21291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.003s	sys 0.019s
I20260709 13:08:01.630398 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:01.571964 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2035) took 1090 ms. Trace:
I20260709 13:08:01.631560 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:01.631358 21142 rpcz_store.cc:276] 0709 13:08:00.481151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.483349 (+  2198us) service_pool.cc:224] Handling call
0709 13:08:00.483620 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.794738 (+311118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.571654 (+776916us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540031bad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:01.571889 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714121600}
I20260709 13:08:00.958806 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.632864 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:01.633351 21809 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.634105 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:01.624004 21219 rpcz_store.cc:276] 0709 13:08:00.483179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.484477 (+  1298us) service_pool.cc:224] Handling call
0709 13:08:01.515972 (+1031495us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540035be54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:01.516191 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819931520}
I20260709 13:08:01.633474 21295 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:01.621810 21294 rpcz_store.cc:276] 0709 13:07:59.542343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.595849 (+ 53506us) service_pool.cc:224] Handling call
0709 13:07:59.638442 (+ 42593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.747753 (+109311us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:59.775703 (+ 27950us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.025861 (+250158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.025926 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.025986 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.133141 (+1107155us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18001d9d40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419
0709 13:08:01.512964 (+379823us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001603d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:01.513028 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.513214 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44544,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":108,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31855,"spinlock_wait_cycles":257431808,"thread_start_us":249695,"threads_started":1,"wal-append.queue_time_us":460181,"wal-append.run_cpu_time_us":1080,"wal-append.run_wall_time_us":1023503}
W20260709 13:08:01.372085 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.037s
I20260709 13:08:01.639020 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:01.641634 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.005s	sys 0.049s
I20260709 13:08:01.642108 21808 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:01.642266 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 837445us
I20260709 13:08:01.643093 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:01.639437 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.640184 21148 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:01.647243 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.177999 25044 consensus_meta.cc:287] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.000s
W20260709 13:08:01.393834 25046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.034s
I20260709 13:08:01.656381 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.648077 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:01.658553 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 600) took 1988 ms. Trace:
I20260709 13:08:01.649973 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.654127 25102 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.516819 24947 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.687381 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:01.658972 21222 rpcz_store.cc:276] 0709 13:07:59.669699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.669810 (+   111us) service_pool.cc:224] Handling call
0709 13:07:59.670078 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.676920 (+  6842us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:59.809155 (+132235us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.844255 (+ 35100us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18003b3860. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d557 00007f2b6ac8f7c1
0709 13:08:01.006859 (+1162604us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b18003b3860. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a
0709 13:08:01.007164 (+   305us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.007681 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.007829 (+   148us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:01.008038 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.647960 (+639922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.648081 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.658271 (+ 10190us) raft_consensus.cc:1685] finished
0709 13:08:01.658299 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.658500 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26941,"prepare.queue_time_us":293641,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":7809,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":96789248,"thread_start_us":216901,"threads_started":2,"wal-append.queue_time_us":325266}
I20260709 13:08:01.626062 24578 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.688349 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:01.189910 24944 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:01.626356 25033 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.004997 24968 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.512761 25062 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.001370 25042 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.567612 24989 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:01.659168 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:01.518560 24866 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.672557 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.706856 21810 raft_consensus.cc:2376] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5. Re-sending same reply.
I20260709 13:08:01.672955 25072 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.673302 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.709100 21807 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:08:01.673472 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.663570 25092 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:01.674451 24861 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.577426 24934 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.675930 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:01.676162 24941 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:00.958910 24867 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.141824 24888 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.696224 24721 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:01.698796 25044 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.941213 24901 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:01.676568 25088 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.969s	user 0.003s	sys 0.009s
I20260709 13:08:01.676724 24976 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.946826 24997 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.656002 24967 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.677625 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.678373 24929 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:00.947144 25074 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.671326 21038 maintenance_manager.cc:419] P 17f9ac50e9a3445ba29d33dbe0f8af0f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033382
I20260709 13:08:01.601796 25051 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.682679 21811 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:01.684250 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:01.761694 21294 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.685988 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:01.763702 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:01.764318 21150 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:01.177645 24970 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.766825 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 881a7cf58d404812aa274b116b666741 with delete_type TABLET_DATA_TOMBSTONED (TS 3585d99c303e453c8c3762b294caba4e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35736
I20260709 13:08:01.710639 25042 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.596102 25096 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.520005 25057 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:01.543318 24683 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.550963 24953 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:01.691425 21144 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:01.639240 24951 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.980406 24884 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.692144 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.659667 21805 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:01.626628 24958 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:01.694679 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.694811 21148 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:01.782908 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2037) took 1293 ms. Trace:
I20260709 13:08:01.783245 21148 rpcz_store.cc:276] 0709 13:08:00.489131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.489411 (+   280us) service_pool.cc:224] Handling call
0709 13:08:00.489690 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.639625 (+1149935us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b58007c52d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcd60aa 00007f2b6dd58447 00007f2b6dd70fe7 00007f2b6dd727de 00007f2b6dd7cb49 00007f2b6dd7d416 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4
0709 13:08:01.782694 (+143069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.782863 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27684096}
I20260709 13:08:01.695571 21049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 375) took 7380 ms. Trace:
I20260709 13:08:01.735970 24861 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.748998 25044 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.707221 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:01.709990 21814 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
W20260709 13:08:01.663800 25046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.000s	sys 0.045s
I20260709 13:08:01.691143 21047 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.708159 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:01.710621 21809 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:01.698469 25062 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:01.798182 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:01.701390 24797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.001s	sys 0.014s
I20260709 13:08:01.749338 24721 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.690577 24947 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:01.808473 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.808670 24855 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.809082 24855 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:01.809188 24947 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.809733 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.810254 24947 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.809842 24855 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.810664 21814 raft_consensus.cc:2410] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 10 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:01.810962 24855 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.656826 24529 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:08:01.710852 25002 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:01.706105 24989 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:01.820325 24989 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.821578 24989 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:01.747632 24978 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.004s
I20260709 13:08:01.753371 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.249001 25067 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.699182 24578 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.757980 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 730) took 1624 ms. Trace:
I20260709 13:08:01.824005 21149 rpcz_store.cc:276] 0709 13:08:00.133733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.252781 (+119048us) service_pool.cc:224] Handling call
0709 13:08:00.253093 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.372471 (+119378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.372499 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.372897 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.525861 (+152964us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.525884 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.996660 (+470776us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400180bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:00.996713 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.674941 (+678228us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:01.757765 (+ 82824us) raft_consensus.cc:1685] finished
0709 13:08:01.757784 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.757919 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295633664,"thread_start_us":152615,"threads_started":1,"wal-append.queue_time_us":267837}
I20260709 13:08:01.699849 25033 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.825788 24578 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.826843 25033 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.826607 24578 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.699658 24944 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.765074 21142 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.765408 21150 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.766650 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.627060 24995 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.767735 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.763204 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:01.768671 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:01.850692 21145 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:01.850136 24995 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.715313 25056 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:01.852593 24721 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.686753 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:01.852973 24995 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.853355 21146 raft_consensus.cc:2376] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6. Re-sending same reply.
I20260709 13:08:01.772367 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:01.772724 24970 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:01.752835 24929 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:01.854527 24970 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.742902 25072 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:01.718745 25092 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.856765 24970 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.856897 25092 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.785207 21812 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:01.857204 25042 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.858152 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:01.704655 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.809726 24861 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.787747 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.674455 25102 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.754482 24941 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:01.773622 24968 raft_consensus.cc:476] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:01.792935 21299 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:01.689213 24992 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.799175 21808 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:08:01.800474 21294 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:01.781168 25057 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.872913 24992 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.874141 25102 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.875845 24992 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.802306 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.878022 21809 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.784394 21049 rpcz_store.cc:276] 0709 13:07:54.374956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.380499 (+  5543us) service_pool.cc:224] Handling call
0709 13:08:01.663108 (+7282609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:56.726469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:56.993648 (+267179us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:56.993718 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:07:56.993744 (+    26us) tablet.cc:662] Decoding operations
0709 13:07:57.116355 (+122611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:57.116451 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:57.116491 (+    40us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:07:57.118555 (+  2064us) tablet.cc:701] Row locks acquired
0709 13:07:57.118614 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:07:57.118822 (+   208us) write_op.cc:270] Start()
0709 13:07:57.119014 (+   192us) write_op.cc:276] Timestamp: P: 1783602477118746 usec, L: 0
0709 13:07:57.119043 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:07:57.145418 (+ 26375us) log.cc:844] Serialized 7795 byte log entry
0709 13:07:57.632996 (+487578us) op_driver.cc:464] REPLICATION: finished
0709 13:07:58.033358 (+400362us) write_op.cc:301] APPLY: starting
0709 13:07:58.033464 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:58.033921 (+   457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:58.034081 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:58.262882 (+228801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:58.302792 (+ 39910us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:07:58.302841 (+    49us) write_op.cc:312] APPLY: finished
0709 13:07:58.303315 (+   474us) log.cc:844] Serialized 139 byte log entry
0709 13:07:58.303528 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.303700 (+   172us) write_op.cc:454] Released schema lock
0709 13:07:58.303787 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:58.304172 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.304198 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5753,"reported_tablets":39,"spinlock_wait_cycles":216960,"child_traces":[["op",{"apply.queue_time_us":400032,"apply.run_cpu_time_us":6673,"apply.run_wall_time_us":270812,"num_ops":20,"prepare.queue_time_us":327679,"prepare.run_cpu_time_us":14064,"prepare.run_wall_time_us":756172,"raft.queue_time_us":62921,"raft.run_cpu_time_us":20642,"raft.run_wall_time_us":452018,"replication_time_us":457181,"thread_start_us":727219,"threads_started":4,"wal-append.queue_time_us":292549,"wal-append.run_cpu_time_us":5849,"wal-append.run_wall_time_us":1933218}]]}
W20260709 13:08:01.791527 24822 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:08:01.781461 24953 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.792032 25096 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.786623 24884 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:01.738701 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 62837.8us
I20260709 13:08:01.884280 25096 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.811096 25044 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.798365 21047 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 4 to 6, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:01.819046 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2594) took 1010 ms. Trace:
I20260709 13:08:01.822762 24978 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.758546 21298 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:08:01.802058 24797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.001s	sys 0.014s
I20260709 13:08:01.823167 21810 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:08:01.794137 24867 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.843508 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.711666 25068 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:01.786974 24958 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.943420 24947 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:01.944309 24958 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.945722 21296 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:01.744482 24888 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.866644 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:01.862620 24910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.024s	sys 0.039s
I20260709 13:08:01.695926 25065 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.955668 25065 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.958524 25065 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:01.814170 21813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.010s	sys 0.047s
W20260709 13:08:01.885401 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 122285us
W20260709 13:08:01.959342 21813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.010s	sys 0.048s
I20260709 13:08:01.960052 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1123) took 1043 ms. Trace:
I20260709 13:08:01.960289 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:01.885703 21809 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:01.839980 25002 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:01.892061 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:01.892172 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:01.896443 21221 rpcz_store.cc:276] 0709 13:08:00.808662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.857438 (+ 48776us) service_pool.cc:224] Handling call
0709 13:08:00.857745 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:00.858122 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.858148 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:00.858677 (+   529us) log.cc:844] Serialized 52 byte log entry
0709 13:08:01.604397 (+745720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:01.604451 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.604541 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.818802 (+214261us) raft_consensus.cc:1685] finished
0709 13:08:01.818821 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.818982 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2218,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":91,"thread_start_us":371091,"threads_started":1,"wal-append.queue_time_us":958115}
I20260709 13:08:01.913326 21047 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 1 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 4 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.960377 21813 rpcz_store.cc:276] 0709 13:08:00.916573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.916718 (+   145us) service_pool.cc:224] Handling call
0709 13:08:00.917056 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.917248 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:00.921767 (+  4519us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.959739 (+1037972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.959787 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:01.959829 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.959894 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.959999 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4781,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":1037671,"threads_started":1}
I20260709 13:08:01.917517 21808 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:01.923089 21298 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:01.977769 21811 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:01.914376 25044 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.928431 21142 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:01.854975 24929 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.929368 25102 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.929844 24884 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.930583 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:01.931130 24578 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:01.935405 24867 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:01.936650 24978 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.938350 25057 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.885038 25062 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:01.941145 24944 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:01.941334 21810 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:01.941761 24901 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:01.942505 21299 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.947016 21814 raft_consensus.cc:2410] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:01.947161 21805 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:01.948261 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2216) took 1437 ms. Trace:
I20260709 13:08:01.978005 21047 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 5 to 9, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.985522 21298 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:01.987103 24888 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:01.987689 24929 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.922209 25092 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:01.963089 24910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.025s	sys 0.040s
W20260709 13:08:02.426517 25114 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:02.314030 21295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.012s
W20260709 13:08:02.545411 24951 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.003s
W20260709 13:08:02.584853 21295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.012s	sys 0.013s
I20260709 13:08:02.585114 25057 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:02.132850 21296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2556) took 1523 ms (client timeout 1888 ms). Trace:
I20260709 13:08:02.429713 25067 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:02.128295 21292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.013s
W20260709 13:08:02.510143 24976 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.006s
W20260709 13:08:02.586676 21292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.011s	sys 0.022s
I20260709 13:08:02.587412 21806 raft_consensus.cc:2410] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:02.207767 21297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.009s	sys 0.008s
W20260709 13:08:02.417730 21293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.002s	sys 0.019s
W20260709 13:08:02.587996 21297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.018s	sys 0.015s
I20260709 13:08:02.104005 21294 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [6.7-9.8]
I20260709 13:08:02.588136 25107 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:02.323628 21190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.008s
I20260709 13:08:02.519960 24997 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:02.508564 21151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.017s	sys 0.014s
W20260709 13:08:02.547537 24953 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.001s
W20260709 13:08:02.367681 21141 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.017s
W20260709 13:08:02.592211 21141 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.001s	sys 0.018s
I20260709 13:08:02.212039 25002 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.593812 25107 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:02.594246 25107 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:02.578421 24989 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.005s
W20260709 13:08:02.294879 21192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.010s	sys 0.007s
I20260709 13:08:02.595002 25107 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:02.595592 21192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.012s	sys 0.012s
I20260709 13:08:02.586190 25092 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:02.591491 24953 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.596594 25092 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.597764 25092 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.598122 21221 pending_rounds.cc:85] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 9
I20260709 13:08:02.598366 24953 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:02.598455 21221 pending_rounds.cc:107] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:08:02.598896 21221 raft_consensus.cc:2889] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.600999 21222 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.604048 21222 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:02.587431 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2218) took 2064 ms. Trace:
I20260709 13:08:02.611955 21291 rpcz_store.cc:276] 0709 13:08:00.511211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.511510 (+   299us) service_pool.cc:224] Handling call
0709 13:08:00.541195 (+ 29685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.705553 (+164358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.705588 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.786961 (+ 81373us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.629997 (+843036us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:01.630031 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.630092 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.947982 (+317890us) raft_consensus.cc:1685] finished
0709 13:08:01.948009 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.948188 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5787,"raft.queue_time_us":97144,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9092,"thread_start_us":944832,"threads_started":2,"wal-append.queue_time_us":1056731}
I20260709 13:08:02.612704 21292 rpcz_store.cc:276] 0709 13:08:00.522759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.522888 (+   129us) service_pool.cc:224] Handling call
0709 13:08:00.523195 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.523439 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:01.622993 (+1099554us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.587111 (+964118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:02.587160 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:02.587198 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.587277 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.587378 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1306235,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":397,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":2033213,"threads_started":2}
W20260709 13:08:02.613974 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 683437us
W20260709 13:08:02.487287 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.011s	sys 0.011s
W20260709 13:08:02.619699 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.013s	sys 0.011s
W20260709 13:08:02.586133 21296 rpcz_store.cc:269] 0709 13:08:00.609077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.609224 (+   147us) service_pool.cc:224] Handling call
0709 13:08:02.132577 (+1523353us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001b1a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:02.132761 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970255744}
I20260709 13:08:02.586081 24951 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.988776 25065 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.627383 21151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.019s	sys 0.017s
W20260709 13:08:02.590752 21190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.013s	sys 0.012s
I20260709 13:08:01.993662 25044 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:02.137760 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 501469us
W20260709 13:08:02.671698 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 1.06198e+06us
I20260709 13:08:02.683590 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:02.684717 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.681706 21300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.021s	sys 0.027s
W20260709 13:08:02.685468 21300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.021s	sys 0.027s
W20260709 13:08:02.577281 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.009s	sys 0.015s
W20260709 13:08:02.685819 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.009s	sys 0.016s
W20260709 13:08:02.686116 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.04302e+06us
W20260709 13:08:02.064190 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.367489 21116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.006s	sys 0.012s
W20260709 13:08:02.500283 24928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.027s	sys 0.023s
W20260709 13:08:02.588168 21293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.002s	sys 0.022s
W20260709 13:08:02.636396 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.010s
W20260709 13:08:02.580228 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.642927 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:02.657155 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:01.962512 24885 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.652237 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:02.393170 25113 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:08:02.669088 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:01.990715 25102 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.401259 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.003s	sys 0.015s
W20260709 13:08:02.687215 21116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.007s	sys 0.017s
W20260709 13:08:02.687983 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.005s	sys 0.010s
I20260709 13:08:02.689617 21223 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.046746 24970 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.130806 24947 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.198796 24993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.032s	sys 0.035s
I20260709 13:08:02.639500 24997 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.693477 21222 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.307904 24967 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
W20260709 13:08:02.693805 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50955.8us
I20260709 13:08:02.725962 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:02.694909 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:02.698179 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 711) took 1033 ms. Trace:
I20260709 13:08:02.727356 21300 rpcz_store.cc:276] 0709 13:08:01.664609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.795097 (+130488us) service_pool.cc:224] Handling call
0709 13:08:01.795430 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.855677 (+ 60247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:01.855975 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.687775 (+831800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:02.687822 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:02.687874 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.697938 (+ 10064us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54001b1f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:02.697990 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.698120 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2774,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":138087680,"thread_start_us":831526,"threads_started":1}
W20260709 13:08:02.699695 21190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.608s (SENT) [suppressed 37 similar messages]
I20260709 13:08:02.700846 21218 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:02.701939 21220 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:02.703984 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.007s	sys 0.020s
W20260709 13:08:02.715236 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.00541e+06us
W20260709 13:08:02.730711 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.007s	sys 0.020s
W20260709 13:08:02.731073 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 770787us
W20260709 13:08:02.717244 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.003s	sys 0.022s
I20260709 13:08:02.670176 24989 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:02.693115 24928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.030s	sys 0.029s
W20260709 13:08:02.716859 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.734205 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:02.687110 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.667304 24901 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.740629 21226 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:08:02.740731 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:02.658555 21047 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 5 to 7, now has a pending config: VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1), VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 7 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: NON_VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:02.692884 24736 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.671140 24951 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.747371 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:02.749564 21146 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:02.751924 21142 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:02.753013 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.754032 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.754778 21142 raft_consensus.cc:2410] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:02.755419 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.692727 25051 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.756603 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.756907 21116 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:02.757357 21148 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:02.694094 24888 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:02.758646 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.759228 21149 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:02.756655 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.761432 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:02.757783 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:02.734927 24993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.038s	sys 0.058s
I20260709 13:08:02.722285 25107 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.767396 21264 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.017s	sys 0.019s
I20260709 13:08:02.754647 21222 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:02.758113 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:02.769585 21150 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.721632 25102 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.776023 21143 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:02.776484 21150 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:02.760847 24822 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.682085 24978 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:08:02.681841 24578 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:08:02.739289 24947 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:02.778024 21264 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.017s	sys 0.019s
I20260709 13:08:02.784088 24856 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.758535 24967 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:02.766925 24976 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.837025 21219 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:02.760759 24970 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:02.767198 24989 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.761094 24794 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:02.756498 25058 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.761049 25057 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:02.764750 24953 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.790517 21223 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:02.792488 25044 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:02.697423 25056 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:02.792961 24928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35736 (request call id 97) took 5783 ms. Trace:
I20260709 13:08:02.763002 24901 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.692839 25065 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.760555 24951 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.670081 25072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.013s	sys 0.012s
I20260709 13:08:02.790715 24884 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.760995 24736 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:02.746708 24997 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:02.768180 24888 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.810189 24732 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.767004 25051 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:02.832105 24910 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.869316 25126 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.869961 25122 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.870859 25062 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.872176 25134 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.872886 24867 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:02.852684 25127 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.843658 24976 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.841080 24967 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.809511 24822 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.859990 25123 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:02.849699 24794 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.867379 25057 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:02.899076 25135 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:02.860936 25058 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.847986 24989 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:02.892932 25072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.014s	sys 0.012s
I20260709 13:08:02.894423 25128 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.922856 24993 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.923664 24993 consensus_queue.cc:1243] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:02.913879 25135 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.925793 25135 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:02.926796 25117 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:02.896127 24978 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.905949 25134 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.898087 25102 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:02.917135 25136 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:02.916822 25057 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:02.918526 24989 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:02.763224 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:03.050347 21142 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:03.050674 24970 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:02.811278 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 1.01346e+06us
I20260709 13:08:03.053794 24822 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:02.845566 24578 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:03.036038 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 709) took 1383 ms. Trace:
I20260709 13:08:03.037228 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2564) took 1380 ms. Trace:
I20260709 13:08:03.038034 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 708) took 1408 ms. Trace:
I20260709 13:08:02.920671 24888 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:02.796116 21777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.009s	sys 0.057s
I20260709 13:08:03.127987 25127 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:03.044126 24901 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.050477 24736 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:02.998117 21047 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 7 to 8, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 8 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.129503 24967 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:02.883747 24928 rpcz_store.cc:276] 0709 13:07:56.980404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.248120 (+1267716us) service_pool.cc:224] Handling call
0709 13:07:58.301555 (+ 53435us) log.cc:844] Serialized 494 byte log entry
0709 13:07:59.325078 (+1023523us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800386920. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dcd3b0b 00007f2b6dd58b63 00007f2b6dd80752 00007f2b6dd789fa
0709 13:08:02.763862 (+3438784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":630675,"raft.queue_time_us":927994,"raft.run_cpu_time_us":1501,"raft.run_wall_time_us":310545,"spinlock_wait_cycles":8225152,"thread_start_us":96215,"threads_started":1,"wal-append.queue_time_us":130513,"wal-append.run_cpu_time_us":17468,"wal-append.run_wall_time_us":2369729}
I20260709 13:08:03.130817 21047 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 7 to 8, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 8 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.962883 25128 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.963743 25134 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.133669 21047 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 8 to 9, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:03.107523 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 407685us
I20260709 13:08:03.136349 24884 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.136472 24944 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.137360 24884 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.138047 25058 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.054366 24976 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:03.139236 25148 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.139408 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.139820 25065 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.140470 21219 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:08:03.140123 25148 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.141357 24578 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.141860 24578 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:03.142027 25051 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.143784 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.143561 24578 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.144593 21223 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:03.124123 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 367128us
I20260709 13:08:03.117806 21297 rpcz_store.cc:276] 0709 13:08:01.629319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.648660 (+ 19341us) service_pool.cc:224] Handling call
0709 13:08:01.674043 (+ 25383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.588427 (+914384us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:02.588457 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.588885 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.037286 (+448401us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:03.037383 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.037498 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.037575 (+    77us) raft_consensus.cc:1685] finished
0709 13:08:03.037585 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.037848 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85606,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9354,"thread_start_us":1361626,"threads_started":2,"wal-append.queue_time_us":360529}
W20260709 13:08:03.128264 21777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.009s	sys 0.058s
I20260709 13:08:02.944679 25136 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:02.903481 25122 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.137409 24944 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.191697 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1613) took 1429 ms. Trace:
I20260709 13:08:03.192932 24944 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.193161 25122 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.192121 21151 rpcz_store.cc:276] 0709 13:08:01.762321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.763864 (+  1543us) service_pool.cc:224] Handling call
0709 13:08:01.764259 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.770733 (+  6474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.770781 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.782087 (+ 11306us) log.cc:844] Serialized 52 byte log entry
0709 13:08:02.671223 (+889136us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:03.106303 (+435080us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.190923 (+ 84620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.191095 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.191167 (+    72us) raft_consensus.cc:1685] finished
0709 13:08:03.191183 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.191422 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38805,"prepare.queue_time_us":434900,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":46396,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":24586,"thread_start_us":1270334,"threads_started":2,"wal-append.queue_time_us":1058582}
I20260709 13:08:03.195637 25136 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.197845 25136 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.198210 24888 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.142127 21047 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.200559 21047 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 7 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.203009 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.204201 21217 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:03.204507 25132 tablet_replica.cc:333] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:08:03.050743 24794 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.205875 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.207023 21219 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:03.208379 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.142952 25148 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.130021 25127 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.219398 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:03.220772 24794 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.221410 24794 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:03.226243 25056 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:03.228005 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:03.156762 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:03.158886 24997 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:02.935351 24978 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.160821 24885 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:03.222784 24794 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.248512 24885 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.249851 24978 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.252457 24885 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:02.905223 25126 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.253574 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:03.254999 25126 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.255236 21222 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:03.255515 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 529509us
I20260709 13:08:03.255784 25126 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:03.256609 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:03.257877 25126 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:03.172427 25102 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.117309 21295 rpcz_store.cc:276] 0709 13:08:01.652163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.717559 (+ 65396us) service_pool.cc:224] Handling call
0709 13:08:01.717919 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.585317 (+867398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.585344 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.585813 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.035101 (+449288us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.035212 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.035381 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.035482 (+   101us) raft_consensus.cc:1685] finished
0709 13:08:03.035506 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.035780 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19368,"raft.queue_time_us":53976,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"thread_start_us":1295059,"threads_started":2,"wal-append.queue_time_us":368654}
I20260709 13:08:03.258816 25155 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.178736 24947 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.117743 21293 rpcz_store.cc:276] 0709 13:08:01.656667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.735664 (+ 78997us) service_pool.cc:224] Handling call
0709 13:08:01.736059 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.736303 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:02.687637 (+951334us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.035193 (+347556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.036474 (+  1281us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.036589 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.036723 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.037015 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93565,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":16807,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":259,"thread_start_us":1283830,"threads_started":2,"wal-append.queue_time_us":273004}
W20260709 13:08:03.176009 25161 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:08:03.260272 24947 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.173496 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.187352 24578 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.261003 24947 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.261997 25147 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.262428 25147 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:03.188261 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:03.203877 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:03.184295 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 391005us
W20260709 13:08:03.114574 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 358964us
I20260709 13:08:03.215940 21047 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:03.218451 21776 leader_election.cc:400] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9.
I20260709 13:08:03.219099 25105 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.199127 24888 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:03.228888 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.230330 24884 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.197878 25134 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.239523 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 434356us
I20260709 13:08:03.155392 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:03.186232 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 446104us
W20260709 13:08:03.165627 21264 connection.cc:256] RPC call timeout handler was delayed by -1.1898199920000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
I20260709 13:08:03.256443 24997 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:03.183619 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 957) took 1531 ms. Trace:
I20260709 13:08:03.279639 25065 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:03.279924 24884 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.267655 25056 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.280902 25051 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:03.282435 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:03.282635 25132 raft_consensus.cc:2243] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:03.283481 25058 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:03.284274 25147 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.273650 21147 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
W20260709 13:08:03.280347 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 125471us
I20260709 13:08:03.300680 21223 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:03.303989 24929 consensus_meta.cc:287] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.011s
I20260709 13:08:03.286641 24947 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.267656 25105 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:03.263823 25122 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:03.326835 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.327195 25122 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.291652 21809 rpcz_store.cc:276] 0709 13:08:01.647577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.962147 (+314570us) service_pool.cc:224] Handling call
0709 13:08:01.988276 (+ 26129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.044098 (+1055822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.044155 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.044242 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.044273 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.178963 (+134690us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54003b0bd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:03.179001 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.179213 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4698,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":111,"spinlock_wait_cycles":1372566400,"thread_start_us":458274,"threads_started":1}
I20260709 13:08:03.315953 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:03.316256 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:03.317142 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63752.5us
I20260709 13:08:03.317507 24888 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:03.318076 25065 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.318501 25158 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:03.318948 25134 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.321456 21047 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.323858 25105 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.294214 24884 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.304767 25056 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.326256 25147 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.336241 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.830895 21291 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:03.835933 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 520172us
W20260709 13:08:03.836133 21147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2047) took 2149 ms (client timeout 1540 ms). Trace:
I20260709 13:08:03.836303 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:03.836616 21147 rpcz_store.cc:269] 0709 13:08:01.686483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.687153 (+   670us) service_pool.cc:224] Handling call
0709 13:08:03.835890 (+2148737us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001ddb54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:03.836038 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037003648}
I20260709 13:08:03.837051 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:03.837188 25134 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:03.837781 24794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.003s
W20260709 13:08:03.838243 24794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.003s
I20260709 13:08:03.840111 21047 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 5, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 5 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:03.331952 25154 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:03.339505 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.831557 25158 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.841998 21047 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 5, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 5 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.307646 24978 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.843502 25158 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:03.845371 25105 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:03.847827 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 629898us
W20260709 13:08:03.833078 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 341473us
I20260709 13:08:03.833186 24997 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.850811 24997 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.851358 24997 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:03.852409 24997 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.856945 25065 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:03.330205 25122 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:03.833779 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 517712us
I20260709 13:08:03.864748 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:03.477479 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.866417 21294 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:03.833947 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 577515us
W20260709 13:08:03.789803 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.431279 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.413087 25062 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.003s
I20260709 13:08:03.329200 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:03.392902 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.834792 25124 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:03.330530 21293 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:03.324903 25128 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.841727 25154 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:03.837071 21291 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:03.826277 24884 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:03.908876 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 59746.2us
I20260709 13:08:03.909767 21297 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:03.333282 25132 raft_consensus.cc:2272] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:03.826623 25056 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.331506 25058 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:03.900424 25136 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.702s	user 0.015s	sys 0.000s
I20260709 13:08:03.907143 25065 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:03.914783 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.335928 24951 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.557389 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:03.831555 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 494937us
I20260709 13:08:03.928134 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:03.916332 25058 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.918596 24888 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.933068 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 70554.6us
I20260709 13:08:03.921907 25171 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.925765 25157 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.948161 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:03.916332 25122 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:08:03.933549 25058 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:03.953564 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44072.9us
I20260709 13:08:03.950637 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.955389 21298 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:03.947781 25158 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.962311 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.932962 25065 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:03.956100 21776 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:03.951175 24978 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:03.950750 24941 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:08:03.967711 21293 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:03.974617 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:03.979465 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.961802 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.953045 24888 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:03.987457 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123011us
I20260709 13:08:03.951579 25157 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.944669 25128 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:03.984908 21298 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:03.997256 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:03.997685 21191 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:03.996992 25136 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.999475 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:03.990358 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:03.997965 21297 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:03.983992 24978 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:04.005189 21295 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:03.990955 24951 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:03.998750 21115 leader_election.cc:336] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.876s (SENT)
W20260709 13:08:04.009258 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49172us
I20260709 13:08:04.010658 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:04.006667 25158 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:04.020023 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 628468us
I20260709 13:08:04.020545 21143 raft_consensus.cc:2376] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10. Re-sending same reply.
I20260709 13:08:04.026736 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:04.025720 25163 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:04.032775 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45749us
I20260709 13:08:04.023344 25127 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:04.036443 25169 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:04.044016 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.044335 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.044813 21143 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:04.046434 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.047572 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:04.047755 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.049847 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.050506 21145 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:04.053201 21146 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.056397 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:04.061116 21291 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:04.023170 25170 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:04.066440 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:04.067529 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 115148us
I20260709 13:08:04.069401 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.070000 21298 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:04.070574 21298 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:04.071933 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.072746 21297 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:03.989358 25154 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.094435 24884 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.099357 25171 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:04.094291 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:04.079607 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.116904 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.118019 24884 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.118605 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.125696 21297 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:04.077768 25158 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.126590 21146 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:04.129236 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:04.131954 21142 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:08:04.139695 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.139871 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.140327 21298 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.140499 21292 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:04.141480 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.142853 24888 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.143633 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.144060 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.144630 25136 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.145202 25136 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.146297 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.147538 25165 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:04.147605 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.147825 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.148135 25165 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:04.148427 21294 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:04.149082 25165 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.150177 25128 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.135964 21145 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:04.157572 21298 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:04.126982 25124 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:04.163127 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.162482 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:04.127121 24976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.012s	sys 0.013s
I20260709 13:08:04.164386 21293 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:04.168792 25132 ts_tablet_manager.cc:1916] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:04.170147 25167 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:08:04.150651 25065 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.134478 25157 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.131124 25171 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:04.177785 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:04.176255 24976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.012s	sys 0.014s
I20260709 13:08:04.177917 21225 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.182143 21299 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:04.150878 24951 raft_consensus.cc:2764] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:04.177765 24888 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:04.183945 24884 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.184274 21224 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:04.128289 25122 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:04.167111 25147 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:04.161549 25173 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.205680 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:04.211199 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 197414us
I20260709 13:08:04.213279 25158 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:04.213711 25158 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:04.214669 25158 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.134126 24978 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.211122 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.218845 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:04.223654 21223 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:04.211380 24888 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.224426 25124 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:04.225605 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:04.226035 24888 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:04.223744 25171 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.229454 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.229836 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:04.230087 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.230700 21809 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:04.234351 21151 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
W20260709 13:08:04.229728 21189 leader_election.cc:336] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.540s (SENT)
I20260709 13:08:04.207131 25147 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.235941 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:04.239823 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:04.241051 25157 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.241317 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.241384 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:04.242069 24888 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:04.242308 21810 raft_consensus.cc:2410] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:04.243083 24888 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.243491 24888 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.243822 24888 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.241595 25157 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:04.247275 25157 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.248919 25154 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:04.266532 21809 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:08:04.282564 21033 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df140636c4344f32a0253fef2a907c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 13:08:04.285151 24794 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.285226 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.285902 24794 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:04.286542 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.286779 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.287468 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.287762 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.288178 24794 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.288653 21217 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:04.290671 21221 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:04.291693 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.300817 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:04.304836 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 348813us
I20260709 13:08:04.238629 25147 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.317111 21225 raft_consensus.cc:2410] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:08:04.327540 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 181345us
I20260709 13:08:04.342226 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:04.343500 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 113797us
I20260709 13:08:04.344192 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.354961 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:04.319412 25127 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:04.337272 25173 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.353919 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.338294 25136 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.356666 21810 raft_consensus.cc:2376] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7. Re-sending same reply.
I20260709 13:08:04.362736 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.362650 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:04.362067 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 343160us
I20260709 13:08:04.376097 21809 raft_consensus.cc:2376] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10. Re-sending same reply.
I20260709 13:08:04.382474 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:04.386082 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.387465 21226 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:04.387903 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.388661 21811 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:04.389051 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.389813 21805 raft_consensus.cc:2368] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:04.360337 25105 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:04.391034 25184 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:04.391939 25184 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.392303 25184 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.391631 25105 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.387780 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:04.399638 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43699.1us
I20260709 13:08:04.395149 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:04.411463 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.409758 24794 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.416263 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.410933 25173 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.405612 25171 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.416930 25105 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.417412 25185 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.417902 21805 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:04.417514 25171 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:04.418073 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.394526 25056 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.416406 24794 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.416263 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.417011 21811 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:04.404472 25177 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:04.464807 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.466149 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.470858 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 116336us
W20260709 13:08:04.492127 24997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.015s	sys 0.009s
W20260709 13:08:04.492674 24997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.015s	sys 0.009s
W20260709 13:08:04.495500 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 100504us
I20260709 13:08:04.496215 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.497256 21811 raft_consensus.cc:2410] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:04.473747 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.417995 25185 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.472136 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.469568 25177 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:04.510500 21806 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.510782 25177 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.511560 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:04.512324 25187 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.407491 25128 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:04.514544 25056 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.504439 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.515511 21292 raft_consensus.cc:2410] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:04.505842 21299 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:04.439463 24794 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.515153 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:04.531898 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.553525 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 79814us
I20260709 13:08:04.419186 25171 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.560880 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.508405 25185 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.573369 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.573421 21806 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
W20260709 13:08:04.572372 21264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.049s	sys 0.061s
W20260709 13:08:04.576066 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 197995us
W20260709 13:08:04.576390 21264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.049s	sys 0.061s
W20260709 13:08:04.577013 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 527852us
I20260709 13:08:04.583715 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:04.563591 25058 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
W20260709 13:08:04.562889 25140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.010s	sys 0.030s
W20260709 13:08:04.588027 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 91810.2us
I20260709 13:08:04.594741 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.596310 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.597404 21116 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:04.598186 21116 raft_consensus.cc:2686] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:04.495211 25180 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:04.600947 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.601233 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.567656 25174 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.610752 21142 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:04.572955 25165 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:08:04.573925 24997 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:04.594108 25140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.010s	sys 0.031s
I20260709 13:08:04.616310 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:04.609824 25176 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 13:08:04.627650 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 116202us
I20260709 13:08:04.629292 21151 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:04.629618 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.529235 25127 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.634651 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.638924 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:04.626762 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:04.644927 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.615809 24997 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.618132 25136 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.646428 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:04.606154 25058 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:04.666697 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:04.633760 25056 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:04.670856 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.671660 21145 raft_consensus.cc:2368] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:04.672801 21810 raft_consensus.cc:2410] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:08:04.673637 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 74781.2us
I20260709 13:08:04.674968 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:04.665925 24997 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:04.679138 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.680121 25194 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:08:04.681293 25199 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:08:04.667689 24951 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:04.679273 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.696904 21805 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.678690 25105 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.667876 25157 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.669489 25136 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:04.679207 25195 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:08:04.701021 25181 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.720618 25181 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.721139 25181 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.709059 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2569) took 1374 ms. Trace:
I20260709 13:08:04.727478 21296 rpcz_store.cc:276] 0709 13:08:03.334798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.393184 (+ 58386us) service_pool.cc:224] Handling call
0709 13:08:03.393619 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.415609 (+ 21990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.415653 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.907397 (+491744us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.159883 (+252486us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:04.159921 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.159995 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.708775 (+548780us) raft_consensus.cc:1685] finished
0709 13:08:04.708802 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.708987 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"thread_start_us":224920,"threads_started":1,"wal-append.queue_time_us":275933}
I20260709 13:08:04.709829 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.730808 21806 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.699846 24951 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.703851 25157 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.731510 24951 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.711225 24941 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.731603 25157 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.735333 25181 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.736725 21149 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:04.738196 25181 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:04.717815 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51244.7us
W20260709 13:08:04.697611 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 135865us
I20260709 13:08:04.741828 21810 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:04.709772 25178 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.743558 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:04.762336 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:04.699597 25184 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.762599 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:04.765164 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77089.2us
I20260709 13:08:04.767238 21806 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:08:04.746049 25200 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:04.768715 21144 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:04.813534 21814 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:04.766158 24976 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.813979 21814 pending_rounds.cc:85] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
W20260709 13:08:04.819016 25206 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:08:04.820106 25058 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:04.820441 21809 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:04.817752 21814 pending_rounds.cc:107] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:04.822078 21814 raft_consensus.cc:2889] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.818024 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:04.813979 25197 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:08:04.822567 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 76347.3us
I20260709 13:08:04.827690 25056 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:04.827826 25215 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.828280 25056 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.828517 25215 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.829144 25215 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:04.832062 25209 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:04.826141 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.818662 24976 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:04.846938 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 137571us
I20260709 13:08:04.824436 25105 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:04.863186 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.864068 21809 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:08:04.865839 25147 consensus_meta.cc:287] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.003s
I20260709 13:08:04.866238 25147 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.867374 21224 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:04.863613 25105 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:04.880741 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 180410us
I20260709 13:08:04.848507 24976 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.839315 25212 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:04.885345 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67418.6us
I20260709 13:08:04.891021 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:04.885174 24888 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
W20260709 13:08:04.912319 21263 connection.cc:256] RPC call timeout handler was delayed by -1.0812083849999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:08:04.916400 25056 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:04.919334 25193 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:08:04.919476 25184 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.922387 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:04.925382 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 99306.3us
I20260709 13:08:04.889724 25212 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:04.930727 21805 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:04.926187 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:04.941287 21810 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:04.941406 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:04.944433 25210 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:04.945596 25210 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:04.925169 25056 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.914072 24888 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.950814 25171 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:04.951434 21811 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:04.951223 25171 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.959657 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:04.959937 25171 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:04.961489 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.962188 25210 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:04.968999 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:04.969309 25207 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 13:08:04.969838 25208 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 13:08:04.970104 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:04.970830 21295 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:04.970973 21296 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:08:04.971675 25204 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:08:04.971916 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.972595 21292 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.973030 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.973558 21297 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.978371 21299 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.979643 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.979823 21298 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:04.980229 21294 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.980425 25228 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.981247 25221 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:04.980979 25228 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:04.980229 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 352801us
I20260709 13:08:04.984361 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:04.935315 25212 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.992249 21297 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:04.998600 25067 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.004810 25067 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.005688 25185 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:05.006956 25067 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:04.998637 25231 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.937565 25128 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:05.003091 21294 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:08:04.998234 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75966.1us
I20260709 13:08:04.967382 25136 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:05.003419 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:05.015339 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79824.1us
I20260709 13:08:05.018647 21293 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.018927 21190 leader_election.cc:400] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:05.019308 21190 leader_election.cc:403] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.983165 25228 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:05.020020 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:05.017351 25177 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.009s
I20260709 13:08:05.033147 25132 ts_tablet_manager.cc:1929] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.033727 25132 log.cc:1199] T 881a7cf58d404812aa274b116b666741 P 3585d99c303e453c8c3762b294caba4e: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/wals/881a7cf58d404812aa274b116b666741
I20260709 13:08:05.014914 25231 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:05.039134 21810 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:05.039234 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.039826 25216 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.039937 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.049041 21813 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:08:05.049427 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:05.050330 21217 raft_consensus.cc:606] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:05.021518 25227 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.041231 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.053952 21805 raft_consensus.cc:2376] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10. Re-sending same reply.
I20260709 13:08:05.055014 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.056053 21805 raft_consensus.cc:2410] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:05.043287 25232 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.038756 21292 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:05.044087 25214 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:08:05.045509 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.045656 21810 pending_rounds.cc:85] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
I20260709 13:08:05.063880 21810 pending_rounds.cc:107] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:08:05.064232 21810 raft_consensus.cc:2889] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.064639 21810 pending_rounds.cc:107] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:05.064915 21810 raft_consensus.cc:2889] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.066339 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.050249 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.040558 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.051978 21807 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.040784 21293 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:04.996730 24976 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.067046 21810 raft_consensus.cc:2376] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10. Re-sending same reply.
I20260709 13:08:05.117010 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:05.120529 25198 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:05.121007 25234 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:08:05.122262 25185 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:05.122892 25227 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.123696 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.124321 21808 raft_consensus.cc:1813] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Handling vote request from an unknown peer 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:05.124868 21808 raft_consensus.cc:2410] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:05.125240 25227 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:05.125527 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.125946 25218 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.034516 25171 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:05.126475 25218 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.127478 25147 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:05.030177 25228 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:05.129503 21811 raft_consensus.cc:2410] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:08:05.053049 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.127965 25171 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:05.052598 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 126484us
I20260709 13:08:05.048481 25231 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.155445 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.156087 21807 raft_consensus.cc:2376] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9. Re-sending same reply.
I20260709 13:08:05.156581 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.036017 25177 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:05.160084 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:05.219012 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 88675.7us
I20260709 13:08:05.223758 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:05.286396 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 278773us
I20260709 13:08:05.131529 25228 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:05.289682 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 129707us
I20260709 13:08:05.121076 25198 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:05.307888 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:05.223658 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.299052 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:05.279407 24997 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.001s
I20260709 13:08:05.143304 25157 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.131656 24951 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.130169 25216 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.281157 25132 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35736 (request call id 98) took 3587 ms. Trace:
I20260709 13:08:05.311535 21807 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:08:05.328486 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 309059us
I20260709 13:08:05.347087 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:05.271837 25170 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:05.434473 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:05.323628 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:05.355867 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 337086us
W20260709 13:08:05.532949 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.233852 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 317919us
I20260709 13:08:05.312577 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:05.433734 21226 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:05.310993 21805 raft_consensus.cc:2368] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
W20260709 13:08:05.636525 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.233160 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 1.22401e+06us
I20260709 13:08:05.780076 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:05.780627 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.235957 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:06.244458 21219 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:08:05.563956 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 253420us
W20260709 13:08:05.282203 25154 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.033s	user 0.005s	sys 0.008s
I20260709 13:08:05.433831 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:06.246199 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1096) took 1200 ms. Trace:
I20260709 13:08:06.236029 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:06.246205 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.241250 25128 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.617966 25212 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.003s
I20260709 13:08:05.433612 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:06.248483 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 962) took 1103 ms. Trace:
I20260709 13:08:06.249351 21143 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:06.246618 21807 rpcz_store.cc:276] 0709 13:08:05.039113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.248053 (+208940us) service_pool.cc:224] Handling call
0709 13:08:06.239890 (+991837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.258517 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1101) took 1202 ms. Trace:
W20260709 13:08:05.770896 25232 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 13:08:05.309132 25228 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:05.308076 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 158969us
W20260709 13:08:05.552800 24794 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.974s	user 0.003s	sys 0.013s
W20260709 13:08:05.356894 25233 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 13:08:05.648008 25213 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.876s	user 0.004s	sys 0.000s
W20260709 13:08:05.631564 25187 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.119s	user 0.007s	sys 0.005s
I20260709 13:08:06.260314 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:05.563401 25231 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.260811 21806 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:05.782096 25180 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:05.636790 24978 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.258713 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1108) took 1206 ms. Trace:
I20260709 13:08:06.261490 21805 rpcz_store.cc:276] 0709 13:08:05.139889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.157692 (+ 17803us) service_pool.cc:224] Handling call
0709 13:08:06.243476 (+1085784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.604759 25158 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:05.424926 25227 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:06.262944 21813 rpcz_store.cc:276] 0709 13:08:05.040494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.419629 (+379135us) service_pool.cc:224] Handling call
0709 13:08:06.242894 (+823265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.433251 25177 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:05.782286 25222 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:05.281090 25215 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:05.308656 25239 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:06.267421 25128 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:05.355806 25171 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:06.239315 25190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.010s	sys 0.005s
I20260709 13:08:05.311472 25198 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:05.441424 25240 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.833s
I20260709 13:08:06.280355 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1109) took 1237 ms. Trace:
I20260709 13:08:06.271741 25232 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:06.281473 21809 rpcz_store.cc:276] 0709 13:08:05.042263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.442046 (+399783us) service_pool.cc:224] Handling call
0709 13:08:06.248178 (+806132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.300963 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:06.301992 21809 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:06.288538 25223 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:06.274675 25210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.009s	sys 0.019s
I20260709 13:08:06.284070 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.304078 21807 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:06.304661 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1106) took 1262 ms. Trace:
I20260709 13:08:06.305040 21807 rpcz_store.cc:276] 0709 13:08:05.041749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.276713 (+1234964us) service_pool.cc:224] Handling call
0709 13:08:06.304593 (+ 27880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.243043 24997 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.289242 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.278211 25187 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:06.270195 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:06.267385 25212 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.273811 24794 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:06.306097 25210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.009s	sys 0.019s
I20260709 13:08:06.298735 21808 rpcz_store.cc:276] 0709 13:08:05.042523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.246329 (+1203806us) service_pool.cc:224] Handling call
0709 13:08:06.280292 (+ 33963us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:06.328989 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.039s
W20260709 13:08:06.329241 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.011s	sys 0.039s
W20260709 13:08:06.329397 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 537067us
I20260709 13:08:06.329373 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.330686 21808 raft_consensus.cc:2410] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:06.286185 25227 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.299516 21147 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 5.
I20260709 13:08:06.290377 25180 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.331194 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1103) took 1290 ms. Trace:
I20260709 13:08:06.331508 25227 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.331672 21808 rpcz_store.cc:276] 0709 13:08:05.040985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.329105 (+1288120us) service_pool.cc:224] Handling call
0709 13:08:06.331127 (+  2022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.333004 25180 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.333014 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.333952 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:06.334261 25180 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:06.321134 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1104) took 1262 ms. Trace:
I20260709 13:08:06.335172 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.335340 21809 rpcz_store.cc:276] 0709 13:08:05.041241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.300607 (+1259366us) service_pool.cc:224] Handling call
0709 13:08:06.303644 (+  3037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.336264 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 959) took 1293 ms. Trace:
I20260709 13:08:06.336681 21809 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:06.336714 21808 rpcz_store.cc:276] 0709 13:08:05.043082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.334884 (+1291802us) service_pool.cc:224] Handling call
0709 13:08:06.336202 (+  1318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.337469 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1097) took 1298 ms. Trace:
I20260709 13:08:06.337831 21809 rpcz_store.cc:276] 0709 13:08:05.039434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.336117 (+1296683us) service_pool.cc:224] Handling call
0709 13:08:06.336393 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.337232 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.337396 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.338565 21808 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:06.338999 21808 pending_rounds.cc:85] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:06.339039 21809 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.339677 21808 pending_rounds.cc:107] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 13:08:06.297627 25190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.010s	sys 0.005s
I20260709 13:08:06.286916 24978 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.344801 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.297865 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.348165 21808 raft_consensus.cc:2889] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.315649 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1102) took 1274 ms. Trace:
I20260709 13:08:06.339933 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 963) took 1097 ms. Trace:
I20260709 13:08:06.348315 21813 raft_consensus.cc:2410] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:06.350899 21805 rpcz_store.cc:276] 0709 13:08:05.040743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.281709 (+1240966us) service_pool.cc:224] Handling call
0709 13:08:06.315591 (+ 33882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.351063 21809 rpcz_store.cc:276] 0709 13:08:05.242635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.338594 (+1095959us) service_pool.cc:224] Handling call
0709 13:08:06.338860 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.339708 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.339888 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.339071 25227 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.324155 25223 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.349072 24951 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:06.349725 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 88782.4us
I20260709 13:08:06.368420 25216 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.368597 21190 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:06.369061 25216 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.350003 24978 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:06.314775 25239 consensus_queue.cc:1059] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:06.352447 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 964) took 1037 ms. Trace:
I20260709 13:08:06.352522 25212 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.239826 25132 rpcz_store.cc:276] 0709 13:08:01.740539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.766503 (+ 25964us) service_pool.cc:224] Handling call
0709 13:08:02.871554 (+1105051us) ts_tablet_manager.cc:1151] Deleting tablet 881a7cf58d404812aa274b116b666741
0709 13:08:02.871651 (+    97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:03.204045 (+332394us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b540040d154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd82ff9 00007f2b72d90482 00007f2b72dc12d0 00007f2b72da783d 00007f2b72da77e9 00007f2b72da7779 00007f2b72da7741 00007f2b72da696d 000000000038f354 000000000038f199
0709 13:08:04.668720 (+1464675us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:05.033004 (+364284us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:05.281002 (+247998us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94097,"spinlock_wait_cycles":150214528,"tablet-delete.queue_time_us":1091447,"thread_start_us":780807,"threads_started":1}
I20260709 13:08:06.297592 25222 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.359880 21807 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:06.440022 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 961) took 1300 ms. Trace:
I20260709 13:08:06.440498 21807 rpcz_store.cc:276] 0709 13:08:05.139523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.320542 (+1181019us) service_pool.cc:224] Handling call
0709 13:08:06.439939 (+119397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.349740 25128 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:06.343940 25225 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.389966 21813 rpcz_store.cc:276] 0709 13:08:05.315543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.289928 (+974385us) service_pool.cc:224] Handling call
0709 13:08:06.352389 (+ 62461us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:06.445472 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 174346us
W20260709 13:08:06.446532 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 78074.3us
W20260709 13:08:06.446041 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 172856us
I20260709 13:08:06.323690 25171 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:06.451776 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 218288us
I20260709 13:08:06.362444 25187 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:06.451862 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2632) took 1058 ms. Trace:
I20260709 13:08:06.451802 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 958) took 1409 ms. Trace:
I20260709 13:08:06.456050 21808 rpcz_store.cc:276] 0709 13:08:05.042805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.337784 (+1294979us) service_pool.cc:224] Handling call
0709 13:08:06.338142 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.451540 (+113398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.451750 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.454869 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:06.457269 21293 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:08:06.462282 21144 raft_consensus.cc:2410] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:06.471583 21264 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:06.479543 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:06.482609 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2596) took 1322 ms. Trace:
I20260709 13:08:06.486078 21296 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:06.486291 25223 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.369575 25216 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.489547 25157 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.490523 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:06.491065 25227 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.491233 21295 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.491671 25227 raft_consensus.cc:3055] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:06.492048 25227 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:06.494340 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:06.495235 21293 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:06.495793 21291 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:06.497730 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:06.483194 21292 rpcz_store.cc:276] 0709 13:08:05.160594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.160740 (+   146us) service_pool.cc:224] Handling call
0709 13:08:05.224116 (+ 63376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.224373 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:06.237847 (+1013474us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.482272 (+244425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.482319 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:06.482378 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.482443 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.482556 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46186,"prepare.queue_time_us":131682,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":1161472,"thread_start_us":375911,"threads_started":2}
I20260709 13:08:06.505281 21778 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:06.480345 21298 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:06.527832 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:06.528178 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:06.529206 21296 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:06.535831 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.536458 21809 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:06.537420 21805 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:08:06.537334 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:06.448479 24978 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:06.473984 25178 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:06.546361 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.474349 25124 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.474556 25232 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:06.474759 25122 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:06.489739 25216 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.492522 25187 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:06.493997 25128 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:06.482513 25212 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:06.527092 21299 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:06.548781 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 289090us
I20260709 13:08:06.551385 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.528651 21300 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:06.541618 25140 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:06.567492 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:06.564327 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 233211us
W20260709 13:08:06.559278 21776 connection.cc:256] RPC call timeout handler was delayed by -1.18151017699995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:08:06.565230 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.568966 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:06.565680 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77501.2us
W20260709 13:08:06.566608 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 115854us
I20260709 13:08:06.566018 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.550393 25178 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.569660 21776 connection.cc:256] RPC call timeout handler was delayed by -1.0573101769999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 13:08:06.566745 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:06.574355 21223 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:06.572822 21220 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:06.453599 25225 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.550853 25124 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:06.570197 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:06.551175 25122 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:06.551048 25232 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:06.575418 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:06.571802 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:06.575469 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:06.653079 25258 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:06.582294 21813 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.623145 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.564568 24997 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:06.660127 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 87174.2us
W20260709 13:08:06.649118 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75232.7us
I20260709 13:08:06.624460 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:06.629053 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.672149 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:06.567828 25140 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:06.623265 21812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.001s	sys 0.019s
W20260709 13:08:06.693331 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 74264.5us
W20260709 13:08:06.655210 25252 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:08:06.694919 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 138278us
I20260709 13:08:06.696259 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:06.702558 21294 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.698843 21812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.009s	sys 0.019s
I20260709 13:08:06.699730 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:06.694459 21218 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:06.709554 25124 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.710719 25124 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.710057 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.716696 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:06.717283 21814 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:06.717944 21809 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.718389 21814 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:06.718438 25239 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.563077 25254 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:08:06.720256 25225 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.721001 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1589) took 2498 ms. Trace:
I20260709 13:08:06.702471 25128 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:06.721426 21224 rpcz_store.cc:276] 0709 13:08:04.222581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.222728 (+   147us) service_pool.cc:224] Handling call
0709 13:08:04.231114 (+  8386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.867798 (+636684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.720716 (+1852918us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400115654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:06.720924 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462610304}
I20260709 13:08:06.722132 25128 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:06.722864 25128 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.655447 24794 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.723726 24794 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.724036 25231 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.724067 24794 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.726469 24794 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.700985 25216 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:06.727591 25216 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.727913 25216 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.730077 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1088) took 1698 ms. Trace:
I20260709 13:08:06.730495 21811 rpcz_store.cc:276] 0709 13:08:05.031793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.045099 (+ 13306us) service_pool.cc:224] Handling call
0709 13:08:06.729851 (+1684752us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b54003912d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:06.730019 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6982912}
I20260709 13:08:06.733862 25226 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:06.734112 24794 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.623795 25257 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:08:06.734440 25226 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.734791 25177 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.736608 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:06.756440 21146 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:06.757134 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1630) took 1008 ms. Trace:
W20260709 13:08:06.737591 21147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2048) took 2778 ms (client timeout 1639 ms). Trace:
I20260709 13:08:06.571460 25227 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.740334 24976 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.741442 25222 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:06.677979 25232 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.656009 24884 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.743592 21189 connection.cc:256] RPC call timeout handler was delayed by -1.1704129450000664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:08:06.592082 25215 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:06.758212 21147 rpcz_store.cc:269] 0709 13:08:03.988119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.999067 (+ 10948us) service_pool.cc:224] Handling call
0709 13:08:06.737413 (+2738346us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400065254. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:06.737524 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5206917248}
I20260709 13:08:06.568507 25212 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.757540 21146 rpcz_store.cc:276] 0709 13:08:05.749305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.749544 (+   239us) service_pool.cc:224] Handling call
0709 13:08:06.736441 (+986897us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:08:06.757060 (+ 20619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5972224}
I20260709 13:08:06.701858 25140 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.766541 21263 leader_election.cc:400] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:06.777127 21263 leader_election.cc:403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.674453 25157 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:08:06.719192 25239 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:06.777582 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.775240 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:06.776060 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.778514 21299 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.739045 25228 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.783771 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:06.785637 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.787356 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.787740 21217 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:06.781507 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.788820 21224 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:06.792769 21294 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
W20260709 13:08:06.795533 21115 connection.cc:256] RPC call timeout handler was delayed by -1.1143982310001093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:08:06.795929 21115 connection.cc:256] RPC call timeout handler was delayed by -1.0857808100000739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3022s for a response
W20260709 13:08:06.798447 21115 connection.cc:256] RPC call timeout handler was delayed by -1.080198231000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:08:06.809545 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:06.776671 25231 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.778321 25171 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:06.762949 25177 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.778862 24884 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:06.827181 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:06.960109 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 260528us
W20260709 13:08:06.873312 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.964936 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 192177us
I20260709 13:08:06.782078 25158 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:06.970314 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:06.779860 25227 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:06.977560 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 402170us
I20260709 13:08:06.978711 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:06.766769 25187 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:06.808164 24888 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:07.000633 21264 connection.cc:256] RPC call timeout handler was delayed by -2.3409257329999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:08:07.001282 21264 connection.cc:256] RPC call timeout handler was delayed by -2.3301257330000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:08:07.001681 21264 connection.cc:256] RPC call timeout handler was delayed by -2.0646257329999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:08:07.003787 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.004999 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:07.005786 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56377.8us
I20260709 13:08:06.778512 25122 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:07.008862 21264 connection.cc:256] RPC call timeout handler was delayed by -1.9782257330000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 13:08:07.021036 21264 connection.cc:256] RPC call timeout handler was delayed by -1.4634257330000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2731s for a response
I20260709 13:08:06.948953 25267 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:06.888432 25270 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.017964 21294 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:06.812261 25272 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:06.968968 25225 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.973556 25171 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:07.032634 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.032739 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.033318 21292 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:06.973716 25226 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:07.038455 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:06.888260 25231 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.024196 25247 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.023922 25189 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:07.025252 25274 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:07.060509 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.061208 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.061242 21811 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.066766 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:07.071841 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.047765 25225 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:07.072817 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.074642 21292 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:07.054893 21812 raft_consensus.cc:2955] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:07.038196 25215 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.094089 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:07.090224 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 58761.3us
W20260709 13:08:07.102030 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44819.9us
I20260709 13:08:07.099136 21221 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.077127 25122 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.082437 25285 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.072587 25279 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:07.084713 25247 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:07.116039 24794 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.121999 24884 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.042342 25171 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.094048 25181 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:07.143189 25171 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.144253 25171 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.144375 25178 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.143586 25181 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.145548 25257 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.116981 25065 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:07.146890 25065 consensus_queue.cc:1243] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:07.035203 25270 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.147215 25181 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:07.135558 21295 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.005s
I20260709 13:08:07.139060 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.141309 24884 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.148989 24884 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.149189 21224 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:07.149436 24884 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.149614 21224 pending_rounds.cc:85] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 8
I20260709 13:08:07.149945 21224 pending_rounds.cc:107] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:07.150172 21224 raft_consensus.cc:2889] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.151497 25216 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.100278 25215 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.089993 25225 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.153571 21295 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.157814 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.029762 25239 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:07.149430 25276 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:08:07.046418 25272 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.146975 25178 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:07.161453 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.125200 25279 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:07.033970 25267 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.180097 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.185534 21300 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.176928 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 86712.1us
W20260709 13:08:07.182533 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43578us
I20260709 13:08:07.191561 25189 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:07.160355 25158 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.195343 25215 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:07.194058 21264 leader_election.cc:336] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.768s (SENT)
I20260709 13:08:07.201371 21295 raft_consensus.cc:2368] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
W20260709 13:08:07.203071 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.175078 25228 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:07.207190 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 135428us
I20260709 13:08:07.180570 25212 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.210749 21218 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:07.139917 25285 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.212169 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.213812 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:07.215013 21114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.032s
W20260709 13:08:07.215499 21114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.009s	sys 0.032s
I20260709 13:08:07.211236 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:07.215852 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 645671us
I20260709 13:08:07.219341 24884 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.221372 24884 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.215360 24794 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:07.223619 25292 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.224076 25292 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:07.224398 25292 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.224882 25180 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:07.227427 25228 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.227836 25228 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.227952 21300 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:07.228221 25228 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.228385 25263 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:07.228951 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.229411 25266 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.229516 21300 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:07.230392 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.230536 21811 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:07.231094 21300 raft_consensus.cc:2410] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:07.231927 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.232484 21300 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:07.223078 21299 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:07.204120 25218 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:07.235558 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.234184 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.227948 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.238016 21300 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.238561 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.239130 21298 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.242555 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.236939 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:07.245380 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.246742 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.247712 25218 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:07.248898 25218 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.249630 25218 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.250303 25218 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:07.250670 25218 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:07.251389 25215 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:07.252130 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58077.9us
I20260709 13:08:07.252718 25225 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:07.253451 25282 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:07.254352 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:07.256757 21813 consensus_meta.cc:287] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.588s	user 0.004s	sys 0.004s
I20260709 13:08:07.257114 21813 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:07.255461 25231 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.264760 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.255031 25218 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.236963 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.262336 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 881a7cf58d404812aa274b116b666741 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:08:07.265717 21808 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.268508 21300 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:07.269630 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1095) took 2227 ms. Trace:
I20260709 13:08:07.270325 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.237447 25247 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.271461 21299 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:07.270864 21812 rpcz_store.cc:276] 0709 13:08:05.033995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.043476 (+  9481us) service_pool.cc:224] Handling call
0709 13:08:05.044187 (+   711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.044828 (+   641us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:05.431901 (+387073us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.874142 (+1442241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.020436 (+146294us) log.cc:844] Serialized 494 byte log entry
0709 13:08:07.020684 (+   248us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:07.258858 (+238174us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.261175 (+  2317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.261253 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.261278 (+    25us) raft_consensus.cc:1685] finished
0709 13:08:07.261284 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.261363 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105195,"prepare.queue_time_us":1255046,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3123,"raft.queue_time_us":280701,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22200,"thread_start_us":1233888,"threads_started":3,"wal-append.queue_time_us":1150935}
I20260709 13:08:07.274948 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.275712 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.277156 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.277819 21811 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:07.278249 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.279474 25285 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:07.289492 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 52609.1us
I20260709 13:08:07.279629 25267 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.232872 25299 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:08:07.260407 25215 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.302937 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.280308 25264 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:06.455689 21222 rpcz_store.cc:276] 0709 13:08:05.389711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.389838 (+   127us) service_pool.cc:224] Handling call
0709 13:08:05.432660 (+ 42822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.432907 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:05.433185 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.447494 (+1014309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.447545 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:06.447591 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.447657 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.447772 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108460,"prepare.queue_time_us":868,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":52791,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7841,"thread_start_us":164920,"threads_started":1}
W20260709 13:08:07.281518 25283 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:08:07.282042 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:07.282503 25198 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.001s
I20260709 13:08:07.282652 25157 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.283666 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1631) took 1533 ms. Trace:
I20260709 13:08:07.286319 21808 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:07.286980 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.287762 21300 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:07.257556 25254 raft_consensus.cc:2764] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:07.291711 21298 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:07.270466 25282 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.272378 25279 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.288833 24888 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.271929 25236 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:08:07.300326 25128 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.003s
I20260709 13:08:07.301434 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.304214 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.306855 21297 raft_consensus.cc:2410] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:07.306982 21147 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:07.308688 21219 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:07.320250 21299 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.319945 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.310124 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.307780 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.321529 21146 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.307910 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.316416 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:07.312662 21150 rpcz_store.cc:276] 0709 13:08:05.749792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.749931 (+   139us) service_pool.cc:224] Handling call
0709 13:08:06.237366 (+487435us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:06.555323 (+317957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.555367 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:06.568554 (+ 13187us) log.cc:844] Serialized 78 byte log entry
0709 13:08:06.693987 (+125433us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:06.760955 (+ 66968us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.761212 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.761303 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.283444 (+522141us) raft_consensus.cc:1685] finished
0709 13:08:07.283463 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.283612 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66652,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2298,"raft.queue_time_us":69764,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":8844032,"thread_start_us":346803,"threads_started":2,"wal-append.queue_time_us":197373}
I20260709 13:08:07.325064 21226 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:07.326421 25264 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:07.327797 25273 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:07.328105 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.328392 25279 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.329393 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.330018 21142 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:07.327792 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.313958 25157 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.331209 21145 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:07.331729 25157 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.332201 21148 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:08:07.332244 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.333184 25236 consensus_queue.cc:1243] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:07.333726 25282 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:07.334020 25267 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.333798 25292 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.334473 25267 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:07.327293 25128 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.334703 25282 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.335407 25158 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.336019 25292 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.337695 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1625) took 2037 ms. Trace:
I20260709 13:08:07.306602 25298 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.338126 21144 rpcz_store.cc:276] 0709 13:08:05.288297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.288453 (+   156us) service_pool.cc:224] Handling call
0709 13:08:07.320026 (+2031573us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400066154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:07.325297 (+  5271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492449664}
I20260709 13:08:07.340054 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.312728 25198 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:07.340710 21144 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:07.340876 21294 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:07.341598 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.341881 25198 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:07.342696 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:07.343279 21219 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.306656 25215 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.344447 25273 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.344805 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:07.344926 25273 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.345798 25215 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.345911 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:07.319133 24888 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:07.346493 24888 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.346935 25273 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.347802 25273 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:07.348307 25273 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.344097 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:07.350052 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.350656 25273 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.353147 21146 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:07.354125 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.354781 21808 raft_consensus.cc:2410] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:07.356885 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:07.357897 25238 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 2.001s	user 0.007s	sys 0.011s
I20260709 13:08:07.358059 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.359110 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.358359 24888 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.359982 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.359051 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.359987 21807 raft_consensus.cc:2368] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:07.375648 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.376299 21807 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:07.376346 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.377380 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.377466 21808 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:07.378846 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.379419 21807 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:07.381220 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.385736 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.361685 24888 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.362715 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.386725 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:07.363440 25232 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.002s
I20260709 13:08:07.385286 25298 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:07.366539 25266 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.327911 25264 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:07.395051 25264 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:07.396201 21292 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:07.396597 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.397325 21292 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:07.398011 25228 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.398502 21292 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.401328 21292 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:07.391161 25227 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:07.374261 25140 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
I20260709 13:08:07.360234 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.360594 21219 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.387509 21298 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.414669 21805 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:07.385787 21293 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.388059 21809 pending_rounds.cc:85] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:07.416355 21809 pending_rounds.cc:107] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:07.416705 21809 raft_consensus.cc:2889] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.388937 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.419003 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.390519 21807 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:07.421854 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.389812 25286 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.393841 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.389781 25232 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:07.397291 21149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1629) took 1823 ms (client timeout 1904 ms). Trace:
I20260709 13:08:07.425258 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.420089 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.423303 21146 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:07.427644 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.428243 21150 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:07.425401 21149 rpcz_store.cc:269] 0709 13:08:05.573832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.574027 (+   195us) service_pool.cc:224] Handling call
0709 13:08:07.396462 (+1822435us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800002a98. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d400a0 00007f2b72d3f984 00007f2b6c2ba6d4 00007f2b6c2ba662
0709 13:08:07.397240 (+   778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4285312}
I20260709 13:08:07.424475 21808 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:07.429267 21808 pending_rounds.cc:85] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:07.429543 21808 pending_rounds.cc:107] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:07.429824 21808 raft_consensus.cc:2889] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.448328 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.446449 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:07.459708 21145 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:07.415189 25273 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.460353 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.468480 21146 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:07.468456 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.460984 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.464166 21298 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:07.469152 21805 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 6.
I20260709 13:08:07.470218 21220 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:07.423677 25286 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.472313 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.428171 25298 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.434593 24888 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:07.428814 25266 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.484627 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.488567 21264 leader_election.cc:400] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:07.485456 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:07.486034 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 92253.9us
I20260709 13:08:07.486058 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.455345 25279 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.310495 25189 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.473619 21298 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.490386 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.455626 25174 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:07.492311 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.502288 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.503057 21808 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:07.489646 21149 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:07.468158 25273 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.409561 25264 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.503814 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.419580 25140 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.507082 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.483979 25286 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.512218 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.487089 25265 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.515727 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.516649 21808 raft_consensus.cc:2368] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:07.519057 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.524314 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.525126 21808 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 6.
I20260709 13:08:07.526131 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.526793 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:07.527966 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.528613 21808 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:07.529515 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.530079 21808 raft_consensus.cc:2376] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11. Re-sending same reply.
I20260709 13:08:07.531000 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.532212 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.500955 24888 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:07.508806 25273 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.489013 25247 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:07.539901 21810 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:07.534539 21149 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:07.538688 25266 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:07.548051 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.518510 24941 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.550653 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:07.492616 25298 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.518874 25127 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.558204 25211 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:07.533602 25157 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.533725 25225 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.559930 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.558238 25266 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.496476 25285 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:07.533412 25122 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:07.514142 25308 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.533658 25292 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:07.570570 21148 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:07.549562 25228 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.571333 21219 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:07.576853 21145 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:07.539815 25198 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:07.557384 24941 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:07.579075 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:07.592067 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.592764 21219 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.505730 25174 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.566329 25225 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:07.598330 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.574697 25122 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.570674 25265 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:07.602609 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 54648.5us
I20260709 13:08:07.577304 25211 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:07.576547 25308 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.577533 25292 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:07.607106 25127 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:07.607118 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.608706 21146 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:07.609089 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.610159 21805 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:07.610780 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.595592 25299 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.601138 25225 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.586526 25279 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:07.611384 24888 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:07.653892 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47610.5us
I20260709 13:08:07.661634 21142 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:07.624344 25308 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.786456 21150 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:07.669067 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.604683 25122 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:07.660352 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:07.703476 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.653859 25232 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:07.623605 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 177230us
I20260709 13:08:07.631918 21219 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.792936 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.793668 21150 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:08:07.668833 21145 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:07.625924 25228 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.625519 25173 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:07.799098 25198 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:07.799741 25173 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:07.783030 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.661273 25211 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.783679 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.626016 25292 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:07.788653 21144 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.795924 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:07.796413 21776 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.568s (SENT) [suppressed 38 similar messages]
I20260709 13:08:07.797883 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.814023 21219 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.789841 25310 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 13:08:07.671120 25299 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:07.809556 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.801371 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:07.792341 25303 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.010s
I20260709 13:08:07.815395 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:07.817864 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.818440 21264 leader_election.cc:400] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:07.819994 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:07.819058 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.820621 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.821322 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:07.825380 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.835518 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574f49e93265460891ff981be2cee774"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:07.817314 25198 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:07.837455 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:07.838907 21191 connection.cc:256] RPC call timeout handler was delayed by -1.5812866269999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:08:07.826968 25247 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.840895 21217 raft_consensus.cc:606] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:07.841332 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.841953 21145 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:07.846299 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:07.843811 21191 connection.cc:256] RPC call timeout handler was delayed by -1.405786626999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:08:07.842387 25173 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.837018 25140 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:07.848001 21191 connection.cc:256] RPC call timeout handler was delayed by -1.1087866269999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:08:07.846931 21809 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
W20260709 13:08:07.850279 21191 connection.cc:256] RPC call timeout handler was delayed by -1.0691866269999082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:08:07.830694 25264 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.856721 21219 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:07.842909 25198 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.845081 25239 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:07.913527 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:07.821738 25228 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.916893 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.852890 25279 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.922529 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1632) took 2144 ms. Trace:
I20260709 13:08:07.922953 21151 rpcz_store.cc:276] 0709 13:08:05.778469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.258901 (+480432us) service_pool.cc:224] Handling call
0709 13:08:06.276734 (+ 17833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.279308 (+  2574us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:06.452514 (+173206us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.921962 (+1469448us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b1800227c20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a
0709 13:08:07.922151 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.922205 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.922250 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.922321 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.922467 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260686,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":14519040,"thread_start_us":253081,"threads_started":2,"wal-append.queue_time_us":262875,"wal-append.run_cpu_time_us":10612,"wal-append.run_wall_time_us":1075631}
I20260709 13:08:07.924391 25154 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.853127 25127 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.925128 25127 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:07.925438 25228 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.926000 25127 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.927218 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:07.927840 21807 raft_consensus.cc:1813] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Handling vote request from an unknown peer f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:07.928386 21807 raft_consensus.cc:2410] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:07.930262 21807 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:07.926016 25228 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:08:07.858983 25157 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:07.927243 21142 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:07.917707 21809 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:07.949512 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:07.959786 21219 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:07.939224 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:07.912432 25198 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:07.980948 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:07.982262 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:07.912415 25239 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:07.918962 25174 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:07.970412 25227 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.002548 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 142775us
W20260709 13:08:08.006985 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67836.9us
W20260709 13:08:08.021242 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 224825us
I20260709 13:08:07.994576 25239 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.031591 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.036650 21809 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:08:08.039425 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 202042us
I20260709 13:08:08.038976 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.040405 21264 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:08.044458 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1596) took 1234 ms. Trace:
I20260709 13:08:08.044885 21218 rpcz_store.cc:276] 0709 13:08:06.809643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.826902 (+ 17259us) service_pool.cc:224] Handling call
0709 13:08:08.044254 (+1217352us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400116054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.044360 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554966272}
I20260709 13:08:08.045450 25328 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.045884 25328 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:08.046224 25328 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.046456 21218 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:07.982494 25299 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:07.999429 25227 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:08.060079 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 218805us
I20260709 13:08:08.067634 25323 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:08:08.069548 25273 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
I20260709 13:08:08.069998 25273 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.073135 25273 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:08.073354 25319 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:08:08.078500 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:08.067317 25286 consensus_meta.cc:287] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.006s
I20260709 13:08:08.085006 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:08.089195 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.089917 25327 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.090122 25227 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:08.090404 25327 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:08.090842 25327 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.091897 25267 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.093117 25267 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.082924 25323 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.065079 25177 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.089478 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.104307 21149 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:08.076638 25324 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:08.107677 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67107.2us
I20260709 13:08:08.109941 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.084072 25322 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.116286 25322 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.118764 25322 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.094847 25292 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.121038 25292 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.121632 24941 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.124823 25225 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.126876 25225 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.127768 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.129899 25173 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.130563 25173 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.131206 25173 consensus_queue.cc:1243] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:08.131754 25232 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:08.132085 25232 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.133188 21225 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.132839 25232 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:08.133767 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1597) took 1215 ms. Trace:
I20260709 13:08:08.134137 21225 rpcz_store.cc:276] 0709 13:08:06.918403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.132685 (+1214282us) service_pool.cc:224] Handling call
0709 13:08:08.133022 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.133543 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.133714 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.123003 24941 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.135361 21191 leader_election.cc:400] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:08.132897 25308 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.102921 25174 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:08.107606 25323 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.107949 25177 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.146389 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57026.8us
I20260709 13:08:08.136265 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.118906 25320 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:08.101094 25286 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.156193 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.156463 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:08.156862 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 148558us
I20260709 13:08:08.160192 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:08.173218 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.173389 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.174539 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.145941 24976 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:08.140182 24997 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:08.178848 25306 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:08.187651 24997 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:08.188050 24997 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.188462 25306 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:08.188939 25306 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:08.188875 24997 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.190289 24997 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.190117 25306 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.182916 21808 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:08.167579 25157 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:08.163153 25177 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.136307 25122 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.157460 25320 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.178761 24976 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.185132 25308 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:08.158385 25174 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.157788 25280 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:08:08.220309 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.221179 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:08.198691 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.247746 21223 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:08.180876 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:08.260623 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 149605us
I20260709 13:08:08.265062 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.266649 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.267077 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:08.280256 21806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1092) took 3223 ms (client timeout 1681 ms). Trace:
W20260709 13:08:08.280730 21806 rpcz_store.cc:269] 0709 13:08:05.033046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.045224 (+ 12178us) service_pool.cc:224] Handling call
0709 13:08:08.256030 (+3210806us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54004fa1d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.256188 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752189312}
W20260709 13:08:08.311338 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 130546us
I20260709 13:08:08.313613 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.317582 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:08.367165 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.368155 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.368466 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.369074 21300 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:08.320376 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 153375us
I20260709 13:08:08.374805 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.203378 25215 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.203816 25312 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.376004 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:08.385901 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 225766us
I20260709 13:08:08.376971 21293 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:08.222445 25218 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.254921 24976 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.375517 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.398456 21298 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:08.216944 25286 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:08.382846 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.224452 25128 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:08.384490 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67007.6us
I20260709 13:08:08.177531 25225 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.200s
I20260709 13:08:08.262107 25320 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.406669 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.367560 25140 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.402518 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:08.171728 25324 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.220s
I20260709 13:08:08.431409 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:08.204104 25317 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.192s
I20260709 13:08:08.429675 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.386557 25215 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.205864 25239 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.219297 25198 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.434576 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:08.419595 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.376704 25285 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:08.439572 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.439743 21295 raft_consensus.cc:2368] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
W20260709 13:08:08.442410 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.195173 25327 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:08.456043 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:08.462033 21810 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:08.462162 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:08.458319 21809 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:08.456127 21806 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:08.447619 25128 raft_consensus.cc:2764] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:08.447098 21296 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:08.479211 21300 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:08.482323 21295 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: [6.7-10.8]
I20260709 13:08:08.449090 25215 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.494109 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:08.496014 21811 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:08.524227 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.460999 25285 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:08.745931 25285 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.748299 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:08.466281 25174 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:08.588032 25313 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:08.754666 25313 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:08.755491 25313 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.591539 25314 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.755832 25298 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.756474 25314 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.756717 25313 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.756963 25314 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.757139 25216 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:08.590871 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.591919 25330 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 13:08:08.759119 21218 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:08.760469 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.761315 21218 raft_consensus.cc:2368] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:08.762284 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.601876 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.606257 21223 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:08.763607 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 752) took 1205 ms. Trace:
I20260709 13:08:08.764122 21149 rpcz_store.cc:276] 0709 13:08:07.557883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.558019 (+   136us) service_pool.cc:224] Handling call
0709 13:08:07.558307 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.104759 (+546452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.763297 (+658538us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540040db54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:08.763531 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255205120}
I20260709 13:08:08.607244 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.765944 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.766343 21300 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.766677 21149 raft_consensus.cc:1813] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Handling vote request from an unknown peer f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.608455 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.769024 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.769932 21298 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:08.770838 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.776415 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.777830 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.464546 25328 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.795419 25314 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.797451 25328 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.798290 25328 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.615142 25339 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:08.799386 25339 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.802234 25339 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.617832 25239 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.625361 21145 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.804473 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.806035 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.626113 21150 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.626540 25327 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:08.632742 25177 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.640337 25308 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:08.809283 25308 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:08.643359 25335 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:08.645423 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:08.810550 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.811178 21150 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:08.810842 25335 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.811360 21299 raft_consensus.cc:2368] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8.
I20260709 13:08:08.812101 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:08.812637 21150 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.813119 25335 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.647222 25212 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:08.648226 21220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 629) took 2053 ms (client timeout 1777 ms). Trace:
I20260709 13:08:08.815358 25212 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:08.651814 25323 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:08.815436 21220 rpcz_store.cc:269] 0709 13:08:06.594438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.695027 (+100589us) service_pool.cc:224] Handling call
0709 13:08:08.648042 (+1953015us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540038ac54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.648157 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744097536}
I20260709 13:08:08.816147 25323 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.816740 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.816586 25212 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.817854 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.818491 21220 raft_consensus.cc:2368] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:08.658411 21143 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:08.659926 25154 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:08.819126 25154 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.819415 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 751) took 1280 ms. Trace:
I20260709 13:08:08.819552 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.820011 21143 rpcz_store.cc:276] 0709 13:08:07.539082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.539201 (+   119us) service_pool.cc:224] Handling call
0709 13:08:07.546224 (+  7023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.658272 (+1112048us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b54003eea20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:08:08.819067 (+160795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.819338 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17984768}
I20260709 13:08:08.821153 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.821617 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.821995 21220 raft_consensus.cc:2410] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:08.822877 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:08.666047 25318 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.681s	user 0.002s	sys 0.000s
I20260709 13:08:08.666483 21146 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:08.668798 25158 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.827694 25128 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:08.828238 25128 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:08.827490 25158 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.673337 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 761) took 1064 ms. Trace:
I20260709 13:08:08.829623 21142 rpcz_store.cc:276] 0709 13:08:07.608504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.794175 (+185671us) service_pool.cc:224] Handling call
0709 13:08:08.673140 (+878965us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b540040ea54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.673245 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200036608}
I20260709 13:08:08.829457 25128 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.830462 25158 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.831122 21142 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.831314 21146 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.818221 25212 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.832454 21142 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:08.832459 21146 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:08.676309 25270 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.677017 21151 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:08.677604 21294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2234) took 1654 ms (client timeout 1755 ms). Trace:
W20260709 13:08:08.835047 21294 rpcz_store.cc:269] 0709 13:08:07.022804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.038143 (+ 15339us) service_pool.cc:224] Handling call
0709 13:08:08.677418 (+1639275us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400033c54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.677520 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694031744}
I20260709 13:08:08.835439 25154 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.677737 25272 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:08.639045 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 749) took 1147 ms. Trace:
W20260709 13:08:08.679796 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.684042 24976 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.837551 25154 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.684276 25232 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:08.838297 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.838719 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.839847 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.840828 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.841457 21220 raft_consensus.cc:2368] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:08.842136 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.689754 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.694314 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.698822 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 635) took 1670 ms. Trace:
I20260709 13:08:08.727178 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:08.728543 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.732661 25280 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:08.738690 25306 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.729566 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 753) took 1171 ms. Trace:
I20260709 13:08:08.492607 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:08.745115 25122 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.755744 21812 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:08.761018 25330 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:08.592674 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.486590 25312 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.613005 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2646) took 1310 ms. Trace:
I20260709 13:08:08.771944 21149 raft_consensus.cc:2410] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:08.615381 25198 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.778952 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.780681 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.783284 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.845203 21147 rpcz_store.cc:276] 0709 13:08:07.491886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.492065 (+   179us) service_pool.cc:224] Handling call
0709 13:08:08.638800 (+1146735us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540040e554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.638967 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607738752}
I20260709 13:08:08.816970 25323 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:08.818552 25231 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:08.656167 25332 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.661032 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1179) took 1119 ms. Trace:
I20260709 13:08:08.889776 21808 rpcz_store.cc:276] 0709 13:08:07.542061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.550424 (+  8363us) service_pool.cc:224] Handling call
0709 13:08:08.659092 (+1108668us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54004a3654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:08.659240 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437706112}
I20260709 13:08:08.823745 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:08.818176 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 216395us
W20260709 13:08:08.844399 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.843211 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:08.866798 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 114243us
I20260709 13:08:08.893014 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.860433 21300 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:08.872061 21297 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.870543 21292 raft_consensus.cc:1813] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Handling vote request from an unknown peer f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.894263 21292 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:08.872244 21298 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:08.860409 21814 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.894838 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:08.851246 21150 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:08.870540 21224 rpcz_store.cc:276] 0709 13:08:07.028271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.028438 (+   167us) service_pool.cc:224] Handling call
0709 13:08:07.038452 (+ 10014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.150616 (+112164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.695217 (+1544601us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540039add4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:08.698740 (+  3523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253811584}
I20260709 13:08:08.870750 21226 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
W20260709 13:08:08.872668 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 380109us
I20260709 13:08:08.896463 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.896665 21191 leader_election.cc:400] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:08.896958 21191 leader_election.cc:403] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:08.897814 21191 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:08.878238 21218 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
W20260709 13:08:08.900094 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.789763 25215 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:08.874752 21189 leader_election.cc:336] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Timed out: RequestConsensusVote RPC to 127.19.145.1:46145 timed out after 1.639s (SENT)
W20260709 13:08:08.880100 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 101265us
I20260709 13:08:08.904727 21778 leader_election.cc:400] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8.
I20260709 13:08:08.876600 21219 rpcz_store.cc:276] 0709 13:08:07.302847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.039089 (+736242us) service_pool.cc:224] Handling call
0709 13:08:08.040990 (+  1901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.066308 (+ 25318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.066355 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.066932 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.384253 (+317321us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:08.389625 (+  5372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.389717 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.612774 (+223057us) raft_consensus.cc:1685] finished
0709 13:08:08.612798 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.612943 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20570,"raft.queue_time_us":26621,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":6594,"thread_start_us":248944,"threads_started":1,"wal-append.queue_time_us":361380}
I20260709 13:08:08.878412 21223 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:08.906109 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.907002 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:08.907757 21150 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:08.884333 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:08.884333 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:08.890060 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.820850 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.900695 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.870150 21148 rpcz_store.cc:276] 0709 13:08:07.558280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.559180 (+   900us) service_pool.cc:224] Handling call
0709 13:08:07.559472 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.591505 (+ 32033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.729301 (+1137796us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b54001f7554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:08.729498 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16903040}
I20260709 13:08:08.909466 21116 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.891646 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:08.910627 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.898391 25260 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.871106 25272 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.925856 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.926759 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.927127 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.927511 21223 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:08.870080 25280 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.912094 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:08.924633 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.878998 25267 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.930230 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:08.932410 21294 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:08.945569 21223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:08.947841 21223 raft_consensus.cc:606] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:08.948155 21223 raft_consensus.cc:614] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:08.948927 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74222.2us
I20260709 13:08:08.949133 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.960744 21297 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:08.899807 25198 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:08.982385 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 70350.5us
W20260709 13:08:08.983348 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.892787 25128 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.973616 21807 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:08.893592 25218 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.950786 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:08.975713 21297 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:08.976428 21149 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:08.969113 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.970609 21218 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:08:08.909466 21147 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:08.991235 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:08.992329 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:08.994519 25317 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:08.949349 25344 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:08.995623 21292 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:08.996237 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.997704 21298 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:08.949576 24997 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.924443 25231 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:08.855638 25320 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:09.046627 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:09.074141 21147 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:08.981983 25154 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:08.885877 25312 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:09.043918 25286 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.925248 25289 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:08.979586 25257 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.957108 25267 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:09.071396 21142 raft_consensus.cc:2368] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:08:09.067528 25270 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.973035 25173 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:09.085819 25173 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:09.086293 25173 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.996513 25324 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:08:08.950066 25272 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:09.071748 25317 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:09.068568 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:09.043118 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 92415.4us
I20260709 13:08:10.164868 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:10.166072 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:09.077121 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:10.169617 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 775) took 1287 ms. Trace:
I20260709 13:08:10.169984 21147 rpcz_store.cc:276] 0709 13:08:08.894815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.076859 (+182044us) service_pool.cc:224] Handling call
0709 13:08:10.169547 (+1092688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.098534 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:09.361639 21217 raft_consensus.cc:2410] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:08:10.317382 21217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1604) took 2189 ms (client timeout 2050 ms). Trace:
W20260709 13:08:10.317754 21217 rpcz_store.cc:269] 0709 13:08:08.128095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.583548 (+455453us) service_pool.cc:224] Handling call
0709 13:08:10.317163 (+1733615us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540039b7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:10.317312 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123520256}
I20260709 13:08:09.072501 21218 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
W20260709 13:08:09.626335 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.109680 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.042s	sys 0.107s
W20260709 13:08:11.337486 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.909s	user 0.050s	sys 0.134s
W20260709 13:08:11.338194 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 2.9365e+06us
I20260709 13:08:11.339054 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:10.013667 21037 maintenance_manager.cc:643] P 17f9ac50e9a3445ba29d33dbe0f8af0f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.247s	user 0.187s	sys 0.046s Metrics: {"bytes_written":30124,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":2481,"dirs.run_cpu_time_us":413,"dirs.run_wall_time_us":9466,"drs_written":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4,"lbm_write_time_us":39903,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":7438,"threads_started":2,"update_count":14,"wal-append.queue_time_us":5628}
I20260709 13:08:10.144742 21049 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.345886 21049 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:11.346551 25330 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.943856 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:11.400875 21142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1645) took 2519 ms (client timeout 1941 ms). Trace:
W20260709 13:08:11.401263 21142 rpcz_store.cc:269] 0709 13:08:08.881331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.082510 (+201179us) service_pool.cc:224] Handling call
0709 13:08:11.400786 (+2318276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.964048 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:11.405273 21143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 776) took 2510 ms (client timeout 1941 ms). Trace:
W20260709 13:08:11.405650 21143 rpcz_store.cc:269] 0709 13:08:08.895207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.963706 (+1068499us) service_pool.cc:224] Handling call
0709 13:08:11.405203 (+1441497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.996272 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:11.407383 21145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1646) took 2525 ms (client timeout 2063 ms). Trace:
W20260709 13:08:11.407740 21145 rpcz_store.cc:269] 0709 13:08:08.881647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.996015 (+1114368us) service_pool.cc:224] Handling call
0709 13:08:11.407315 (+1411300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.984068 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:10.118299 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:09.987141 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:11.411392 21150 raft_consensus.cc:2368] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
W20260709 13:08:11.411823 21150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1648) took 2529 ms (client timeout 2034 ms). Trace:
W20260709 13:08:11.412175 21150 rpcz_store.cc:269] 0709 13:08:08.882359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.986888 (+1104529us) service_pool.cc:224] Handling call
0709 13:08:11.411757 (+1424869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.071617 21151 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.171209 21147 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:10.289642 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 122816us
W20260709 13:08:10.310176 21047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46294 (request call id 379) took 15556 ms (client timeout 15000 ms). Trace:
I20260709 13:08:11.415511 21147 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:10.315174 21141 tablet_service.cc:1558] Processing DeleteTablet for tablet 881a7cf58d404812aa274b116b666741 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:35736
I20260709 13:08:11.416267 25366 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:11.416375 21147 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:10.322779 21149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1644) took 1441 ms (client timeout 1904 ms). Trace:
I20260709 13:08:10.047802 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2652) took 1206 ms. Trace:
I20260709 13:08:11.420238 21226 rpcz_store.cc:276] 0709 13:08:08.841009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.046981 (+1205972us) service_pool.cc:224] Handling call
0709 13:08:10.047286 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.047466 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.047494 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.047537 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:10.047570 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.047624 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.047742 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.225099 21291 raft_consensus.cc:2410] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:08:11.423888 21291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 757) took 2815 ms (client timeout 1822 ms). Trace:
I20260709 13:08:10.243894 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2648) took 1404 ms. Trace:
W20260709 13:08:11.424249 21291 rpcz_store.cc:269] 0709 13:08:08.608867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.689469 (+ 80602us) service_pool.cc:224] Handling call
0709 13:08:11.423665 (+2734196us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540022e2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:11.423786 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815032576}
I20260709 13:08:11.417506 21147 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.424793 21220 rpcz_store.cc:276] 0709 13:08:08.839692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.068802 (+229110us) service_pool.cc:224] Handling call
0709 13:08:09.069256 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.072217 (+  2961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.072251 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.078843 (+  6592us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.240895 (+1162052us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.240938 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.241008 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.243637 (+  2629us) raft_consensus.cc:1685] finished
0709 13:08:10.243663 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.243821 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2496,"raft.queue_time_us":2671,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3815,"thread_start_us":145910,"threads_started":1,"wal-append.queue_time_us":1134316,"wal-append.run_cpu_time_us":24728,"wal-append.run_wall_time_us":1149155}
I20260709 13:08:10.173859 21222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:11.427891 21222 raft_consensus.cc:606] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:11.428483 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50268 (request call id 23) took 1369 ms. Trace:
I20260709 13:08:11.428787 21222 rpcz_store.cc:276] 0709 13:08:10.058906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.173697 (+114791us) service_pool.cc:224] Handling call
0709 13:08:11.428398 (+1254701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.913185 21225 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:08:11.430725 21225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1598) took 3304 ms (client timeout 1631 ms). Trace:
W20260709 13:08:11.431084 21225 rpcz_store.cc:269] 0709 13:08:08.126407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.134947 (+  8540us) service_pool.cc:224] Handling call
0709 13:08:11.430485 (+3295538us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540039bcd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:11.430636 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042882944}
W20260709 13:08:09.777493 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.010s	sys 0.025s
W20260709 13:08:11.434176 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.483s	user 0.012s	sys 0.026s
W20260709 13:08:11.434504 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 2.48335e+06us
I20260709 13:08:11.435346 25362 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.435923 25362 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:10.064183 21190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.019s	sys 0.006s
W20260709 13:08:11.440567 21190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.466s	user 0.020s	sys 0.008s
W20260709 13:08:11.441159 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 2.51082e+06us
I20260709 13:08:09.084628 21293 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:09.107728 21295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.055s
W20260709 13:08:11.448657 21295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.849s	user 0.003s	sys 0.055s
I20260709 13:08:11.449708 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2254) took 3182 ms. Trace:
W20260709 13:08:09.455485 21296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.024s
W20260709 13:08:11.452364 21296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.523s	user 0.011s	sys 0.024s
I20260709 13:08:10.323866 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2654) took 1482 ms. Trace:
I20260709 13:08:10.321583 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1605) took 2193 ms. Trace:
I20260709 13:08:09.992379 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2649) took 1152 ms. Trace:
I20260709 13:08:10.002631 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2650) took 1162 ms. Trace:
I20260709 13:08:11.459923 21223 rpcz_store.cc:276] 0709 13:08:08.840355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.001900 (+1161545us) service_pool.cc:224] Handling call
0709 13:08:10.002168 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.002326 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.002350 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.002388 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.002424 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.002483 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.002578 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:09.504015 21264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.009s	sys 0.016s
W20260709 13:08:11.462146 21264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.713s	user 0.010s	sys 0.016s
I20260709 13:08:11.462038 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:09.093436 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.466509 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.552642 21299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.018s	sys 0.025s
W20260709 13:08:11.470311 21299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.583s	user 0.019s	sys 0.026s
I20260709 13:08:11.472637 25379 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.473385 25379 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:10.335354 21115 leader_election.cc:336] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.681s (SENT)
W20260709 13:08:11.476141 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 1.14082e+06us
I20260709 13:08:10.285465 21776 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:10.088677 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.094547 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:10.266692 21805 raft_consensus.cc:1217] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.6->[7.7-11.9]   Dedup: 7.7->[9.8-11.9]
I20260709 13:08:10.275466 21806 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:08:10.067456 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 986) took 1634 ms. Trace:
I20260709 13:08:11.486758 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1122) took 1213 ms. Trace:
I20260709 13:08:11.486886 21807 rpcz_store.cc:276] 0709 13:08:08.432706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.432869 (+   163us) service_pool.cc:224] Handling call
0709 13:08:08.433238 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.990656 (+557418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.067158 (+1076502us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54006c02d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:10.067388 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241956224}
I20260709 13:08:11.487234 21806 rpcz_store.cc:276] 0709 13:08:10.273799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.274904 (+  1105us) service_pool.cc:224] Handling call
0709 13:08:10.275216 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.486461 (+1211245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.486701 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.488503 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.489007 25397 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:11.489261 21806 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.489758 25397 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:10.265550 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.492635 21808 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.492934 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 2.39831e+06us
I20260709 13:08:10.276643 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:10.283143 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.495612 21809 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:11.495986 21810 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.496212 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1126) took 1221 ms. Trace:
I20260709 13:08:11.496701 21809 rpcz_store.cc:276] 0709 13:08:10.274860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.276393 (+  1533us) service_pool.cc:224] Handling call
0709 13:08:11.496136 (+1219743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.497970 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:10.267412 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:09.529556 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1177) took 2255 ms. Trace:
I20260709 13:08:11.500672 21812 rpcz_store.cc:276] 0709 13:08:07.274554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.274784 (+   230us) service_pool.cc:224] Handling call
0709 13:08:09.529307 (+2254523us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:09.529473 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404281088}
I20260709 13:08:11.501801 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:11.502645 21812 raft_consensus.cc:2410] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:10.266136 21813 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:10.266362 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:11.488507 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:11.504649 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1119) took 1239 ms. Trace:
I20260709 13:08:11.504998 21814 raft_consensus.cc:2410] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:11.505502 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1115) took 1241 ms. Trace:
I20260709 13:08:11.505813 21814 rpcz_store.cc:276] 0709 13:08:10.264339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.266092 (+  1753us) service_pool.cc:224] Handling call
0709 13:08:11.505450 (+1239358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.348824 24976 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.512619 24976 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.513604 25399 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:09.204113 25173 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:10.322774 25174 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.517275 25174 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.517441 25173 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:11.520184 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45731.2us
W20260709 13:08:09.153620 25187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.020s	sys 0.047s
W20260709 13:08:11.523399 25187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.589s	user 0.020s	sys 0.049s
I20260709 13:08:10.139760 25189 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.524971 25189 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.991791 25198 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:10.138690 25211 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.486634 25396 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:11.532199 25211 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:09.191155 25215 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:09.107937 25257 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:09.214943 25260 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9.
I20260709 13:08:09.085104 25267 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.543045 25384 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35736 (request call id 99) took 1229 ms. Trace:
I20260709 13:08:11.543530 25211 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:09.104928 25270 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:11.549814 25382 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:09.209439 25272 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.543629 25384 rpcz_store.cc:276] 0709 13:08:10.313368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.314889 (+  1521us) service_pool.cc:224] Handling call
0709 13:08:11.542633 (+1227744us) ts_tablet_manager.cc:1151] Deleting tablet 881a7cf58d404812aa274b116b666741
0709 13:08:11.542714 (+    81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:11.542970 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":126040,"thread_start_us":131726,"threads_started":1}
I20260709 13:08:11.553480 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:11.490955 25397 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:11.557137 20041 debug-util.cc:398] Leaking SignalData structure 0x7b080000fce0 after lost signal to thread 21263
I20260709 13:08:11.557848 25272 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.558312 25272 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:10.159967 25273 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.560010 25273 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.565188 25388 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:09.074455 25280 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.567088 25388 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:11.567996 25280 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.568284 25382 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.568805 25382 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:11.569945 25382 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.571326 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:09.136096 25282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.007s	sys 0.014s
W20260709 13:08:11.577127 25282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.375s	user 0.009s	sys 0.014s
I20260709 13:08:09.072095 25285 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:11.581395 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 117655us
I20260709 13:08:09.090447 25286 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:11.582680 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.583297 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:11.584618 25286 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:11.584700 25392 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:09.096239 25289 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.585733 21033 catalog_manager.cc:5028] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): tablet 881a7cf58d404812aa274b116b666741 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:08:11.586829 25388 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.587612 25289 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:11.587446 25388 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.587994 25285 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:08.983332 25292 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:11.589984 25292 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:11.590461 21291 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:11.594655 21291 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:10.098057 25299 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.597446 25388 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:08.960799 25308 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.611995 21292 pending_rounds.cc:85] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 9
I20260709 13:08:11.612313 21292 pending_rounds.cc:107] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:08:11.612373 25308 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.612607 21292 raft_consensus.cc:2889] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:10.098790 25312 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:10.161535 25306 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.619931 25306 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.622061 25306 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:10.031467 25314 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:09.210529 25320 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.625717 25320 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.626281 25320 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:09.102290 25231 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:08.980746 25323 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.008986 25324 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.631570 25324 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.634070 25324 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:10.352011 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2079) took 1693 ms. Trace:
I20260709 13:08:10.239544 25364 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:10.977334 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff7c0 after lost signal to thread 20039
W20260709 13:08:11.637020 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2c40 after lost signal to thread 21083
W20260709 13:08:11.638476 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6aa0 after lost signal to thread 21175
W20260709 13:08:11.638760 21835 debug-util.cc:398] Leaking SignalData structure 0x7b080032de60 after lost signal to thread 21176
I20260709 13:08:11.340531 25378 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.639897 25320 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:11.639582 25378 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.642199 25378 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.344651 21038 maintenance_manager.cc:419] P 17f9ac50e9a3445ba29d33dbe0f8af0f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10736 bytes on disk
W20260709 13:08:11.353215 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08001c07c0 after lost signal to thread 20036
I20260709 13:08:11.347795 21049 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 10, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:11.643225 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0a00 after lost signal to thread 20039
I20260709 13:08:11.355358 25330 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:11.364408 25380 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:11.378111 25322 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.381444 25178 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.663544 25380 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.664558 25178 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:11.665186 25178 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.386212 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080009bee0 after lost signal to thread 20036
I20260709 13:08:11.386992 25381 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.666170 25380 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:11.666529 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800133cc0 after lost signal to thread 20039
I20260709 13:08:11.666718 25381 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.667593 25322 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.667503 25330 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.668833 25381 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:11.394786 21192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.018s	sys 0.003s
W20260709 13:08:11.669561 21192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.018s	sys 0.003s
I20260709 13:08:11.669873 25322 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:11.417724 21149 rpcz_store.cc:269] 0709 13:08:08.881059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.073448 (+192389us) service_pool.cc:224] Handling call
0709 13:08:10.322732 (+1249284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.415736 21047 rpcz_store.cc:269] 0709 13:07:54.754136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.821920 (+ 67784us) service_pool.cc:224] Handling call
0709 13:08:10.310078 (+15488158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.672582 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.837803 (+165221us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.848767 (+ 10964us) write_op.cc:435] Acquired schema lock
0709 13:08:04.877981 (+ 29214us) tablet.cc:662] Decoding operations
0709 13:08:05.120509 (+242528us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:05.120619 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:05.120646 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:05.121989 (+  1343us) tablet.cc:701] Row locks acquired
0709 13:08:05.122032 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:08:05.122223 (+   191us) write_op.cc:270] Start()
0709 13:08:05.122393 (+   170us) write_op.cc:276] Timestamp: P: 1783602485122155 usec, L: 0
0709 13:08:05.122414 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:05.123230 (+   816us) log.cc:844] Serialized 5851 byte log entry
0709 13:08:06.972486 (+1849256us) op_driver.cc:464] REPLICATION: finished
0709 13:08:07.231627 (+259141us) write_op.cc:301] APPLY: starting
0709 13:08:07.231722 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:07.232733 (+  1011us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:07.235554 (+  2821us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:07.263382 (+ 27828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:07.263758 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:08:07.263809 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:07.264202 (+   393us) log.cc:844] Serialized 101 byte log entry
0709 13:08:07.264398 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.264585 (+   187us) write_op.cc:454] Released schema lock
0709 13:08:07.264648 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:07.292739 (+ 28091us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.302285 (+  9546us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5432,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":258852,"apply.run_cpu_time_us":5465,"apply.run_wall_time_us":43192,"num_ops":14,"prepare.queue_time_us":539325,"prepare.run_cpu_time_us":24412,"prepare.run_wall_time_us":1709852,"raft.queue_time_us":602787,"raft.run_cpu_time_us":19620,"raft.run_wall_time_us":219623,"replication_time_us":1849858,"thread_start_us":2106609,"threads_started":4,"wal-append.queue_time_us":1048636,"wal-append.run_cpu_time_us":32821,"wal-append.run_wall_time_us":1987635}]]}
W20260709 13:08:11.667519 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce8a0 after lost signal to thread 21083
W20260709 13:08:11.671797 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08000e12c0 after lost signal to thread 21116
W20260709 13:08:11.672395 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080018d240 after lost signal to thread 21147
I20260709 13:08:11.424206 21151 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:11.672878 21220 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:11.672993 21151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 778) took 2775 ms (client timeout 1764 ms). Trace:
W20260709 13:08:11.673355 21151 rpcz_store.cc:269] 0709 13:08:08.897864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.982605 (+ 84741us) service_pool.cc:224] Handling call
0709 13:08:11.672930 (+2690325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.444823 24884 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.674202 24884 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.675735 21226 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.676126 24884 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.676043 25267 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.676658 25377 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.445021 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:11.447790 25362 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.450095 21293 rpcz_store.cc:276] 0709 13:08:08.267747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.392909 (+125162us) service_pool.cc:224] Handling call
0709 13:08:08.424892 (+ 31983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.446901 (+3022009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.449460 (+  2559us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540029e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:11.449632 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516595072}
I20260709 13:08:11.456228 21218 rpcz_store.cc:276] 0709 13:08:08.128357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.071730 (+943373us) service_pool.cc:224] Handling call
0709 13:08:09.072185 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:10.321287 (+1249102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.321530 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.456668 21217 rpcz_store.cc:276] 0709 13:08:08.841643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.318683 (+1477040us) service_pool.cc:224] Handling call
0709 13:08:10.319012 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.319191 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.319218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.323487 (+  4269us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:10.323552 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.323629 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.323791 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.679212 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0660 after lost signal to thread 21250
W20260709 13:08:11.680601 21835 debug-util.cc:398] Leaking SignalData structure 0x7b0800416d00 after lost signal to thread 21324
W20260709 13:08:11.680886 21835 debug-util.cc:398] Leaking SignalData structure 0x7b080038d620 after lost signal to thread 21325
W20260709 13:08:11.682163 21835 debug-util.cc:398] Leaking SignalData structure 0x7b080024b9e0 after lost signal to thread 21838
W20260709 13:08:11.682436 21835 debug-util.cc:398] Leaking SignalData structure 0x7b080038a460 after lost signal to thread 21839
W20260709 13:08:11.463125 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 2.71472e+06us
I20260709 13:08:11.458233 21219 rpcz_store.cc:276] 0709 13:08:08.840036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.991613 (+1151577us) service_pool.cc:224] Handling call
0709 13:08:09.991923 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.992079 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.992104 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.992144 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:09.992172 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.992222 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.992322 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.485288 21223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:11.686529 21223 raft_consensus.cc:606] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:11.485917 21805 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [7.7-11.9]
I20260709 13:08:11.687727 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1117) took 1422 ms. Trace:
I20260709 13:08:11.688117 21805 rpcz_store.cc:276] 0709 13:08:10.264901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.266145 (+  1244us) service_pool.cc:224] Handling call
0709 13:08:10.266493 (+   348us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:11.687398 (+1420905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.687666 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.503742 21115 connection.cc:256] RPC call timeout handler was delayed by -1.1183234490000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:08:11.689603 21115 connection.cc:256] RPC call timeout handler was delayed by -1.001122801000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 13:08:11.503067 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1127) took 1228 ms. Trace:
I20260709 13:08:11.691423 21812 rpcz_store.cc:276] 0709 13:08:10.275114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.501497 (+1226383us) service_pool.cc:224] Handling call
0709 13:08:11.503008 (+  1511us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.507172 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.508345 25379 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:11.695676 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2c00 after lost signal to thread 24997
W20260709 13:08:11.508780 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 1.22332e+06us
W20260709 13:08:11.696127 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08003d55c0 after lost signal to thread 25067
W20260709 13:08:11.696493 21835 debug-util.cc:398] Leaking SignalData structure 0x7b0800284d40 after lost signal to thread 25154
W20260709 13:08:11.697347 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08003aee60 after lost signal to thread 25317
I20260709 13:08:11.697465 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:11.505053 21807 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:11.505007 21813 rpcz_store.cc:276] 0709 13:08:10.265440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.265593 (+   153us) service_pool.cc:224] Handling call
0709 13:08:10.265901 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.503988 (+1238087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.504598 (+   610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.506774 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.698485 21814 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.511075 21810 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:09.081698 25154 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:11.700619 21810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1132) took 1420 ms (client timeout 1622 ms). Trace:
W20260709 13:08:11.701116 21810 rpcz_store.cc:269] 0709 13:08:10.280180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.282821 (+  2641us) service_pool.cc:224] Handling call
0709 13:08:11.700541 (+1417720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.702216 25154 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.702739 21810 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:11.532861 25396 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:10.241840 25227 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:11.534827 25385 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.744796 21292 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:11.535461 24941 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.745802 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:11.746100 24941 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:11.746505 21292 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:11.535795 25189 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:11.749934 21264 connection.cc:256] RPC call timeout handler was delayed by -1.2728058929999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:08:11.750458 21264 connection.cc:256] RPC call timeout handler was delayed by -1.2047613449999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:08:11.536641 25174 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.530756 25198 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.538653 25257 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.677203 25377 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:11.545202 21778 connection.cc:256] RPC call timeout handler was delayed by -2.2072008910000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:08:11.758911 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.549115 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2094) took 2643 ms. Trace:
I20260709 13:08:11.761749 21147 rpcz_store.cc:276] 0709 13:08:08.905879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.170771 (+1264892us) service_pool.cc:224] Handling call
0709 13:08:10.171092 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.547959 (+1376867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.547990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.548825 (+   835us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:11.548868 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.548942 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.549056 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20042,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":115492,"threads_started":1}
I20260709 13:08:11.356173 21263 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:11.558768 25272 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.574314 25382 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.577814 21221 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:11.577814 25282 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:09.074611 24997 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:11.825418 25198 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:11.598939 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.599077 21809 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.600700 21300 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.830386 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:11.830765 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:11.831084 21300 raft_consensus.cc:2368] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8.
I20260709 13:08:11.831645 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:11.831768 25377 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.831988 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.832209 21223 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.832552 21300 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:09.066461 25067 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:11.605638 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.602257 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.834663 25322 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.834969 21294 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:11.835155 25322 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.835577 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:11.836169 21219 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:11.836537 25386 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.837141 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:11.837036 25386 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.837744 21217 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.838681 21778 leader_election.cc:400] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8.
I20260709 13:08:11.839005 21778 leader_election.cc:403] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:11.562783 25273 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:09.189790 25317 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.597873 25299 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.616978 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:11.614305 24976 consensus_queue.cc:1175] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:11.550716 25270 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.613982 25211 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:11.618685 21808 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:11.850713 25273 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:11.644150 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080014c340 after lost signal to thread 21083
I20260709 13:08:11.644153 21049 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 9, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:11.882416 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08001c06c0 after lost signal to thread 21175
I20260709 13:08:11.657366 21037 maintenance_manager.cc:643] P 17f9ac50e9a3445ba29d33dbe0f8af0f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.013s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":363,"lbm_reads_lt_1ms":4}
W20260709 13:08:11.672643 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8540 after lost signal to thread 21149
W20260709 13:08:11.883924 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8300 after lost signal to thread 21175
W20260709 13:08:11.884254 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08001bbec0 after lost signal to thread 21176
W20260709 13:08:11.885154 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9b80 after lost signal to thread 21218
W20260709 13:08:11.886000 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4120 after lost signal to thread 21250
W20260709 13:08:11.886301 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080037dfc0 after lost signal to thread 21251
W20260709 13:08:11.886605 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800397f40 after lost signal to thread 21263
W20260709 13:08:11.886893 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080031f1e0 after lost signal to thread 21265
I20260709 13:08:11.677170 21224 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:11.694690 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.887866 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.888279 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.854763 25403 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.704663 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1133) took 1424 ms. Trace:
W20260709 13:08:11.705133 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 260178us
I20260709 13:08:11.897362 21810 rpcz_store.cc:276] 0709 13:08:10.280452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.701980 (+1421528us) service_pool.cc:224] Handling call
0709 13:08:11.702333 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.703205 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.704607 (+  1402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.897792 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:11.706005 21807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1131) took 1426 ms (client timeout 1794 ms). Trace:
I20260709 13:08:11.708653 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:11.709616 21222 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:11.901345 21807 rpcz_store.cc:269] 0709 13:08:10.279945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.488187 (+1208242us) service_pool.cc:224] Handling call
0709 13:08:11.705940 (+217753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37120}
I20260709 13:08:11.902680 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:11.712396 21115 leader_election.cc:336] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.417s (SENT)
I20260709 13:08:11.715509 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2614) took 3629 ms. Trace:
I20260709 13:08:11.695573 25381 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.695504 25364 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:11.709734 25362 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.908691 21148 raft_consensus.cc:2410] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:11.908811 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 648) took 4111 ms. Trace:
I20260709 13:08:11.903857 21296 rpcz_store.cc:276] 0709 13:08:08.085801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.085991 (+   190us) service_pool.cc:224] Handling call
0709 13:08:08.086496 (+   505us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:08.228107 (+141611us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b1800439d20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd72bfb 00007f2b6dd7d64b
0709 13:08:08.228266 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.228298 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:08.229689 (+  1391us) log.cc:844] Serialized 608 byte log entry
0709 13:08:08.446996 (+217307us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:08.664099 (+217103us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.452797 (+2788698us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.705567 (+252770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.705641 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.715285 (+  9644us) raft_consensus.cc:1685] finished
0709 13:08:11.715305 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.715447 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222739,"prepare.queue_time_us":253587,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6107,"raft.queue_time_us":197493,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":18262,"spinlock_wait_cycles":10748288,"thread_start_us":3022303,"threads_started":5,"wal-append.queue_time_us":420883,"wal-append.run_cpu_time_us":14445,"wal-append.run_wall_time_us":1473842}
I20260709 13:08:11.909426 21224 rpcz_store.cc:276] 0709 13:08:07.797734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.974700 (+1176966us) service_pool.cc:224] Handling call
0709 13:08:09.040778 (+ 66078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.898657 (+2857879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.908510 (+  9853us) spinlock_profiling.cc:243] Waited 2.64 s on lock 0x7b54002382d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:11.908739 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6062814080}
I20260709 13:08:11.726274 25379 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:11.730185 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.711330 25314 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.733598 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2262) took 3250 ms. Trace:
I20260709 13:08:11.752192 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:11.753170 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.915763 21293 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:11.755962 25380 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.548756 25260 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:11.746989 24941 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.717612 25396 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.777984 25378 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.889046 25211 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.754901 25227 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:11.928102 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:11.606390 21191 leader_election.cc:336] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.755s (SENT)
I20260709 13:08:11.927636 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:11.929086 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 322725us
I20260709 13:08:11.591069 25292 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.793414 21814 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:11.840271 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:11.930549 21814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1129) took 1651 ms (client timeout 2090 ms). Trace:
I20260709 13:08:11.840322 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2637) took 4519 ms. Trace:
I20260709 13:08:11.839731 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.769974 25397 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.849252 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 493130us
I20260709 13:08:11.931166 21221 rpcz_store.cc:276] 0709 13:08:07.262325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.272015 (+  9690us) service_pool.cc:224] Handling call
0709 13:08:07.278860 (+  6845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.770679 (+4491819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.781923 (+ 11244us) spinlock_profiling.cc:243] Waited 4.3 s on lock 0x7b54000ec4d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:11.782086 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9886388608}
W20260709 13:08:11.945950 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.948467 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:11.949481 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.775291 25320 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.849701 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.950071 21297 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:11.826787 25267 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.837205 25322 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.954813 25322 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:11.775074 25282 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:11.852085 21223 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:11.956264 25282 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:11.956395 25410 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:08:11.957051 21148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 777) took 3061 ms (client timeout 2051 ms). Trace:
W20260709 13:08:11.957465 21148 rpcz_store.cc:269] 0709 13:08:08.897496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.118002 (+1220506us) service_pool.cc:224] Handling call
0709 13:08:11.956846 (+1838844us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540031b5d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:11.956988 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144796032}
I20260709 13:08:11.959705 25299 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.960280 25299 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.960615 25299 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:11.961400 25299 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.962615 25299 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.852761 24997 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.774827 25306 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:11.859951 21809 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:11.923763 25154 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:08:11.967224 21809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1128) took 1691 ms (client timeout 1991 ms). Trace:
W20260709 13:08:11.967617 21809 rpcz_store.cc:269] 0709 13:08:10.278612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.497652 (+1219040us) service_pool.cc:224] Handling call
0709 13:08:11.967077 (+469425us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54003c3554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:11.967174 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230886272}
I20260709 13:08:11.968604 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.969151 21809 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.969733 25386 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.844067 25377 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:11.971478 25280 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.971860 25280 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:11.873443 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.972586 25211 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:11.876919 21808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1116) took 1612 ms (client timeout 2060 ms). Trace:
W20260709 13:08:11.973129 21808 rpcz_store.cc:269] 0709 13:08:10.264632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.265274 (+   642us) service_pool.cc:224] Handling call
0709 13:08:11.876862 (+1611588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.974041 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:11.634727 21144 rpcz_store.cc:276] 0709 13:08:08.658514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.658707 (+   193us) service_pool.cc:224] Handling call
0709 13:08:08.659120 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.659413 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.659453 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.112853 (+1453400us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:10.113248 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.351408 (+238160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:10.351456 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.351541 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.351610 (+    69us) raft_consensus.cc:1685] finished
0709 13:08:10.351625 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.351923 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490538880,"thread_start_us":237805,"threads_started":1,"wal-append.queue_time_us":131098,"wal-append.run_cpu_time_us":26226,"wal-append.run_wall_time_us":1139494}
I20260709 13:08:11.877629 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:11.882730 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080039bf40 after lost signal to thread 21176
I20260709 13:08:11.975769 21291 raft_consensus.cc:1813] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Handling vote request from an unknown peer f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:11.976227 21291 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:11.871992 25178 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:11.976588 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd880 after lost signal to thread 21250
W20260709 13:08:11.976878 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd780 after lost signal to thread 21251
W20260709 13:08:11.977149 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbfa0 after lost signal to thread 21264
W20260709 13:08:11.977384 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbf40 after lost signal to thread 21265
W20260709 13:08:11.977888 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5b80 after lost signal to thread 21291
I20260709 13:08:11.695122 21806 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
W20260709 13:08:11.978150 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5b60 after lost signal to thread 21293
W20260709 13:08:11.978539 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5720 after lost signal to thread 21295
W20260709 13:08:11.978565 21806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1123) took 1704 ms (client timeout 1822 ms). Trace:
W20260709 13:08:11.978905 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5800 after lost signal to thread 21296
W20260709 13:08:11.979183 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5a00 after lost signal to thread 21299
W20260709 13:08:11.979049 21806 rpcz_store.cc:269] 0709 13:08:10.274131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.488189 (+1214058us) service_pool.cc:224] Handling call
0709 13:08:11.978510 (+490321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40960}
W20260709 13:08:11.979912 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003727c0 after lost signal to thread 21324
W20260709 13:08:11.980172 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003863e0 after lost signal to thread 21325
I20260709 13:08:11.980147 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:11.980708 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800399ce0 after lost signal to thread 21778
I20260709 13:08:11.980895 21806 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:11.981345 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800170380 after lost signal to thread 21812
I20260709 13:08:11.891091 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:11.882546 21049 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 11, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 11 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:11.982030 25320 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.926343 25380 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.983224 21049 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:11.984565 21049 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 7, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:11.985780 21263 leader_election.cc:400] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
W20260709 13:08:11.904089 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 191711us
I20260709 13:08:11.986296 21049 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:08:11.892097 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08002f54e0 after lost signal to thread 21293
W20260709 13:08:11.987423 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5a40 after lost signal to thread 21295
W20260709 13:08:11.988015 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3880 after lost signal to thread 21324
W20260709 13:08:11.988248 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003893c0 after lost signal to thread 21325
W20260709 13:08:11.988584 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003423c0 after lost signal to thread 21778
I20260709 13:08:11.859366 25346 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.905071 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 196505us
W20260709 13:08:11.989487 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080036cac0 after lost signal to thread 21838
I20260709 13:08:11.989349 25346 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.904186 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:11.991106 21807 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:11.991652 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1134) took 1707 ms. Trace:
I20260709 13:08:11.991986 21807 rpcz_store.cc:276] 0709 13:08:10.284064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.990555 (+1706491us) service_pool.cc:224] Handling call
0709 13:08:11.990807 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.991442 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.991602 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.992928 25346 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.844033 25383 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:11.905699 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 761) took 3295 ms. Trace:
I20260709 13:08:11.910936 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.994904 21296 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:11.994741 25280 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:11.995726 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.995651 25314 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:11.996194 25280 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.997506 25314 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:11.997997 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:11.998721 25314 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.008466 25314 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.904973 25174 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.009285 25314 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:11.916268 25312 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:11.953852 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 72885us
I20260709 13:08:11.966388 25272 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.010565 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.011142 21293 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:12.011662 25272 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:11.926713 25379 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.985312 25364 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:11.999704 25416 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:11.989806 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800104ca0 after lost signal to thread 21839
W20260709 13:08:12.017431 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800368e20 after lost signal to thread 24976
W20260709 13:08:12.017709 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080024ad00 after lost signal to thread 24997
I20260709 13:08:11.981871 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:12.018010 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800104de0 after lost signal to thread 25067
W20260709 13:08:12.018314 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800104da0 after lost signal to thread 25154
W20260709 13:08:12.018522 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08001d75e0 after lost signal to thread 25173
I20260709 13:08:12.018546 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:11.981935 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080026f300 after lost signal to thread 21838
I20260709 13:08:11.921566 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:12.019177 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800406780 after lost signal to thread 21839
W20260709 13:08:12.019482 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800396460 after lost signal to thread 24976
I20260709 13:08:11.922302 21298 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:08:12.019707 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800397720 after lost signal to thread 24997
I20260709 13:08:11.914335 21295 rpcz_store.cc:276] 0709 13:08:08.483640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.487706 (+  4066us) service_pool.cc:224] Handling call
0709 13:08:08.578004 (+ 90298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.449344 (+2871340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.449378 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:11.449964 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:08:11.506005 (+ 56041us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:11.706863 (+200858us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.733304 (+ 26441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.733379 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.733416 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:11.733428 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.733544 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50474,"prepare.queue_time_us":13741,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"raft.queue_time_us":209001,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":6044,"thread_start_us":3105684,"threads_started":3,"wal-append.queue_time_us":55362}
I20260709 13:08:11.999516 25267 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.900890 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:12.043857 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 143015us
I20260709 13:08:12.044258 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.044857 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:11.993287 21807 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:12.001250 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:11.850335 25385 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:12.002758 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:11.981876 25397 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:11.978148 25178 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:11.975087 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:11.937732 25378 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:11.898463 25323 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:11.936239 21300 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:08:12.018884 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080036d720 after lost signal to thread 25187
I20260709 13:08:11.904353 25381 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:12.019984 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080018d1c0 after lost signal to thread 25067
W20260709 13:08:12.064472 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800351340 after lost signal to thread 25154
I20260709 13:08:12.020882 21806 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:12.064836 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7420 after lost signal to thread 25173
W20260709 13:08:11.930898 21814 rpcz_store.cc:269] 0709 13:08:10.279387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.506523 (+1227136us) service_pool.cc:224] Handling call
0709 13:08:11.930502 (+423979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.065160 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1136) took 1780 ms. Trace:
I20260709 13:08:12.065529 21806 rpcz_store.cc:276] 0709 13:08:10.284667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.018956 (+1734289us) service_pool.cc:224] Handling call
0709 13:08:12.020716 (+  1760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.064946 (+ 44230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.065111 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.022670 21811 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:12.021942 21049 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 9, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.029778 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:12.032071 21809 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:12.065986 21814 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:12.045856 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1135) took 1761 ms. Trace:
I20260709 13:08:12.052173 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.067605 21810 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:12.068035 21810 pending_rounds.cc:85] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:11.993726 21299 rpcz_store.cc:276] 0709 13:08:08.609783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.814467 (+204684us) service_pool.cc:224] Handling call
0709 13:08:08.814802 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.815041 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:08.887303 (+ 72262us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.505199 (+2617896us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.734228 (+229029us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.772111 (+ 37883us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18003a0d20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:08:11.882445 (+110334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.882492 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.882543 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.882603 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.905621 (+ 23018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174403,"prepare.queue_time_us":226283,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":133,"raft.queue_time_us":148806,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3086,"spinlock_wait_cycles":16204544,"thread_start_us":2932804,"threads_started":4,"wal-append.queue_time_us":530219,"wal-append.run_cpu_time_us":2115,"wal-append.run_wall_time_us":1005186}
I20260709 13:08:12.049966 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.067497 21807 rpcz_store.cc:276] 0709 13:08:10.284402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.992722 (+1708320us) service_pool.cc:224] Handling call
0709 13:08:11.993024 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.045603 (+ 52579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.045793 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.069067 21144 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.056481 25273 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 7. Current term is 8.
I20260709 13:08:12.067234 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1138) took 1782 ms. Trace:
I20260709 13:08:12.070209 25285 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:12.050189 21294 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:12.071516 25289 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.072012 25289 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.073989 25289 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.070748 25285 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.076040 25285 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.069860 21814 rpcz_store.cc:276] 0709 13:08:10.285190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.065432 (+1780242us) service_pool.cc:224] Handling call
0709 13:08:12.065704 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.067011 (+  1307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.067186 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.077145 21296 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.078578 21296 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.068387 21810 pending_rounds.cc:107] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:12.087224 21810 raft_consensus.cc:2889] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.087950 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1137) took 1803 ms. Trace:
I20260709 13:08:12.088250 21810 rpcz_store.cc:276] 0709 13:08:10.284927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.019705 (+1734778us) service_pool.cc:224] Handling call
0709 13:08:12.063699 (+ 43994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.087725 (+ 24026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.087901 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.090000 25273 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.092129 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:12.092730 25273 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.093174 25273 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.093327 25362 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:12.090046 21811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1120) took 1824 ms (client timeout 2362 ms). Trace:
W20260709 13:08:12.094251 21811 rpcz_store.cc:269] 0709 13:08:10.265697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.267147 (+  1450us) service_pool.cc:224] Handling call
0709 13:08:11.881001 (+1613854us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b540012f5a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7de18 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:12.089881 (+208880us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540012edd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:12.089993 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865754240}
I20260709 13:08:12.096035 21811 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:12.096655 25380 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:12.093854 25362 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:12.098261 25362 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.054879 21217 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:12.058372 21189 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.059517 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:12.104095 25174 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:12.060441 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080041d2e0 after lost signal to thread 25198
W20260709 13:08:12.105077 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800332520 after lost signal to thread 25215
I20260709 13:08:12.105111 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.105594 25260 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:12.058997 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 133594us
I20260709 13:08:12.061381 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:12.105986 25260 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:12.106577 21219 raft_consensus.cc:2410] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:12.062857 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.064334 21221 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:12.106767 25260 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.023690 21263 leader_election.cc:403] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:08:12.108156 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 122503us
I20260709 13:08:12.037187 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:12.108721 25324 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.067983 21150 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:12.110114 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080032a6c0 after lost signal to thread 25231
W20260709 13:08:12.110412 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800414ae0 after lost signal to thread 25257
W20260709 13:08:12.110632 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003f10a0 after lost signal to thread 25260
W20260709 13:08:12.110841 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800402b00 after lost signal to thread 25267
W20260709 13:08:12.111066 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003778e0 after lost signal to thread 25270
W20260709 13:08:12.065182 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08002e11c0 after lost signal to thread 25187
W20260709 13:08:12.111287 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800354940 after lost signal to thread 25272
W20260709 13:08:12.111424 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800084c40 after lost signal to thread 25198
W20260709 13:08:12.111590 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1300 after lost signal to thread 25280
W20260709 13:08:12.111726 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800350620 after lost signal to thread 25215
W20260709 13:08:12.111866 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1320 after lost signal to thread 25282
W20260709 13:08:12.112044 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003e52a0 after lost signal to thread 25231
W20260709 13:08:12.112360 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080041e460 after lost signal to thread 25285
W20260709 13:08:12.112452 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5b40 after lost signal to thread 25257
W20260709 13:08:12.112632 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1500 after lost signal to thread 25286
W20260709 13:08:12.112739 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8280 after lost signal to thread 25260
W20260709 13:08:12.112943 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080038c9c0 after lost signal to thread 25289
W20260709 13:08:12.113035 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5320 after lost signal to thread 25267
I20260709 13:08:12.053632 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:12.113335 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800393060 after lost signal to thread 25270
W20260709 13:08:12.068456 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.113783 21149 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:12.114812 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.113590 21297 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:12.116163 21149 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:12.113600 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003fdf00 after lost signal to thread 25272
W20260709 13:08:12.117165 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800324a40 after lost signal to thread 25280
W20260709 13:08:12.117420 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7980 after lost signal to thread 25282
W20260709 13:08:12.117640 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080036eb00 after lost signal to thread 25285
W20260709 13:08:12.117841 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1340 after lost signal to thread 25286
W20260709 13:08:12.118048 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdec0 after lost signal to thread 25289
W20260709 13:08:12.118266 21172 debug-util.cc:398] Leaking SignalData structure 0x7b0800305680 after lost signal to thread 25292
W20260709 13:08:12.113241 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003e88e0 after lost signal to thread 25292
W20260709 13:08:12.108107 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 49817.9us
I20260709 13:08:12.119308 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.121201 25231 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.121943 25380 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.123320 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:12.126767 21247 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5f40 after lost signal to thread 25308
I20260709 13:08:12.127707 21293 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:12.121939 25231 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:12.128013 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080039d0c0 after lost signal to thread 25317
W20260709 13:08:12.124053 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.129446 21247 debug-util.cc:398] Leaking SignalData structure 0x7b080017aea0 after lost signal to thread 25320
W20260709 13:08:12.130321 21247 debug-util.cc:398] Leaking SignalData structure 0x7b0800178140 after lost signal to thread 25323
I20260709 13:08:12.124559 21150 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:12.125137 24884 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:12.125277 21189 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:12.125964 21144 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:12.125794 25174 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:12.125821 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.118216 25260 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.141204 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.067026 25272 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.141901 24941 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.142104 25272 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.142589 25272 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:12.118613 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003ebe40 after lost signal to thread 25308
W20260709 13:08:12.143517 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080034cc80 after lost signal to thread 25317
W20260709 13:08:12.143880 21172 debug-util.cc:398] Leaking SignalData structure 0x7b080023f540 after lost signal to thread 25320
W20260709 13:08:12.144181 21172 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe700 after lost signal to thread 25323
I20260709 13:08:12.144527 25379 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:12.146250 25397 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.043148 25267 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.146931 25267 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.143568 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.148413 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.122879 25324 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:12.148106 21263 connection.cc:256] RPC call timeout handler was delayed by -3.7213223690000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.44240000000000007s for a response
W20260709 13:08:12.151469 21263 connection.cc:256] RPC call timeout handler was delayed by -3.4939570819999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 13:08:12.148474 21049 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.149729 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:12.141417 21809 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.148707 21145 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:12.152109 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:12.164162 21263 connection.cc:256] RPC call timeout handler was delayed by -3.4714570819999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:08:12.164718 21263 connection.cc:256] RPC call timeout handler was delayed by -3.4327570819999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 13:08:12.149096 21148 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.056185 25403 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.178s
I20260709 13:08:12.062945 25211 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 13:08:12.212934 21297 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:12.172663 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:12.336800 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.165059 21295 raft_consensus.cc:2410] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:12.272492 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1642) took 3391 ms (client timeout 2018 ms). Trace:
W20260709 13:08:12.314951 25412 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:08:12.215510 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 99524.9us
I20260709 13:08:12.067184 24976 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:12.262466 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 190946us
I20260709 13:08:12.213368 21806 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:12.246730 21143 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
I20260709 13:08:12.063971 25346 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.049548 25417 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:12.316092 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.167062 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:12.372977 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.262818 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:12.298388 21296 raft_consensus.cc:2410] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:08:12.444765 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.215412 21812 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:12.251977 25174 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:12.165127 21263 connection.cc:256] RPC call timeout handler was delayed by -3.4147570819999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:08:12.230998 21298 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:08:12.448987 21263 connection.cc:256] RPC call timeout handler was delayed by -3.3805570819999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:08:12.449879 21263 connection.cc:256] RPC call timeout handler was delayed by -3.1179369999999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:08:12.451547 21263 connection.cc:256] RPC call timeout handler was delayed by -2.9764570819999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26030000000000003s for a response
W20260709 13:08:12.454139 21263 connection.cc:256] RPC call timeout handler was delayed by -2.9098570819999168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2677s for a response
W20260709 13:08:12.454594 21263 connection.cc:256] RPC call timeout handler was delayed by -2.7114096410000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:08:12.454994 21263 connection.cc:256] RPC call timeout handler was delayed by -2.6380570819999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2979s for a response
W20260709 13:08:12.455552 21263 connection.cc:256] RPC call timeout handler was delayed by -2.56110964100003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:08:12.455955 21263 connection.cc:256] RPC call timeout handler was delayed by -2.4657096409999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:08:12.440901 21146 rpcz_store.cc:269] 0709 13:08:08.880578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.983861 (+1103283us) service_pool.cc:224] Handling call
0709 13:08:12.271671 (+2287810us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54000852d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:12.272412 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930137984}
W20260709 13:08:12.279297 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 441457us
I20260709 13:08:12.261212 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:12.296859 25257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.033s
I20260709 13:08:12.459314 25273 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.067425 25323 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:12.150063 25306 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:12.498311 21295 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.497872 25306 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.498821 21226 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.501935 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.261792 25227 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.440884 25362 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:12.270864 25324 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.467496 25381 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:12.231650 25420 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.318s
I20260709 13:08:12.210155 21049 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 2 to 6, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 6 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:12.442152 24976 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:12.390769 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 461052us
I20260709 13:08:12.449435 25198 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:12.476590 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 351342us
W20260709 13:08:12.397114 25382 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.619s	user 0.001s	sys 0.008s
I20260709 13:08:12.326858 25380 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:12.333096 25312 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.063709 25282 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:12.490065 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.604092 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.490859 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:12.491513 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:12.605286 21223 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:12.492630 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:12.496896 25257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.038s
I20260709 13:08:12.497174 21293 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:12.513348 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1125) took 2238 ms. Trace:
I20260709 13:08:12.607847 21812 rpcz_store.cc:276] 0709 13:08:10.274609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.704989 (+1430380us) service_pool.cc:224] Handling call
0709 13:08:11.718859 (+ 13870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.446612 (+727753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.513087 (+ 66475us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:12.513278 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141035776}
W20260709 13:08:12.570402 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 307673us
I20260709 13:08:12.551340 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.609427 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:12.609354 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.571354 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.571962 21049 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 8, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 8 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:12.518050 25280 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
W20260709 13:08:12.573369 21263 connection.cc:256] RPC call timeout handler was delayed by -2.4324096410000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:08:12.619669 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.605289 21219 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:12.540243 25299 consensus_meta.cc:287] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.002s
I20260709 13:08:12.503672 25289 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:12.516369 25418 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.568s	user 0.003s	sys 0.000s
I20260709 13:08:12.613687 21220 raft_consensus.cc:2410] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:12.612999 21049 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 9, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 9 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.592669 25378 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:12.635440 21776 connection.cc:256] RPC call timeout handler was delayed by -2.1460482459999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:08:12.635829 21776 connection.cc:256] RPC call timeout handler was delayed by -2.1361482459999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:08:12.609354 21295 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:12.614343 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:12.614873 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 43783.1us
I20260709 13:08:12.637665 21299 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:12.636116 21776 connection.cc:256] RPC call timeout handler was delayed by -2.1298482459999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:08:12.638365 21776 connection.cc:256] RPC call timeout handler was delayed by -2.0650482459999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 13:08:12.638635 21776 connection.cc:256] RPC call timeout handler was delayed by -1.9696482460000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:08:12.616293 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:12.638895 21776 connection.cc:256] RPC call timeout handler was delayed by -1.9696482460000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:08:12.639191 21776 connection.cc:256] RPC call timeout handler was delayed by -1.8814482459999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:08:12.639531 21776 connection.cc:256] RPC call timeout handler was delayed by -1.8427482459999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:08:12.639791 21116 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:12.617408 21151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.022s
W20260709 13:08:12.640638 21151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.003s	sys 0.022s
I20260709 13:08:12.618760 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.641650 21143 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.618979 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.562543 21148 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
W20260709 13:08:12.619679 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3910096409999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:08:12.615695 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:12.621212 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:12.643863 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3631096410000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:08:12.644186 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3631096410000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:08:12.644517 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3487096410000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:08:12.644774 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3343096410000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:08:12.645051 21263 connection.cc:256] RPC call timeout handler was delayed by -2.3154096410000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 13:08:12.645298 21263 connection.cc:256] RPC call timeout handler was delayed by -2.2362096410000731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:08:12.502707 25306 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:12.516422 25415 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.577s	user 0.002s	sys 0.000s
I20260709 13:08:12.519979 25377 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.628077 21150 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:12.626763 24997 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:12.251396 25314 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.662901 21149 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.554940 25320 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:12.568498 25198 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:12.633241 21222 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.633460 21049 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:12.666536 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.502746 21291 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:12.646190 21145 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.671682 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.672297 21299 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:12.640688 25312 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.645699 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:12.647854 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.648087 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:12.651451 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 355019us
W20260709 13:08:12.628886 25364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.022s
I20260709 13:08:12.605687 25292 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:12.659232 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:12.659688 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1130) took 2380 ms. Trace:
I20260709 13:08:12.707508 21297 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:08:12.673859 25280 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.555930 25272 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.661667 21150 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:08:12.723332 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 110538us
I20260709 13:08:12.723970 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.630060 25289 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.662894 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.729554 21293 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:12.668259 21049 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:12.689405 25312 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.739042 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.730720 21049 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 3 to 6, term changed from 6 to 7, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to <none>, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:12.742686 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.591964 25324 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:12.639796 21776 connection.cc:256] RPC call timeout handler was delayed by -1.8103482459999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:08:12.745524 21776 connection.cc:256] RPC call timeout handler was delayed by -1.7113482459999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:08:12.745276 21145 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
W20260709 13:08:12.745996 21776 connection.cc:256] RPC call timeout handler was delayed by -1.6996482459999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:08:12.746505 21776 connection.cc:256] RPC call timeout handler was delayed by -1.6924482460000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 13:08:12.746878 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.747455 21145 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:12.747890 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.748224 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.682861 21143 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:12.687245 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.749207 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.656121 25299 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.691063 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.690150 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:12.660737 25377 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:12.708045 21297 pending_rounds.cc:85] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:12.511862 25267 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:12.708611 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62978.8us
I20260709 13:08:12.707806 21813 rpcz_store.cc:276] 0709 13:08:10.279697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.706593 (+1426896us) service_pool.cc:224] Handling call
0709 13:08:11.706900 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.709030 (+  2130us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:11.888944 (+179914us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.385156 (+496212us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.385360 (+   204us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.386039 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.386188 (+   149us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.436222 (+ 50034us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.454869 (+ 18647us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.659303 (+204434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.659400 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.659457 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:12.659469 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.659614 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27496,"prepare.queue_time_us":289518,"prepare.run_cpu_time_us":661,"prepare.run_wall_time_us":1753,"raft.queue_time_us":199469,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":15462,"spinlock_wait_cycles":11284608,"thread_start_us":815566,"threads_started":4,"wal-append.queue_time_us":440955}
I20260709 13:08:12.726244 21299 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:12.725263 25280 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.745635 25423 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.153s	user 0.006s	sys 0.000s
W20260709 13:08:12.730721 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.740306 25289 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.745952 25312 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.690927 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:12.738457 25174 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.745342 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1124) took 2471 ms. Trace:
W20260709 13:08:12.725397 25317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.001s	sys 0.026s
W20260709 13:08:12.772877 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 124846us
I20260709 13:08:12.707484 25392 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:12.774459 21291 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:12.704473 24997 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:12.818717 21812 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:12.703979 25364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.008s	sys 0.022s
I20260709 13:08:12.781526 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:12.783619 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.787847 21150 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:12.790477 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:12.848382 21148 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:12.678215 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:12.782107 21049 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 7, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:12.792510 25450 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:12.793327 25272 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:12.796121 25440 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:12.798434 25377 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.799804 25442 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.856282 21049 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 6, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 6 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.775624 25306 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.803529 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.804211 25324 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:12.664662 25257 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:12.751992 25211 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.818248 21813 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:12.729123 25198 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.811951 21805 rpcz_store.cc:276] 0709 13:08:10.274374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.705043 (+1430669us) service_pool.cc:224] Handling call
0709 13:08:11.720206 (+ 15163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.731435 (+ 11229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.731466 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.731927 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.841374 (+109447us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.841409 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.841466 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.515209 (+673743us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:12.730803 (+215594us) raft_consensus.cc:1685] finished
0709 13:08:12.730837 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.745276 (+ 14439us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3636,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":223611136,"thread_start_us":109128,"threads_started":1,"wal-append.queue_time_us":158318}
I20260709 13:08:12.778388 25299 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.845970 21221 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:08:12.846596 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 156508us
I20260709 13:08:12.847642 21147 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.849018 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:12.806901 25280 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.883111 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:12.808168 25320 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:12.815200 25317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.002s	sys 0.026s
I20260709 13:08:12.858515 21049 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 7, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 7 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:12.860963 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.906204 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.906921 21150 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:12.907821 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:12.865451 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62015.4us
I20260709 13:08:12.909825 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:12.867532 21806 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.815815 25174 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.777719 21297 pending_rounds.cc:107] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:08:12.910918 21297 raft_consensus.cc:2889] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.819495 25392 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.871722 21291 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:12.911957 21291 pending_rounds.cc:85] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:12.912230 21291 pending_rounds.cc:107] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:12.912461 21291 raft_consensus.cc:2889] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.873490 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.876740 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:12.913678 21148 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:12.878969 21146 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.882337 25381 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.885355 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:12.868384 25362 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:12.875097 25272 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:12.886816 24976 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.864481 25273 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.877025 25323 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:12.918828 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:12.926887 21297 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:12.919305 21150 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:12.928491 21150 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.921834 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2627) took 1083 ms. Trace:
I20260709 13:08:12.929425 21300 rpcz_store.cc:276] 0709 13:08:11.838504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.172899 (+334395us) service_pool.cc:224] Handling call
0709 13:08:12.251674 (+ 78775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.267570 (+ 15896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.267604 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.280016 (+ 12412us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b180039be60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a
0709 13:08:12.287885 (+  7869us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.484180 (+196295us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:12.484251 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.484358 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.915721 (+431363us) raft_consensus.cc:1685] finished
0709 13:08:12.915739 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.921776 (+  6037us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6340,"spinlock_wait_cycles":12014720,"thread_start_us":195843,"threads_started":1,"wal-append.queue_time_us":359206}
I20260709 13:08:12.916502 25392 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.899466 25299 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.911739 25174 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.942878 25299 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:12.944166 25432 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:08:12.945329 25299 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:12.946135 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1195) took 1172 ms. Trace:
I20260709 13:08:12.946563 21810 rpcz_store.cc:276] 0709 13:08:11.773873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.088956 (+315083us) service_pool.cc:224] Handling call
0709 13:08:12.089305 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.089746 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:12.090885 (+  1139us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.611301 (+520416us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.620595 (+  9294us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.620738 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.620772 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.620833 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.945921 (+325088us) raft_consensus.cc:1685] finished
0709 13:08:12.945937 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.946068 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35787,"prepare.queue_time_us":145,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":54468,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7792,"thread_start_us":478120,"threads_started":1,"wal-append.queue_time_us":592873}
I20260709 13:08:12.912545 25455 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:12.901598 25282 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:12.952440 21298 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:12.870122 25306 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.889744 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:12.956251 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1191) took 1183 ms. Trace:
I20260709 13:08:12.962679 21143 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:08:12.964249 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 108599us
I20260709 13:08:12.965098 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:12.962388 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72699.5us
I20260709 13:08:12.967880 21263 leader_election.cc:400] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:12.968154 21263 leader_election.cc:403] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.917614 25198 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:12.917230 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 70076.1us
W20260709 13:08:12.977342 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.963038 21807 rpcz_store.cc:276] 0709 13:08:11.772806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.069179 (+296373us) service_pool.cc:224] Handling call
0709 13:08:12.069469 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.499806 (+430337us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:12.500110 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.724592 (+224482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.724657 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.724723 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.955968 (+231245us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400796654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:12.956028 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.956183 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19150,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":34,"raft.queue_time_us":94217,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":989213568,"thread_start_us":204932,"threads_started":1,"wal-append.queue_time_us":353812}
I20260709 13:08:12.902701 25385 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:08:12.953398 25231 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.042658 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:12.985693 25459 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.923062 25456 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 13:08:13.049887 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67122.4us
I20260709 13:08:12.925252 24997 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.047111 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:12.986433 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:12.980770 25320 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.925484 25362 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:12.991832 25323 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.990196 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2666) took 1073 ms. Trace:
W20260709 13:08:13.003535 25435 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:08:12.998606 25433 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:13.017478 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.059516 21263 leader_election.cc:400] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:13.041929 25385 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.993779 25272 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:13.051095 25403 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:13.064208 21222 rpcz_store.cc:276] 0709 13:08:11.916835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.917800 (+   965us) service_pool.cc:224] Handling call
0709 13:08:11.918062 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.677608 (+759546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.989933 (+312325us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001275d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:12.990129 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644386688}
I20260709 13:08:13.042479 25380 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:12.997002 25211 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:13.062439 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 281465us
I20260709 13:08:13.078655 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.048023 24884 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:13.078752 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 92398.2us
I20260709 13:08:13.083011 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:13.083166 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.063172 25460 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.063570 25378 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.087644 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.088774 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.090656 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.091758 21226 pending_rounds.cc:85] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 4
I20260709 13:08:13.092046 21226 pending_rounds.cc:107] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:13.092285 21226 raft_consensus.cc:2889] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.994585 25299 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:08:13.094089 21776 leader_election.cc:400] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:08:13.094559 21776 leader_election.cc:403] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.060696 25320 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:13.086690 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.065644 25267 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.061609 25231 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:13.097417 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.076658 25385 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:13.101725 25381 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.084108 25366 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.104738 25289 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.107501 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:13.098301 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:13.085551 24884 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.085794 25460 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.052608 25459 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.100569 25397 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.107839 25320 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.109014 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:13.107376 25382 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.124794 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.070231 25323 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.119861 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.127457 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.136662 21218 raft_consensus.cc:2410] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:13.080394 25456 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:08:13.126904 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 58872.2us
I20260709 13:08:13.137029 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:13.124083 21225 raft_consensus.cc:2410] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:13.095225 25453 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:13.124431 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45832.2us
I20260709 13:08:13.131197 21291 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.138073 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:13.141800 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.144400 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 781) took 1138 ms. Trace:
I20260709 13:08:13.086320 25272 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:13.144896 21294 rpcz_store.cc:276] 0709 13:08:12.005810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.170700 (+164890us) service_pool.cc:224] Handling call
0709 13:08:12.171124 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.171624 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.171664 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.236527 (+ 64863us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.485222 (+248695us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.485282 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.485370 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.144113 (+658743us) raft_consensus.cc:1685] finished
0709 13:08:13.144142 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.144317 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20506,"thread_start_us":215802,"threads_started":1,"wal-append.queue_time_us":422015}
I20260709 13:08:13.125552 25441 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 6. Current term is 7.
I20260709 13:08:13.131145 25378 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.130883 25397 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:13.130759 25403 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:13.136019 25231 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.160894 21221 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:13.137604 25381 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.130434 25444 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:13.138357 25382 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:13.166143 25457 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:08:13.127708 25392 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.198447 21263 leader_election.cc:400] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:13.225328 21263 leader_election.cc:403] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:08:13.200255 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.157778 25273 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:13.220908 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 311162us
W20260709 13:08:13.221885 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 70307.6us
I20260709 13:08:13.162920 25397 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.171017 25306 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.159833 25468 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:13.229257 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 91274.1us
I20260709 13:08:13.179944 25231 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.155593 25453 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:13.231493 25467 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 13:08:13.234122 21812 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:13.231348 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:13.235036 21145 raft_consensus.cc:2368] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:13.239434 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:13.240922 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:13.170470 25280 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.248199 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.249142 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.249935 21810 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.250347 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.250902 21806 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.254905 21807 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:13.246793 25468 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:13.232491 25474 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.260497 25468 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.263134 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:13.266875 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 782) took 1172 ms. Trace:
I20260709 13:08:13.267333 21806 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:13.170903 25385 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.276043 25385 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.279901 25323 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:13.283864 25470 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:13.284538 25280 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.249531 25362 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.285494 25403 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.253756 25476 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10.
I20260709 13:08:13.287117 25476 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:13.287647 25476 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:13.288108 25476 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.170797 24884 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.267298 21296 rpcz_store.cc:276] 0709 13:08:12.094412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.104796 (+ 10384us) service_pool.cc:224] Handling call
0709 13:08:13.266685 (+1161889us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540029ed54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:13.266820 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441585408}
I20260709 13:08:13.292069 24884 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:13.302477 25392 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.303419 25289 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.305825 25459 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.249871 25378 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.306499 25378 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:13.306895 25378 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.272398 25273 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.307765 25273 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.308104 25273 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.311463 25453 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.320015 21291 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:13.318893 21810 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:13.256667 25482 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.332670 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 69619.4us
I20260709 13:08:13.335868 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:13.342196 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.343655 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.344465 21808 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:13.345573 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.345878 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.346853 21813 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.350767 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.352954 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.353521 21813 raft_consensus.cc:2368] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:13.354087 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.356186 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.357187 21809 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.300544 25312 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.360196 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.360744 21805 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.361661 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.362251 21814 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.362812 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.363478 21807 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.366921 21811 raft_consensus.cc:1240] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:13.367667 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.368256 21813 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 7.
I20260709 13:08:13.371732 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.376672 21812 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:13.314383 25481 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:13.335387 25382 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.389338 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.355177 25381 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:13.390411 21810 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:13.390514 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.397742 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.351917 25444 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.397629 21814 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:13.395799 21809 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:13.402217 25469 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:08:13.404352 25324 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.352308 25482 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.379014 25476 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.412603 25383 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.401146 25381 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:13.392930 25481 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.408125 25444 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:13.416103 25383 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:13.417891 25381 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.426025 25481 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:13.425851 25383 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.421010 25378 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.422566 25444 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.435714 25460 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.436702 25460 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.440765 25482 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.426036 25476 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:13.474128 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.484880 21220 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:13.490370 21115 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.822s (SENT)
I20260709 13:08:13.491434 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.510797 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:13.506920 21807 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:13.513381 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.514295 21807 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.517127 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:13.518812 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:13.419540 25312 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.421434 25320 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.522461 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.522482 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.535889 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:13.541957 24884 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.550746 25320 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.551667 21814 raft_consensus.cc:2376] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8. Re-sending same reply.
I20260709 13:08:13.551916 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.551812 25280 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:13.554798 25385 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.555186 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.407295 25174 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.559680 21813 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:13.423187 25322 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.006s	sys 0.002s
W20260709 13:08:13.565260 25322 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.007s	sys 0.002s
I20260709 13:08:13.565371 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.566215 21813 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10. Re-sending same reply.
I20260709 13:08:13.566442 21810 raft_consensus.cc:2376] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:08:13.567579 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.569092 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.569764 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.569844 21810 raft_consensus.cc:2376] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8. Re-sending same reply.
I20260709 13:08:13.567200 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.568181 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 781) took 1542 ms. Trace:
I20260709 13:08:13.580283 21294 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.583549 25385 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.588779 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.589851 21813 raft_consensus.cc:2376] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7. Re-sending same reply.
I20260709 13:08:13.591115 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.592098 21813 raft_consensus.cc:2376] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9. Re-sending same reply.
I20260709 13:08:13.593282 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.594533 24884 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.596380 25273 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.598033 21811 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.607610 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.608860 21810 raft_consensus.cc:2368] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12.
I20260709 13:08:13.610276 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.611965 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:13.618021 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.618273 25362 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.621232 25174 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.577584 21147 rpcz_store.cc:276] 0709 13:08:12.025814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.025962 (+   148us) service_pool.cc:224] Handling call
0709 13:08:12.026214 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.888684 (+862470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.567571 (+678887us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540040ef54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:13.567941 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888604928}
I20260709 13:08:13.553565 25323 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:08:13.626299 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:13.627200 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 108684us
I20260709 13:08:13.628207 25456 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:13.629432 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.600191 25462 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.645714 21225 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:13.646070 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.646924 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.647490 21223 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:13.652995 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.660491 21805 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:13.660832 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:13.662334 25418 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:13.662235 25462 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.663642 25322 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.664361 25462 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:13.666039 21217 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:13.667336 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.667982 21814 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:08:13.667835 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.668212 24884 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.671892 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.672308 25464 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:13.619159 25362 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:13.667989 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.680891 25362 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.682471 21299 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:13.683629 21812 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:08:13.693523 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 452561us
I20260709 13:08:13.694437 25174 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.695500 25174 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.699295 25378 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:13.699761 25174 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.700611 25174 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.701071 25385 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.701675 25174 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.703608 25273 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:13.713264 21294 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:13.666046 25322 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:08:13.687501 21115 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.506s (SENT) [suppressed 25 similar messages]
I20260709 13:08:13.694789 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:13.658301 25456 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.719951 25456 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.723815 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:13.724114 21778 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:13.724768 21297 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.725404 25312 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:13.726027 25312 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:13.727610 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:13.727197 25312 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.728637 21299 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:13.733428 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.751814 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.753597 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:13.755589 21299 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:13.735926 25231 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.750739 25270 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.766434 25231 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.766600 25392 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:13.767410 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 72794.9us
I20260709 13:08:13.768798 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.760267 25270 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.770805 25270 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.772235 25270 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:13.773015 25397 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:08:13.775609 25397 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.777081 21813 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:13.767737 25392 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:13.781055 25320 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.781172 25397 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:13.778523 25392 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.783751 25320 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:13.785423 25476 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.785971 25476 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:13.787173 25476 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.789269 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.794369 25476 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.797242 25174 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:13.798988 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:13.799477 25178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.005s	sys 0.005s
I20260709 13:08:13.799697 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1656) took 1112 ms. Trace:
W20260709 13:08:13.811553 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 148281us
W20260709 13:08:13.809551 25178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.005s	sys 0.005s
I20260709 13:08:13.809602 21145 rpcz_store.cc:276] 0709 13:08:12.687023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.748981 (+ 61958us) service_pool.cc:224] Handling call
0709 13:08:13.799109 (+1050128us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b540031b5d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:13.799396 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115575040}
I20260709 13:08:13.817520 21297 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:13.819438 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:13.821036 25292 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:13.821734 25292 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:13.823268 25292 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.831353 21812 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:13.834450 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:13.801651 25385 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:08:13.839179 21807 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
W20260709 13:08:13.842414 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.834507 25378 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:13.843926 25378 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:13.844681 25378 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.811039 25320 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:13.851882 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 62883.2us
W20260709 13:08:13.841432 21115 leader_election.cc:336] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.622s (SENT)
I20260709 13:08:13.844077 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.855361 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:13.861946 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2101) took 1195 ms. Trace:
I20260709 13:08:13.862423 21146 rpcz_store.cc:276] 0709 13:08:12.666463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.788854 (+122391us) service_pool.cc:224] Handling call
0709 13:08:12.789172 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.915246 (+126074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.861441 (+946195us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b540017b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:13.861770 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206092032}
W20260709 13:08:13.865614 21033 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f81bf1abd0b34f518d1f2b79cc4dba77 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:13.880117 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:13.881016 21812 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:13.896035 21806 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:08:13.896044 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 787) took 1163 ms. Trace:
I20260709 13:08:13.900017 21293 rpcz_store.cc:276] 0709 13:08:12.732230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.803494 (+ 71264us) service_pool.cc:224] Handling call
0709 13:08:12.817699 (+ 14205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.864875 (+ 47176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:12.879824 (+ 14949us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.003790 (+123966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.003860 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:13.003971 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.004061 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.364027 (+359966us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b1800369e80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4
0709 13:08:13.894763 (+530736us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b540001b150. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:13.895806 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4091,"prepare.queue_time_us":17697,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":30258,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":14716,"spinlock_wait_cycles":118923904,"thread_start_us":85457,"threads_started":1,"wal-append.queue_time_us":163848}
I20260709 13:08:13.841195 25322 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:08:13.904481 25322 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.904965 25322 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:13.906364 25324 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.011s
I20260709 13:08:13.906546 25322 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:13.909722 25322 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.912914 21221 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:13.887161 25392 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:13.916752 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.917594 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:13.921193 24941 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.925347 25383 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.929034 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 792) took 1037 ms. Trace:
W20260709 13:08:13.929805 25514 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:13.945220 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 115222us
I20260709 13:08:13.947980 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:13.949141 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:13.950625 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:13.953375 25231 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:13.954643 25377 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.955189 25231 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.955689 25231 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.956054 25231 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.959288 21219 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:13.959717 25314 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.962046 25455 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.962409 21299 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:13.962806 25455 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.942623 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:13.963165 25455 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:13.964432 25455 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.976791 25282 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.977342 25282 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:13.981869 21300 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:13.987784 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.988765 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:13.989511 21219 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:13.978518 25282 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:13.996479 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:13.997452 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 55000.7us
I20260709 13:08:13.929555 21298 rpcz_store.cc:276] 0709 13:08:12.891982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.966380 (+ 74398us) service_pool.cc:224] Handling call
0709 13:08:12.966612 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.495034 (+528422us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:13.495848 (+   814us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.496335 (+   487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.496389 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.496434 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.865669 (+369235us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003a0a80. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:13.928596 (+ 62927us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54003afa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:13.928642 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.928823 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14836,"prepare.queue_time_us":31436,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":30704,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":17213,"spinlock_wait_cycles":1237936128}
I20260709 13:08:14.001921 25282 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.003698 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:14.004379 21226 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:13.986924 25424 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:14.016487 21191 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:14.018612 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:14.024058 21220 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:14.024534 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:14.022118 25270 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.027833 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:14.030220 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.992635 25324 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:14.013053 25320 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.048144 21219 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:14.050026 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 132626us
W20260709 13:08:14.053486 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.053601 21226 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:14.031996 25270 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.028749 25462 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.027324 25362 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:14.059341 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 58063.8us
I20260709 13:08:14.061807 25362 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:14.063628 25362 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.064100 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:14.064910 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59308.8us
I20260709 13:08:14.066098 21264 leader_election.cc:400] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:14.066366 21264 leader_election.cc:403] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.067095 21264 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:14.069542 21115 leader_election.cc:336] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.794s (SENT)
I20260709 13:08:14.058485 25270 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.073407 21115 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.076392 21264 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.079495 25189 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:14.079943 25455 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.080776 25320 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.081458 25231 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.082050 25455 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:14.082473 25462 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.086948 25403 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:14.087699 25403 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.088495 25462 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.089462 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.089951 25403 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.090509 25403 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.083734 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:14.084196 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 85518.4us
I20260709 13:08:14.084270 25320 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.102268 25189 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.102715 25189 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:14.094684 25378 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:14.104996 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.103749 25189 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.109717 25420 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:14.110306 21146 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:14.113744 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.126365 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:14.115454 25322 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:14.115805 25499 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.520s	user 0.003s	sys 0.003s
I20260709 13:08:14.107757 25320 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.116492 25455 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:14.119041 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.121524 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:14.115286 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53051.3us
I20260709 13:08:14.136523 21293 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:14.128407 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.127023 21221 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:14.130137 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.130576 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:14.130930 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 113476us
W20260709 13:08:14.134692 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.144382 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.145119 24941 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.146168 25189 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.147677 25231 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:14.148329 25474 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.148799 25474 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:14.149202 25474 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.152458 21226 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:14.153328 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.153762 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.076409 25526 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:14.162447 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:14.156100 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.166669 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.169667 21146 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:14.174310 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.174916 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45218.3us
I20260709 13:08:14.175748 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:14.178205 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.179214 21806 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.166612 25383 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:14.182543 21811 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.167788 24941 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:14.184351 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:14.185066 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.183516 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:14.187445 21221 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.186889 21813 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:14.191776 21807 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:14.192983 21145 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.184605 25383 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:14.198407 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.199990 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.202028 21809 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:14.185392 25320 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.206667 21806 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:14.204227 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.192358 25378 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:14.209280 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.213068 21295 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.216814 25444 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.217026 25396 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.218675 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:14.217252 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.221742 21806 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:14.224121 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2648) took 1060 ms. Trace:
I20260709 13:08:14.225207 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.224558 21291 rpcz_store.cc:276] 0709 13:08:13.163516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.330185 (+166669us) service_pool.cc:224] Handling call
0709 13:08:13.330500 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.340457 (+  9957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.340553 (+    96us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.354687 (+ 14134us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.423143 (+ 68456us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b480027ccd8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b72ca3aa1 00007f2b72c9ab37 00007f2b72c9a9ca 00007f2b72d9226f 00007f2b72d91f37 00007f2b72da655c 00007f2b72da6508 00007f2b72da6488 00007f2b72da6443 00007f2b72da56ec 00007f2b71ccfa96
0709 13:08:13.625042 (+201899us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:13.625144 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.625233 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.107142 (+481909us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:14.221469 (+114327us) raft_consensus.cc:1685] finished
0709 13:08:14.221505 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.223954 (+  2449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9530,"raft.queue_time_us":9747,"raft.run_cpu_time_us":2433,"raft.run_wall_time_us":75850,"spinlock_wait_cycles":51773696,"thread_start_us":246291,"threads_started":1,"wal-append.queue_time_us":239826}
I20260709 13:08:14.226707 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.231511 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.232229 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.217650 24941 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.232901 25320 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.233716 25448 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.212815 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.284531 25362 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.287659 25378 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.217885 25526 consensus_queue.cc:1059] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:14.234253 21148 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:14.300729 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 91527us
I20260709 13:08:14.303303 21147 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.305810 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:14.217410 25444 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.231439 25462 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:14.309667 21146 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:14.312034 21115 leader_election.cc:336] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.991s (SENT)
I20260709 13:08:14.302050 25448 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:14.313848 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.309062 21142 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:14.304360 25378 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.315814 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.319345 25525 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.319983 25525 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.322194 25525 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:14.323690 25282 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.314733 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.315591 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.332530 21291 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:14.327687 25525 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.341719 25362 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.345001 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.347524 25308 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.348232 25308 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.348809 25308 consensus_queue.cc:1243] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:14.313385 25420 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:14.352530 25420 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:14.353019 25420 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:14.355113 25322 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.355195 25466 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.355877 25322 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.356396 25322 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.356426 25392 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.357077 25392 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:14.357962 25392 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.359110 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.360015 21148 raft_consensus.cc:2410] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:14.362088 25392 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.318321 25448 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.347023 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.266583 25396 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.375006 21145 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:14.380719 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 54104.8us
I20260709 13:08:14.325248 25378 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.384531 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.322856 25270 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.394007 21151 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:14.396955 21148 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:14.398221 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:14.399015 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 147419us
W20260709 13:08:14.400732 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85237.6us
I20260709 13:08:14.402122 21218 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:14.407007 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.354194 25420 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.411129 21812 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:14.415618 21292 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:08:14.415978 21292 pending_rounds.cc:85] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:14.422305 21813 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:14.405459 25308 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.412338 25462 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.431200 21148 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:14.423905 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:14.375826 25383 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.421782 21292 pending_rounds.cc:107] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:14.432437 21292 raft_consensus.cc:2889] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.414984 25362 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.397918 25455 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:14.440081 21146 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:14.442252 21151 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.443558 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:14.444918 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 141338us
I20260709 13:08:14.450219 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.436350 25362 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.441602 25420 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.462137 25466 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:14.467020 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.467545 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.469584 25322 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.471321 25231 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:14.445541 25385 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:14.473641 25270 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.444517 24941 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.446511 25526 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:14.481536 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.487006 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.483127 21148 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:14.463019 25362 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.491619 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 144729us
W20260709 13:08:14.484946 21115 leader_election.cc:336] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.028s (SENT)
I20260709 13:08:14.496098 21145 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:14.497915 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.483507 25231 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.500068 21299 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:14.506107 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.460908 25462 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:14.475031 25455 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:14.491767 25526 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:14.510952 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.511231 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.514057 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.512506 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:14.517081 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:14.517822 21221 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.516953 21148 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:14.507121 25231 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.522656 21293 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.523110 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.520610 21222 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:14.508697 25320 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.521948 21151 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.515165 25526 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.512333 25322 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:14.530551 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 82678.5us
I20260709 13:08:14.531193 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:14.533581 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 106350us
I20260709 13:08:14.521770 25396 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:14.532739 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.537729 25312 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.538777 25498 raft_consensus.cc:3055] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:14.539201 25498 raft_consensus.cc:740] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:14.540052 25498 consensus_queue.cc:260] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.541262 25498 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.543545 25385 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.554692 21221 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:14.516692 25474 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.558971 21299 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:14.560089 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.560820 21295 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:14.559438 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.562440 25377 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.563079 25377 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:14.557214 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.571544 25324 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:14.573194 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.576097 21151 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:14.577540 21292 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:14.578739 25534 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.579298 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.579322 25534 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.580021 21300 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.581670 25534 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.576104 25231 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.586169 25231 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.588186 21299 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:14.588644 21299 pending_rounds.cc:85] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:14.588889 21299 pending_rounds.cc:107] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:14.589102 21299 raft_consensus.cc:2889] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.590143 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.592154 21296 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:14.593185 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.593748 21296 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:14.594897 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.595999 21299 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.598184 21294 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:14.600186 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.634694 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.652263 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:14.655308 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.661448 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 57517.2us
W20260709 13:08:14.662331 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.663973 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.665488 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.664855 21292 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:14.669840 21296 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:14.672849 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 156330us
I20260709 13:08:14.674007 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.675805 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.675941 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.677966 25312 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:14.588269 25526 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.565390 25377 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:14.681484 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.681797 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:14.684496 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.689971 25468 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:14.690733 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:14.692142 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:14.692941 25525 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.685441 25323 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.695433 25320 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.682287 25450 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:14.698324 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 221021us
I20260709 13:08:14.700924 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.703033 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.697150 25324 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.706622 25323 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.708051 25312 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:14.710461 25444 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:14.704299 25526 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.715154 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:14.718539 21115 leader_election.cc:336] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.060s (SENT)
W20260709 13:08:14.719199 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.711287 25231 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.725564 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.726344 25312 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.724687 25323 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:14.743047 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.743546 21298 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:14.744542 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:14.744976 21298 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:14.745296 25320 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:14.745757 25320 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:14.746618 25320 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:14.750255 25474 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.751003 25474 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:14.754182 21300 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:14.765208 21299 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
W20260709 13:08:14.762476 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49405.8us
I20260709 13:08:14.764619 25323 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.727913 25362 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:14.767956 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.775426 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 62900.8us
I20260709 13:08:14.751539 25474 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:14.767290 25312 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.801868 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57413.1us
W20260709 13:08:14.805940 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82376.9us
I20260709 13:08:14.773782 25323 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.779862 25362 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.808148 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:14.810000 21115 leader_election.cc:336] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.090s (SENT)
I20260709 13:08:14.813840 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.772320 25270 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:14.800631 25231 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.809626 25323 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.790422 25444 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:14.840476 25392 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:14.848084 25481 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:14.851928 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.852563 21297 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:14.844691 25362 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.854485 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.820204 25378 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.858845 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:14.859951 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 60308.9us
I20260709 13:08:14.865021 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:14.866669 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.870038 25362 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.871435 21291 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:14.879640 25474 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.884788 25378 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.890748 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:14.843216 25312 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.897605 21292 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:14.892347 25324 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.894088 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.846443 25231 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.901458 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:14.902065 21812 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:14.908895 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 70479us
W20260709 13:08:14.910557 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 56195us
I20260709 13:08:14.911716 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.911407 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:14.863107 25468 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:14.919507 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:14.919679 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:14.920851 21145 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:14.923471 21115 leader_election.cc:336] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 2.362s (SENT)
I20260709 13:08:14.925351 21148 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:14.926975 21147 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:14.927194 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:14.929414 21806 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:14.939811 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45810.9us
I20260709 13:08:14.945139 21151 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.919437 25498 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:14.947239 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.948613 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 92242.8us
I20260709 13:08:14.919891 25378 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.950256 21297 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:14.957748 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46058us
I20260709 13:08:14.958905 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.947602 25324 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:14.950204 25378 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:14.955454 25498 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:14.991377 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:14.984526 21812 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:14.993369 21296 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:14.956951 25543 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:14.994851 25323 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:14.996109 25543 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.996613 25543 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:14.997856 25323 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:14.998468 25323 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:14.999555 25525 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.000422 25231 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.001940 21298 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:14.997478 25543 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.007144 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:15.007858 21263 leader_election.cc:400] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:15.008190 21263 leader_election.cc:403] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.008531 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.008797 25525 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:15.002386 25551 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.010097 25534 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.010182 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.010802 25534 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.011492 25534 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.012485 25474 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:15.012954 25462 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:15.013336 25462 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:15.014094 25474 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:15.014173 25462 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.014780 25474 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:15.015868 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.016726 21151 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:15.016987 25474 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.019591 25312 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:14.971853 25324 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.021051 21295 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.971364 25545 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:08:15.033258 25448 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.009s
I20260709 13:08:15.033854 25448 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.034719 21299 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.020757 25324 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.044525 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:15.064321 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 55871us
I20260709 13:08:14.977180 25378 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.095775 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.096803 21147 raft_consensus.cc:2368] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:15.000905 25498 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.074481 25396 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:15.102213 25396 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:15.076845 25448 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.104084 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:15.105989 25189 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.109095 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.109763 25466 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:15.110220 25189 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.110675 25189 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.111032 25189 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.079468 25282 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:15.112551 25282 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.113476 25282 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.115761 25536 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.081791 25420 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.088325 25383 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.090118 24941 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.091583 21806 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
W20260709 13:08:15.092628 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.114955 25282 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.082895 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:15.132726 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67558.2us
I20260709 13:08:15.127759 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.143318 21296 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.116006 25378 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.148524 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.149184 21222 raft_consensus.cc:2376] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10. Re-sending same reply.
I20260709 13:08:15.149533 25450 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:15.150004 25378 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:15.150120 25434 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.150337 25547 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:15.150612 25434 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.151005 25547 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.151918 25468 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.151568 25434 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.152417 25468 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.152872 25434 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.154146 25547 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:15.154495 25468 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:15.155260 25362 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.155784 25362 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.157828 25362 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.160408 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.160141 25396 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.161034 21148 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:15.161464 25396 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.162943 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.128633 24941 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:15.164085 24941 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.165282 24941 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.128737 25420 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.169828 25420 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.170717 25378 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:15.170917 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 88144.9us
I20260709 13:08:15.170408 25420 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:15.171198 25378 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:15.171665 25378 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.171916 25464 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.172441 25464 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:15.172932 25525 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:15.173355 25464 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.174562 25464 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.179360 25378 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.181615 25378 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.191010 21221 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.121480 25462 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.209550 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.210384 21144 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:15.220182 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.225602 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.116456 25536 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.232046 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.232800 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.233629 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.234681 21148 raft_consensus.cc:2410] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:15.240641 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.241464 21143 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.243774 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.142467 25312 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:15.142491 25551 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.247364 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.242700 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:15.252285 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79628.8us
I20260709 13:08:15.257195 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:15.255052 21147 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:15.258828 25378 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.259382 25378 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:15.259851 25378 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.264345 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:15.267861 25525 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.271320 21223 raft_consensus.cc:1217] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-11.9]   Dedup: 6.7->[9.8-11.9]
I20260709 13:08:15.271864 21223 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: [6.7-11.9]
I20260709 13:08:15.271600 25211 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:15.272991 25424 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.273494 25424 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.128619 25466 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:15.275962 21048 catalog_manager.cc:5697] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 2 to 5, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 5 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:15.228907 25392 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:15.281731 21220 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:15.280776 21145 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:15.282069 21220 pending_rounds.cc:85] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 8
I20260709 13:08:15.282768 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:15.228782 25545 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:15.290395 25545 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.291613 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:15.292217 21221 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:15.292853 21220 pending_rounds.cc:107] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:15.293182 21220 raft_consensus.cc:2889] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.299563 25424 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:15.300616 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.301000 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.301628 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:15.301970 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:15.302763 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:15.303184 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:15.303720 21217 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:15.311355 21143 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:15.314393 21222 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.314818 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:15.320410 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.313457 21048 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 9 to 10, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.333714 21144 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:15.322899 21263 leader_election.cc:400] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:15.335952 21263 leader_election.cc:403] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.335623 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.278584 25534 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:08:15.336964 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 425616us
I20260709 13:08:15.308662 25362 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.310706 25231 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:08:15.348017 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.288182 25189 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.352345 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:15.353644 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:15.363765 21293 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:15.338892 25308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.024s	sys 0.024s
W20260709 13:08:15.373685 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 72163.8us
I20260709 13:08:15.379459 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:15.381453 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 378057us
I20260709 13:08:15.384058 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.382308 25525 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:15.377447 25308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.024s	sys 0.025s
I20260709 13:08:15.373725 25270 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.391062 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.379336 25424 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:15.424943 21778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.020s
W20260709 13:08:15.435273 21778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.020s
W20260709 13:08:15.435745 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 532877us
I20260709 13:08:15.426038 21048 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.382156 25558 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:15.437271 25558 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:15.455928 21115 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.506s (SENT)
I20260709 13:08:15.456598 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.438633 21048 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.413091 25362 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:15.470660 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 147919us
I20260709 13:08:15.471679 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.469784 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:15.476127 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 85167.1us
I20260709 13:08:15.435005 25424 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:15.483870 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.460661 25561 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.489159 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.506547 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.507084 21294 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.507660 21294 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:15.509742 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.478755 25462 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.461001 25270 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:15.520951 21049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 376) took 11283 ms (client timeout 15000 ms). Trace:
I20260709 13:08:15.536135 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet df140636c4344f32a0253fef2a907c50 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55540
I20260709 13:08:15.499609 25552 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.224s
I20260709 13:08:15.502388 25538 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.541934 21151 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:15.522264 25543 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.542603 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.479291 25362 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.538581 21294 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.530742 25547 raft_consensus.cc:2764] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:15.552960 21048 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 5, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.554327 21294 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.534355 25545 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:15.560827 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.563454 21297 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:15.542016 25320 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.561702 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:15.548780 25557 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:15.610862 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:15.611740 21812 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:15.612879 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 136174us
I20260709 13:08:15.561136 25558 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:15.635484 25574 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:15.530562 25551 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:15.555018 25538 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.640120 25552 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.566483 25308 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:08:15.640689 25362 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.642395 25189 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:15.643918 25560 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:08:15.644618 24941 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:15.644840 25576 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:15.645159 25556 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.646245 21293 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:15.646461 25536 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:15.646562 25568 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:15.563812 25424 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.559669 25481 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.611903 25555 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.647877 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:15.534207 21049 rpcz_store.cc:269] 0709 13:08:04.041991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.042287 (+   296us) service_pool.cc:224] Handling call
0709 13:08:15.315836 (+11273549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.233815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.269613 (+ 35798us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.269645 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:13.269663 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:13.276300 (+  6637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.276387 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.276410 (+    23us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:08:13.284703 (+  8293us) tablet.cc:701] Row locks acquired
0709 13:08:13.284727 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:08:13.284941 (+   214us) write_op.cc:270] Start()
0709 13:08:13.285109 (+   168us) write_op.cc:276] Timestamp: P: 1783602493284863 usec, L: 0
0709 13:08:13.285134 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.285968 (+   834us) log.cc:844] Serialized 7362 byte log entry
0709 13:08:13.584133 (+298165us) op_driver.cc:464] REPLICATION: finished
0709 13:08:13.695684 (+111551us) write_op.cc:301] APPLY: starting
0709 13:08:13.695862 (+   178us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:14.121809 (+425947us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:14.157966 (+ 36157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:14.338102 (+180136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:14.338603 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:08:14.338669 (+    66us) write_op.cc:312] APPLY: finished
0709 13:08:14.339234 (+   565us) log.cc:844] Serialized 172 byte log entry
0709 13:08:14.342488 (+  3254us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.342808 (+   320us) write_op.cc:454] Released schema lock
0709 13:08:14.342894 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:14.343315 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.343351 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66902,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":111175,"apply.run_cpu_time_us":34897,"apply.run_wall_time_us":647619,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77404,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":10542,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":19,"prepare.queue_time_us":108452,"prepare.run_cpu_time_us":30291,"prepare.run_wall_time_us":181081,"raft.queue_time_us":146480,"raft.run_cpu_time_us":4235,"raft.run_wall_time_us":18824,"replication_time_us":298627,"thread_start_us":304189,"threads_started":4,"wal-append.queue_time_us":140907,"wal-append.run_cpu_time_us":10485,"wal-append.run_wall_time_us":1919797}]]}
W20260709 13:08:15.653823 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.657076 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.665234 21294 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:15.511168 25561 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.740059 21294 pending_rounds.cc:85] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:15.740406 21294 pending_rounds.cc:107] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:15.740679 21294 raft_consensus.cc:2889] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.743965 21293 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.749747 25525 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
W20260709 13:08:15.681123 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 297178us
I20260709 13:08:15.760977 21293 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.761263 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:15.682934 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.682902 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:15.762980 21806 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.764158 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:15.765944 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:15.692974 21812 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:15.695174 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:15.767669 21807 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.738842 25481 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.696278 21813 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:15.719302 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 171373us
I20260709 13:08:15.659284 25420 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.722903 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:15.726208 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:15.683336 25378 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.741976 21048 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 4 to 7, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 7 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:15.754742 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:15.771108 21294 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.725801 25552 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.781776 25552 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.772203 25362 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.784435 25362 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:15.784435 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 58301.3us
I20260709 13:08:15.784857 25362 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.785953 25551 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.786320 25551 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.786625 25551 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.772073 25481 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.787393 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:15.789597 21048 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 5 to 6, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 6 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:15.791613 21048 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 3 to 4, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 4 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:15.738229 25564 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.736580 25556 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.793108 25564 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.793474 25564 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:15.794698 25282 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.001s
I20260709 13:08:15.794809 25556 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.811139 21143 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:15.812147 25551 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.771103 21811 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:15.814670 21299 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:15.774927 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.815584 25551 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:15.817307 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50266.8us
W20260709 13:08:15.775215 25565 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:08:15.780769 25378 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:15.771935 21191 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:15.792407 25538 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.768954 25377 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:15.760185 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 112396us
I20260709 13:08:15.757622 25547 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:15.797058 25464 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.622s	user 0.002s	sys 0.009s
I20260709 13:08:15.797083 25561 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:15.800035 21048 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.799118 25543 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:15.733232 24941 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.805451 25564 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.807699 25549 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:15.679347 21150 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:15.803081 21294 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:15.817912 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.818637 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:15.821861 21806 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:15.827986 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.829125 25526 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.829746 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:15.832012 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.898466 21145 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
W20260709 13:08:15.898576 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 68887.3us
I20260709 13:08:15.833307 21144 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:15.792078 25270 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:15.759584 25424 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.863278 25377 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:15.867615 25282 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:15.861773 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:15.863613 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 91899.9us
I20260709 13:08:15.864876 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.895829 21297 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.921871 25378 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:15.899176 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.825829 25536 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.910331 21147 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:15.920205 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:15.836831 21807 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
W20260709 13:08:15.945911 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.826701 25420 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:15.848665 25189 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:08:15.867369 25466 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.922387 25526 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:15.865648 25383 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:15.973989 21300 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:15.895615 21142 raft_consensus.cc:2410] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:15.977486 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.927548 25543 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.980400 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:15.980978 25538 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.999774 21145 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:16.000272 21147 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:16.003746 25383 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.004243 25383 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.004813 21191 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:16.006414 25383 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.007543 25588 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:16.008620 25588 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.008847 25420 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.009063 25588 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:16.010111 25588 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.012775 25455 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:16.013239 25455 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:16.014235 25455 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.001844 25466 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.002312 25543 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.003104 25526 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:15.983202 25282 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:15.964185 25549 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:16.026621 21143 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:08:15.982338 25450 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:16.040731 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 179059us
I20260709 13:08:16.083935 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:16.039691 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 140011us
W20260709 13:08:16.039244 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 174998us
W20260709 13:08:16.040341 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 80692.1us
I20260709 13:08:16.056097 21143 pending_rounds.cc:85] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 10
I20260709 13:08:16.039469 21297 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:16.059010 25549 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.060494 25377 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.061661 25455 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:16.065723 25481 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.069523 25282 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.071182 24941 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.076013 25466 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.077499 25572 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.080520 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.112835 21222 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:16.081995 25571 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:08:16.086198 21143 pending_rounds.cc:107] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:16.113782 21143 raft_consensus.cc:2889] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.091352 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:16.092360 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:15.983505 25536 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.098312 21220 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:16.103839 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:16.104167 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:16.123487 21219 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.056123 25538 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:16.120550 21224 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:16.126192 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:16.127501 21300 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:16.129856 21295 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:08:16.132256 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 161805us
W20260709 13:08:16.133864 21115 leader_election.cc:336] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.733s (SENT)
I20260709 13:08:16.096818 25383 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.138419 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 54594.6us
W20260709 13:08:16.141984 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.101783 25377 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.106654 25551 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:16.147711 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.147974 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.149412 21217 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:16.150264 21226 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:16.153492 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:16.158645 21145 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:16.158668 21147 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:16.101512 25525 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:16.165027 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:16.165956 25592 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.166482 25592 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.167443 25450 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.168134 25450 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:16.168885 25592 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.163604 25591 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:16.170904 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:16.173810 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.176692 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:16.177850 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.180182 21151 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:16.181295 21147 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:16.151612 25551 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:16.189421 21222 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:16.169371 25592 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.189054 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:16.176748 25586 tablet_replica.cc:333] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:08:16.136819 25378 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:16.195147 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.198024 21217 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:16.144914 25538 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.189412 24941 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.179774 25270 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.191915 25551 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.226263 21812 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:16.227739 21808 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:16.129127 25572 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.169435 25450 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:16.152190 25383 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.191419 25312 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:16.232226 25596 log.cc:927] Time spent T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:16.191366 25591 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.235085 21811 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:16.171103 25555 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:16.241266 25312 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:16.241873 21150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2111) took 2019 ms (client timeout 1963 ms). Trace:
I20260709 13:08:16.242190 21148 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:16.242965 21812 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:16.246695 25322 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:16.196866 25592 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.251281 21218 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:16.251477 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2124) took 1043 ms. Trace:
I20260709 13:08:16.229668 25536 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.253767 25383 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.201691 25564 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:16.264218 21150 rpcz_store.cc:269] 0709 13:08:14.222166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.466756 (+244590us) service_pool.cc:224] Handling call
0709 13:08:16.241662 (+1774906us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54000848d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:16.241777 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147413248}
I20260709 13:08:16.252976 25396 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:16.266965 21142 rpcz_store.cc:276] 0709 13:08:15.207662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.222172 (+ 14510us) service_pool.cc:224] Handling call
0709 13:08:16.251245 (+1029073us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540040e054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:16.251417 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469455104}
I20260709 13:08:16.269918 21814 raft_consensus.cc:1217] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:08:16.272171 21808 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [8.9-11.11]
I20260709 13:08:16.276052 21814 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:16.275283 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:16.279414 21808 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:16.266389 25322 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:16.237911 25270 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.231330 24941 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.268687 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:16.287757 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.285367 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.289415 21811 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:16.269326 25434 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:16.293740 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:16.306516 21293 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:16.308377 25592 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.308178 25312 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.309345 25434 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.311546 25434 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.312117 25231 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:16.312485 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:16.313161 21217 raft_consensus.cc:606] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:16.312637 25231 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:16.314383 25231 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.316445 25572 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.317945 25481 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.291064 25378 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.320109 25538 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:16.320127 25378 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.325170 25270 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.325994 25378 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.278023 25396 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:16.282083 25584 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.336192 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.336674 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.351022 21226 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:16.341380 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.352285 21217 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:16.352415 21221 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:16.337025 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.337410 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.355050 21223 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:16.345860 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.335764 21222 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:16.363816 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 174836us
I20260709 13:08:16.338097 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.342097 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.365543 21224 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:16.372246 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:16.366016 21811 raft_consensus.cc:2376] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13. Re-sending same reply.
I20260709 13:08:16.373585 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:16.356508 21225 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:16.383459 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:16.383080 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.387751 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:16.326393 25362 consensus_meta.cc:287] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.002s
I20260709 13:08:16.438128 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:16.439786 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 75007.1us
I20260709 13:08:16.440837 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:16.438943 21810 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:16.384406 21809 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:16.345000 24941 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.441918 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.347398 25591 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:16.387187 25383 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:16.387398 25536 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.387203 25584 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:16.438066 25572 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:16.453660 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.449991 21778 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.455077 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.457206 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.465906 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.461265 21809 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:16.466250 21219 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:16.467204 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.468248 21151 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:16.467545 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.466699 21150 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:16.468842 21219 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:16.467326 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:16.327454 25322 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.453068 25383 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.327632 25396 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.444329 25538 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:16.487985 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.492887 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.485622 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.442816 25362 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.458110 25536 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.462378 25591 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.493585 21142 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:16.493778 21219 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:16.470463 25378 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.472401 25525 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.495676 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.468372 25564 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:16.470945 25555 raft_consensus.cc:2804] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.506629 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:16.512653 21809 raft_consensus.cc:2368] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:16.507733 21293 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.512907 21298 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.508313 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:16.471479 25572 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:16.459486 25592 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:16.490760 25383 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.519833 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:16.490909 25231 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:16.462819 25584 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.495924 25536 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.534183 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.509523 25322 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.530453 25270 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:16.531272 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:16.526978 25591 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:16.529544 21219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:16.509443 25525 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.504982 25378 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.539893 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:16.492281 25481 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:16.548091 21219 raft_consensus.cc:606] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:16.549832 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.561455 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.560073 25466 raft_consensus.cc:2764] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:16.562718 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.563306 21219 raft_consensus.cc:614] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.539189 25231 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.565681 25231 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.538129 25555 raft_consensus.cc:697] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:16.556753 25525 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.567174 25555 consensus_queue.cc:237] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.515799 25564 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.528199 25448 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:16.567559 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:16.571117 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.574569 21809 raft_consensus.cc:2376] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9. Re-sending same reply.
I20260709 13:08:16.545279 25270 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.547238 25591 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:16.584105 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.593854 21296 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:16.571468 21097 auto_rebalancer.cc:629] Failed to schedule move for tablet ddef3aae03e94e30acb5d8592f3f75b2: Illegal state: Replica 3585d99c303e453c8c3762b294caba4e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:16.578202 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:16.572806 25573 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.937s	user 0.008s	sys 0.001s
W20260709 13:08:16.600699 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 71929us
I20260709 13:08:16.570979 25378 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.527681 24941 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:16.574263 25448 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.618515 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:16.629169 21809 raft_consensus.cc:2368] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
W20260709 13:08:16.627976 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.633291 25538 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.633955 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.633860 25538 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.634570 21809 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:16.635397 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:16.635838 21809 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.635994 25538 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.638273 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2687) took 1386 ms. Trace:
W20260709 13:08:16.638640 25618 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:16.638727 21292 rpcz_store.cc:276] 0709 13:08:15.252322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.252464 (+   142us) service_pool.cc:224] Handling call
0709 13:08:15.284936 (+ 32472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.309025 (+ 24089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.309055 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.315602 (+  6547us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.489050 (+173448us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:15.489099 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.489166 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.532331 (+1043165us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:16.637902 (+105571us) raft_consensus.cc:1685] finished
0709 13:08:16.637926 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.638195 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4103,"raft.queue_time_us":153,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4070,"spinlock_wait_cycles":29860096,"thread_start_us":113997,"threads_started":1,"wal-append.queue_time_us":205141}
I20260709 13:08:16.641249 25525 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.643642 25525 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:16.652799 25564 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:16.653627 25564 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:16.654450 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:16.657457 25377 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:08:16.655220 21223 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.663475 25572 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.598336 25270 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.553058 25534 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:08:16.574401 25623 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.688429 21298 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
W20260709 13:08:16.689755 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 87939.3us
I20260709 13:08:16.667222 25448 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:16.697479 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 97763us
I20260709 13:08:16.599359 25547 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:08:16.704284 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:16.599184 25551 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.714282 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.709952 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.739320 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.685889 25322 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:16.766973 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:16.767818 21145 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:16.771008 21810 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:16.775369 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.776029 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:16.799244 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:16.800244 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.684182 25623 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:16.802008 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 97851.1us
I20260709 13:08:16.802773 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.809384 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.810388 21808 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:16.774541 25525 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:16.813256 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.817140 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.769522 25322 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:16.822155 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:16.822518 21808 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:16.825510 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.815380 25525 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.826944 25525 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.777734 25466 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:16.829021 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 119149us
I20260709 13:08:16.829627 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:16.804620 25591 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.779829 25481 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:16.811870 25362 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.799574 25547 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:16.838527 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:16.845098 21293 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:16.832280 25581 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:16.834249 25591 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.854254 25639 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.852046 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:16.867789 21808 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:16.842078 25638 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:16.870739 25631 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:16.871634 25627 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.872001 25644 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:16.851667 25322 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:16.872570 25632 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:16.872725 25549 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.876507 25639 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:16.879794 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:16.904184 21226 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.880192 25623 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:16.833613 25466 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.888238 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:16.942162 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:16.891716 21223 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:16.868295 25591 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.900074 21809 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:16.883857 25638 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:16.868782 25581 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:16.902774 25322 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.945477 25362 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.963584 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:16.936137 25392 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.965036 21811 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:16.987246 21805 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:16.991072 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.994179 21805 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:16.958161 25282 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.001442 21805 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:16.996979 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 167454us
I20260709 13:08:16.939635 25549 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:16.967182 25551 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:17.003435 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.004581 21811 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:17.009368 21223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a837dff96224f8b8795bace63448d84"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:17.009970 21223 raft_consensus.cc:606] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:16.987514 25642 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.016450 21805 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:17.018155 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:17.018394 21811 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:17.018739 21814 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.988111 25362 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.023749 25612 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:17.024078 25581 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.026557 25549 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:17.027567 25643 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:17.024154 25612 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:08:17.029819 25582 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.067s	user 0.001s	sys 0.001s
I20260709 13:08:17.029524 25612 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.030776 25612 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.028802 25383 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.031594 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2127) took 1823 ms. Trace:
I20260709 13:08:17.031665 25448 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.032966 25383 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.032106 21149 rpcz_store.cc:276] 0709 13:08:15.208599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.208732 (+   133us) service_pool.cc:224] Handling call
0709 13:08:15.239964 (+ 31232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.460490 (+220526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.460526 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.471041 (+ 10515us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.691551 (+220510us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:15.691608 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.691705 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.029209 (+1337504us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:17.031321 (+  2112us) raft_consensus.cc:1685] finished
0709 13:08:17.031341 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.031536 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74091,"raft.queue_time_us":91099,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6335,"spinlock_wait_cycles":3343232,"thread_start_us":308852,"threads_started":2,"wal-append.queue_time_us":367490}
I20260709 13:08:17.036634 25383 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.040042 21151 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:17.039708 25383 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.043166 25320 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.043773 25320 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:17.050812 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.052919 25362 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.054925 25383 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.035949 25448 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:17.057626 21218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 672) took 1937 ms (client timeout 2162 ms). Trace:
W20260709 13:08:17.057639 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54932.7us
W20260709 13:08:17.058204 21218 rpcz_store.cc:269] 0709 13:08:15.120562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.120743 (+   181us) service_pool.cc:224] Handling call
0709 13:08:17.057455 (+1936712us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400127fd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:17.057548 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585295104}
I20260709 13:08:17.059461 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.060043 21218 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:17.060918 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.061103 21221 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.061419 21218 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.062981 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.064059 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.064172 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:17.065768 25322 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.066450 25322 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:17.066797 25322 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.067153 25322 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.067238 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:17.067914 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.070178 25378 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.070858 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.089149 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.089391 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.089715 21299 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:17.071300 25586 raft_consensus.cc:2243] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:17.071401 25462 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.021348 25639 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.105154 21808 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:17.105413 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:17.106192 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.106222 21805 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:17.072373 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.020674 25638 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.065601 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:17.111837 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:17.112892 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47346.5us
W20260709 13:08:17.113451 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.113947 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:17.107091 21810 raft_consensus.cc:2376] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11. Re-sending same reply.
I20260709 13:08:17.119385 21218 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:17.076088 25322 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.005633 25282 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.077907 25466 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.078712 25434 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.065557 21811 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:17.079953 25615 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.080667 25584 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.080921 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:17.148619 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 67774.1us
I20260709 13:08:17.149022 21805 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:17.149734 21264 leader_election.cc:400] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
I20260709 13:08:17.150137 21264 leader_election.cc:403] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.000541 25392 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.082365 25474 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.085947 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.087843 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.088722 21226 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:17.150990 21218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:17.011981 25481 consensus_queue.cc:1243] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:17.086414 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:17.153231 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:17.154037 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67696.6us
I20260709 13:08:17.155395 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.156852 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.093425 21223 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:17.096890 25586 pending_rounds.cc:70] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Trying to abort 2 pending ops.
I20260709 13:08:17.167452 25462 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.110106 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.168339 21295 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.168097 25462 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.172899 25362 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:17.173349 25362 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.173734 25362 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:17.175851 25536 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:08:17.176666 25606 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:17.124574 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.129169 21298 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:17.130472 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2125) took 1922 ms. Trace:
W20260709 13:08:17.140990 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.093178 24941 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.183612 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:17.184533 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 195628us
I20260709 13:08:17.158419 25474 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.152961 25615 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.159425 25577 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:17.159838 25584 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.158090 25526 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.192711 25392 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.193284 25474 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.193372 25392 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.193960 25392 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.160630 25378 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.160784 25323 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.163602 25566 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.623s	user 0.004s	sys 0.000s
I20260709 13:08:17.195538 25623 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:17.163722 25638 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.195888 25396 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.196121 25623 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:17.196203 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:17.197158 25623 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.163964 25466 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.167400 25586 pending_rounds.cc:77] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305635724225859584 op_type: NO_OP noop_request { }
I20260709 13:08:17.198176 25474 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.198463 25466 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.097396 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.199776 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.200593 25466 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.200490 25378 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.193989 25578 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:17.166299 25270 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.177098 25606 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:17.143272 25534 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:17.145938 25383 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:17.176358 25536 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.209216 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.210026 25282 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.197556 25615 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:17.205514 25534 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:17.214210 25534 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.217581 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.226495 25320 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.178371 21146 rpcz_store.cc:276] 0709 13:08:15.207964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.222937 (+ 14973us) service_pool.cc:224] Handling call
0709 13:08:15.255284 (+ 32347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:15.286176 (+ 30892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.286219 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:15.307620 (+ 21401us) log.cc:844] Serialized 52 byte log entry
0709 13:08:15.476079 (+168459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:17.104177 (+1628098us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180043f2a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf
0709 13:08:17.104354 (+   177us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.104589 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.104674 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.104718 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:17.130266 (+ 25548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.130417 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32891,"prepare.queue_time_us":172070,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":23501,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16765,"spinlock_wait_cycles":4643200,"thread_start_us":351814,"threads_started":2,"wal-append.queue_time_us":582939}
I20260709 13:08:17.202816 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:17.198436 25586 raft_consensus.cc:2889] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:17.265246 21814 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:17.265489 25586 pending_rounds.cc:77] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305635648509739008 op_type: NO_OP noop_request { }
I20260709 13:08:17.266088 25586 raft_consensus.cc:2889] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:17.227838 25606 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:17.229140 25654 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:08:17.229977 25536 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.230553 21145 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:17.206461 25383 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.231604 21220 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:08:17.231694 21225 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:17.232553 25270 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.183184 21295 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:17.237476 25525 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.240322 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2132) took 1417 ms. Trace:
I20260709 13:08:17.243834 25627 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:17.248750 25322 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.248986 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2133) took 1425 ms. Trace:
I20260709 13:08:17.273155 25586 raft_consensus.cc:2272] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:17.250231 25392 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.250882 25462 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.266639 25615 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:17.263666 21298 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:17.263818 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:17.264221 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.267526 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:17.268496 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.184073 25612 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9.
W20260709 13:08:17.272083 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 252052us
W20260709 13:08:17.272078 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 69371.5us
I20260709 13:08:17.322963 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:17.296061 25606 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.326225 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:17.191169 25591 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.296818 21143 rpcz_store.cc:276] 0709 13:08:15.823146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.823381 (+   235us) service_pool.cc:224] Handling call
0709 13:08:15.865361 (+ 41980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.126340 (+260979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.240011 (+1113671us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001ddb54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:17.240236 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348523392}
I20260709 13:08:17.297354 21148 rpcz_store.cc:276] 0709 13:08:15.823905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.824062 (+   157us) service_pool.cc:224] Handling call
0709 13:08:16.241878 (+417816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.264291 (+ 22413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.248799 (+984508us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000848d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:17.248930 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878473984}
I20260709 13:08:17.262828 21296 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.330288 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:17.314520 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 224436us
I20260709 13:08:17.335047 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.295028 25383 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.152426 21218 raft_consensus.cc:606] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.297307 25627 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:17.341279 21218 raft_consensus.cc:614] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:17.323802 21292 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:08:17.325168 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 61451.6us
I20260709 13:08:17.342692 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:17.327006 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:17.266741 25650 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:17.340049 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.340854 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:17.343609 21807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.012s
I20260709 13:08:17.345033 21295 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.344406 25650 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.348613 25650 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:17.349581 25612 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.349980 25612 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.350329 25612 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.350581 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.352232 25615 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.356383 25362 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.358767 25362 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:17.351475 21807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.012s
I20260709 13:08:17.362852 21114 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:17.363901 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:17.367530 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44640.7us
I20260709 13:08:17.367650 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:17.375288 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:17.377030 24941 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:17.377490 24941 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:17.377635 25509 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.377945 24941 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.378134 25509 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.378952 25464 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.374302 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1158) took 1174 ms. Trace:
I20260709 13:08:17.368810 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:17.382310 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.385488 21224 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.387845 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.388654 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:17.389760 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 112901us
I20260709 13:08:17.360494 25526 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.340852 25474 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.381058 21807 rpcz_store.cc:276] 0709 13:08:16.186742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.187071 (+   329us) service_pool.cc:224] Handling call
0709 13:08:16.187509 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.195673 (+  8164us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:16.491283 (+295610us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.785931 (+294648us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.805595 (+ 19664us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.819408 (+ 13813us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.819550 (+   142us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:16.834936 (+ 15386us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.040857 (+205921us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b180014eea0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d522 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:17.168015 (+127158us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180014eea0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:17.360813 (+192798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.360889 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.360955 (+    66us) raft_consensus.cc:1685] finished
0709 13:08:17.360982 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.361106 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15496,"prepare.queue_time_us":531581,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":239972,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":44494,"spinlock_wait_cycles":41488768,"thread_start_us":985040,"threads_started":4,"wal-append.queue_time_us":286709}
I20260709 13:08:17.392694 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.400563 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:17.401427 21144 raft_consensus.cc:3060] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.372215 25322 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.379392 25464 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.410585 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.409801 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.371940 25378 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.411967 21297 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.412231 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.425241 21226 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:17.426431 21226 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:17.426669 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.373920 25462 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.427875 25462 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.428181 25547 raft_consensus.cc:2764] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:17.420106 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:17.429286 21150 raft_consensus.cc:2410] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:17.421973 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.380084 25552 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.430590 25547 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.431339 25552 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.431784 25547 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:17.432376 25547 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:17.428257 25462 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.419807 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.431886 25552 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.424471 21224 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:17.390396 25282 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:17.436815 21145 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:17.360653 25448 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:08:17.447562 21144 raft_consensus.cc:2468] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:17.438233 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.450754 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.451676 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.463385 21146 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:17.371834 25578 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:17.415340 25211 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:17.393801 25526 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:17.462733 21142 raft_consensus.cc:2376] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11. Re-sending same reply.
I20260709 13:08:17.418951 25322 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.377516 25383 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.422993 25464 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.489388 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.474332 25534 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:17.490037 21145 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:17.491030 25661 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:17.490962 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:17.497778 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.500522 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.501631 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:17.502159 21143 raft_consensus.cc:2376] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8. Re-sending same reply.
I20260709 13:08:17.502658 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.503387 21294 raft_consensus.cc:2393] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:17.506968 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 375306us
I20260709 13:08:17.507563 21218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:17.507928 21808 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:17.508121 21218 raft_consensus.cc:606] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.508695 21218 raft_consensus.cc:614] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:17.482409 25526 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.511782 21143 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:17.484603 25322 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.513890 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.521252 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:17.515384 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.521817 21814 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.532083 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:17.488221 25211 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:17.495711 25282 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:17.494650 25612 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.536949 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:08:17.544082 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 161602us
I20260709 13:08:17.547941 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:17.544088 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:17.559867 21814 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:17.559818 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:17.560640 21808 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.557096 21116 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:17.570309 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 199531us
W20260709 13:08:17.605511 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 254969us
I20260709 13:08:17.647995 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:17.575727 25658 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:08:17.590801 21150 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:17.541755 25320 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:17.573973 25615 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.558665 25270 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:17.575431 25537 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.555962 25525 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.667897 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.547530 25584 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:08:17.677066 21222 raft_consensus.cc:2376] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11. Re-sending same reply.
I20260709 13:08:17.668433 21150 raft_consensus.cc:1275] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:17.668264 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.650118 25392 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:17.691977 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44065.2us
I20260709 13:08:17.695369 21808 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:17.700973 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.653687 25543 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.653973 25587 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:17.715397 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:17.718184 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.668445 25509 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.721020 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:17.724347 21150 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 8.
I20260709 13:08:17.549777 25650 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.725996 21808 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:17.726457 21808 pending_rounds.cc:85] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:17.726744 21808 pending_rounds.cc:107] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:17.727101 21264 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.727105 21808 raft_consensus.cc:2889] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.730705 21297 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:17.731137 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.732362 21297 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:17.732698 21297 pending_rounds.cc:85] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:17.732930 21297 pending_rounds.cc:107] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:17.733152 21297 raft_consensus.cc:2889] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.736128 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.699433 25392 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:17.710242 25525 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:17.740911 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.734992 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.746374 21292 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:17.752219 21297 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.747052 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.750231 21300 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:17.715824 25615 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.758255 25615 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.723007 25543 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.760244 21298 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:17.760375 25615 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.760895 25615 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.761370 25543 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.761533 25615 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.762586 25669 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:17.762993 25383 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.763494 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:17.716710 25320 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:17.759553 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:17.765767 25392 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.766939 25392 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.746250 25509 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.763582 25383 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:17.771677 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:17.765039 25320 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.762280 25615 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:17.729494 25623 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.729842 25675 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:17.781754 25675 consensus_queue.cc:1243] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:17.782151 25666 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:17.770938 25525 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.785214 25525 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:17.787719 25526 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:17.789551 25662 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:08:17.791776 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 681) took 1257 ms. Trace:
I20260709 13:08:17.791498 25383 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.792172 21219 rpcz_store.cc:276] 0709 13:08:16.534330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.564457 (+ 30127us) service_pool.cc:224] Handling call
0709 13:08:16.564765 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.565500 (+   735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.565529 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.711440 (+145911us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b2c0006b8f8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:16.739028 (+ 27588us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.288324 (+549296us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:17.288641 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.292207 (+  3566us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.294781 (+  2574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.294855 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.346426 (+ 51571us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b1800444700. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:17.791538 (+445112us) raft_consensus.cc:1685] finished
0709 13:08:17.791561 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.791698 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1703,"prepare.queue_time_us":282,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":1619,"raft.queue_time_us":7055,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":2751,"spinlock_wait_cycles":18058240,"thread_start_us":481634,"threads_started":1,"wal-append.queue_time_us":607178}
I20260709 13:08:17.793735 25383 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.694839 25282 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.807049 25450 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.807688 25450 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.676497 25211 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.759646 25674 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.759873 25668 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:17.832558 25672 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.833160 25672 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.835069 21150 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:17.837297 25612 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:17.809721 25450 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:17.698953 25537 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.727596 25587 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:17.877893 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46198.6us
I20260709 13:08:17.885157 25638 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.885812 25638 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.824209 25378 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:17.858214 25660 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:08:17.900525 21145 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:17.907385 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:17.815834 25623 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:17.919543 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 411574us
I20260709 13:08:17.920917 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:17.921772 21223 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:17.923679 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.924378 21225 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:17.888957 25448 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.925810 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:17.935135 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:17.857560 25462 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.863562 25464 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.945077 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:17.892396 25396 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:17.941881 25534 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.950963 25554 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.920471 25383 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.950306 25525 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:17.951673 25474 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:08:17.951478 25554 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.951960 25525 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.952121 25474 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.952379 25525 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.950995 25534 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.953253 25684 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.953753 25684 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.954252 25464 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.954651 25534 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:17.954973 21143 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.923341 25564 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:17.949333 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.940812 25586 ts_tablet_manager.cc:1916] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:17.952448 25552 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:08:17.972553 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.957747 25677 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.942380 25448 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.937165 25674 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:08:17.984709 25509 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.959297 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.962921 25612 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.974565 25450 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:17.951714 25383 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:17.984973 25659 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.984928 25678 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.993202 24941 consensus_meta.cc:287] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.001s
I20260709 13:08:17.985814 25552 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.994184 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:18.024441 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 50753.7us
I20260709 13:08:18.002704 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:17.999164 25509 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:17.992276 25677 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.020629 25638 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.039939 21217 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:18.040438 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.027164 25320 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.005836 25450 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.027583 25684 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.013511 24941 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:18.111908 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 232789us
I20260709 13:08:18.030678 25685 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.042519 25554 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.115360 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:18.039485 25676 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.010818 25678 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.165298 24941 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.165410 25678 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.167152 25684 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:18.170379 25448 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.179616 25672 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.191433 25623 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.193998 25677 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.199627 25587 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.010923 25659 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.202579 25659 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:18.114985 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 74667.2us
I20260709 13:08:18.155010 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.152220 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.204398 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:18.204584 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 52426.4us
I20260709 13:08:18.206071 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.206642 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:18.159005 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43761us
I20260709 13:08:18.206931 25448 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:18.207648 25448 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:18.208561 25448 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.209045 25552 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.209810 25552 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:18.210351 25552 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:18.162341 25270 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:18.214461 25534 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.214866 25587 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:18.226002 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.228582 25547 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.229939 25547 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.235968 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.236729 21144 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 8: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:18.237650 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.238135 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.238677 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.239452 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.240036 21294 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:18.241230 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.241984 25591 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.242110 25509 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.242728 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.243346 21296 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:18.243475 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.243634 25462 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.238160 21144 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.244063 21145 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.243355 25383 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.245568 25450 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.249918 21150 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:18.241235 21297 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:18.060125 25537 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:18.253961 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 47306.8us
I20260709 13:08:18.255671 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:18.258175 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.258785 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.259558 21220 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 7.
I20260709 13:08:18.045092 25674 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:08:18.116605 25679 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.260404 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:18.270170 21144 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:18.261713 21297 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:18.155184 25675 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.264269 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.264897 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.265038 25526 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.267284 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.268193 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.268953 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.264034 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:18.277992 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.273620 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:18.278228 21221 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.286842 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.294498 21220 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.272380 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.277201 21292 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:18.150516 25612 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:08:18.259363 25678 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.297600 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.296605 21145 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:18.298995 21142 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.302984 25612 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:18.256734 25587 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:08:18.300567 25322 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.000s
I20260709 13:08:18.314795 25322 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.316970 25322 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.317433 25534 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:18.317920 25606 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.000s
I20260709 13:08:18.303637 25678 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.318733 25678 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.318814 21220 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:18.270969 25434 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.314272 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.323777 21292 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:18.298252 25674 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:18.320672 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.333761 21145 raft_consensus.cc:2368] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:18.266827 25591 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:18.326362 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.300860 25270 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:18.319684 25682 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:08:18.356066 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.308734 25672 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:18.366390 21221 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:18.306684 25679 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:18.359180 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:18.368294 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 371398us
I20260709 13:08:18.267524 25552 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.306833 25543 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:08:18.376224 21263 leader_election.cc:400] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:18.376551 21263 leader_election.cc:403] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:08:18.358044 25282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.029s
I20260709 13:08:18.374514 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.379670 21220 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:18.350546 25638 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.380461 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.381253 21145 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:18.382031 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.382287 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.350229 25554 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:18.382885 21145 raft_consensus.cc:2410] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:18.323114 25583 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:08:18.384404 25694 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:18.386889 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.388722 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.390480 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.368496 25679 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.391111 21145 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.385170 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:18.391543 25679 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.392048 21221 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:18.386622 25554 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.397668 25689 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:08:18.398267 25554 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.405943 25679 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.409178 21221 raft_consensus.cc:1217] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-11.9]   Dedup: 6.7->[9.8-11.9]
I20260709 13:08:18.409915 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.410606 25679 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.409895 21221 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: [6.7-11.9]
I20260709 13:08:18.416749 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 813) took 1012 ms. Trace:
I20260709 13:08:18.418876 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 693) took 1004 ms. Trace:
I20260709 13:08:18.419313 21226 rpcz_store.cc:276] 0709 13:08:17.414938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.429788 (+ 14850us) service_pool.cc:224] Handling call
0709 13:08:17.430077 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.456974 (+ 26897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.457006 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:17.457582 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.902982 (+445400us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:17.903120 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.903375 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.418688 (+515313us) raft_consensus.cc:1685] finished
0709 13:08:18.418705 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.418826 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26475,"raft.queue_time_us":37957,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":14716,"thread_start_us":402995,"threads_started":1,"wal-append.queue_time_us":536357}
I20260709 13:08:18.420811 25547 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.421537 25547 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.382097 25526 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.422207 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 815) took 1015 ms. Trace:
I20260709 13:08:18.422653 21147 rpcz_store.cc:276] 0709 13:08:17.406707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.407520 (+   813us) service_pool.cc:224] Handling call
0709 13:08:17.409831 (+  2311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.645982 (+236151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.646012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.654726 (+  8714us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.005739 (+351013us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:18.005781 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.005849 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.421937 (+416088us) raft_consensus.cc:1685] finished
0709 13:08:18.421967 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.422138 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7989,"raft.queue_time_us":97064,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11882,"thread_start_us":522933,"threads_started":2,"wal-append.queue_time_us":630308}
I20260709 13:08:18.425148 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.426369 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.426800 21145 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:18.417331 21151 rpcz_store.cc:276] 0709 13:08:17.404100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.405170 (+  1070us) service_pool.cc:224] Handling call
0709 13:08:17.421192 (+ 16022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.748410 (+327218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.748724 (+   314us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.751297 (+  2573us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.038622 (+287325us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:18.117451 (+ 78829us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.152796 (+ 35345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.152899 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.416479 (+263580us) raft_consensus.cc:1685] finished
0709 13:08:18.416502 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.416678 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76587,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":156172,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":40796,"thread_start_us":540519,"threads_started":2,"wal-append.queue_time_us":586919}
I20260709 13:08:18.425868 21147 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:18.364099 25672 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:18.432024 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.373090 25674 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:18.432484 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.432260 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.432237 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.435377 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.435602 21151 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:18.382433 25606 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.435004 21808 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:18.434561 21292 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:18.364357 25434 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 13:08:18.379681 25282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.013s	sys 0.029s
I20260709 13:08:18.438083 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.440951 21808 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:18.435652 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.453190 21805 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:18.454210 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.454510 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.455039 21814 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:18.455294 21809 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:18.429677 25623 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.456148 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.433823 25554 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.459184 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.459313 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.459978 21807 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:18.460572 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.461083 21812 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.467962 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.461119 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.442389 25474 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:18.464382 21292 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:18.470057 21295 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:18.440737 25434 consensus_queue.cc:1243] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:18.425561 25638 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.380278 25627 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.482870 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 184006us
I20260709 13:08:18.478020 21151 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:18.474064 21813 raft_consensus.cc:1217] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.6->[7.7-13.10]   Dedup: 7.7->[9.8-13.10]
I20260709 13:08:18.483976 21813 pending_rounds.cc:85] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 7
I20260709 13:08:18.484380 21813 pending_rounds.cc:107] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:08:18.484653 21813 raft_consensus.cc:2889] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.487329 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:18.487895 21218 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.481808 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.489394 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.489898 21292 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:18.483590 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.458927 25606 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:18.507581 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.479212 25700 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:18.509070 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:18.509450 25525 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:08:18.509125 25700 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.509714 21221 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.509922 25525 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.511587 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:18.513294 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 275013us
I20260709 13:08:18.522780 21808 raft_consensus.cc:2410] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:18.478370 25591 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:18.512259 21811 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:18.536314 21812 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:08:18.526599 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.527196 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.525411 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.489187 25474 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:08:18.594453 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.487985 25684 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:18.463084 25623 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.463361 25554 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.507004 25694 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.502323 25685 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:18.515349 25679 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:18.589143 25700 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.596611 21218 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:18.628108 21292 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:18.594937 21221 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
W20260709 13:08:18.621531 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 94586.2us
I20260709 13:08:18.506896 25450 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:18.621078 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.558044 25591 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.635664 21114 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.514778 25627 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:18.638823 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 80786.3us
W20260709 13:08:18.643596 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.642714 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.555712 25282 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:08:18.646642 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 57010.6us
I20260709 13:08:18.482332 25672 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.638149 25683 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.658202 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.659940 21814 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:18.637748 25462 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.660964 25462 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.661633 25552 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.662482 25552 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.663200 25552 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.664922 25462 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.640936 25664 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.672467 21807 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:18.643110 25591 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.645797 25509 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.680181 21292 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:18.644130 25679 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:18.682807 25547 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.653908 25534 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:18.687399 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.688226 21805 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.656006 25702 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:18.672739 25683 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.691498 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.644397 25450 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.673373 25525 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.713284 21142 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:18.641142 25694 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.687681 25672 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.716866 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.690843 25509 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:18.555905 25674 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.725065 21097 auto_rebalancer.cc:629] Failed to schedule move for tablet f13baf7007c44fb5a2efa7e30933caf3: Illegal state: Replica f81bf1abd0b34f518d1f2b79cc4dba77 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:18.723366 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.705057 25683 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.705262 25534 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:18.724781 25392 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.005s
I20260709 13:08:18.683773 25664 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.729169 21806 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:08:18.692312 25448 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:18.697088 25700 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:18.732007 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.729139 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.714883 25677 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.736877 21144 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:18.683779 25606 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.741058 25509 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.742183 25677 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.742715 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.743520 25707 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:18.744664 25650 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.745635 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 816) took 1335 ms. Trace:
I20260709 13:08:18.746038 21149 rpcz_store.cc:276] 0709 13:08:17.410376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.410487 (+   111us) service_pool.cc:224] Handling call
0709 13:08:17.437575 (+ 27088us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.461885 (+ 24310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.461926 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:18.248194 (+786268us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:18.248752 (+   558us) log.cc:844] Serialized 52 byte log entry
0709 13:08:18.459408 (+210656us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:18.459441 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.459502 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.745353 (+285851us) raft_consensus.cc:1685] finished
0709 13:08:18.745373 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.745579 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97101,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4522,"spinlock_wait_cycles":19833600,"thread_start_us":210302,"threads_started":1,"wal-append.queue_time_us":343005}
W20260709 13:08:18.747570 25706 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:08:18.748420 21149 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:18.749366 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.750459 21224 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:18.701726 25474 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.752471 25450 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.752943 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:18.754369 25694 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.749574 21149 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:18.733415 25717 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.766494 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:18.768565 21145 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:18.748437 25698 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:08:18.779603 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.781455 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.728842 25543 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:18.786458 21814 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:18.788342 25697 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:18.788759 25697 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.789005 25677 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.789111 25697 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:18.791447 25699 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:08:18.720486 25684 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.768641 25638 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:18.795411 25713 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:08:18.795632 25638 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:18.797118 25554 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.797456 25664 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.799571 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.703589 25702 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.775743 25701 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:08:18.768260 25717 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.808645 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.805346 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:18.807520 21805 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:18.809785 21218 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:18.810787 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:18.779791 25578 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.814606 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:18.813527 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.812621 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:18.815696 21805 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.819646 25424 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:18.820084 25424 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.820420 25424 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.821185 25552 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.823637 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.768349 25392 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:18.826066 21145 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:18.811906 25677 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.824817 25577 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.829981 21810 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:18.830703 25725 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:18.835191 25716 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:18.875979 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:18.876716 21810 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:18.827906 25552 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:18.840581 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.843199 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.847898 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:18.850749 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:18.879856 21299 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.852658 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:18.880771 21300 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:18.853243 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:18.765009 25679 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.859835 25664 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.862425 21805 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:18.862495 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.872259 21296 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:18.811616 25717 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.865767 25526 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:18.863343 25694 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.853262 25702 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.706063 25685 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.877627 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:18.882133 21114 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.501s (SENT) [suppressed 13 similar messages]
I20260709 13:08:18.883769 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:18.886214 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 73641.1us
I20260709 13:08:18.879989 25623 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:18.888981 25536 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.906952 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.862836 25378 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:18.910971 21810 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:18.911758 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.897540 21292 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:18.900395 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.861581 25678 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.923550 21292 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:18.903012 25448 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.922860 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:18.927894 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.904847 25564 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.928890 25564 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:18.929456 25564 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:18.930846 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.797418 25534 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.901162 25664 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.942561 25552 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.925616 21292 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:18.948495 21292 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:18.943078 25719 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:18.827373 25578 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:18.960587 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 199909us
I20260709 13:08:18.962777 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:18.963593 21294 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.962991 21293 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:18.969741 21295 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:08:18.971936 21294 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:18.976434 25462 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:18.979704 25638 raft_consensus.cc:2764] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:08:18.981302 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 53474.7us
I20260709 13:08:18.983057 25638 consensus_queue.cc:1048] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:18.950712 21299 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:18.878950 25677 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.990020 25677 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:18.956112 21146 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:18.992477 25684 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.986048 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:19.001876 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 119778us
I20260709 13:08:19.002081 25638 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.003541 25450 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.004109 25450 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:18.993830 25684 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.006304 25450 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:19.007956 25684 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.009778 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:19.010618 25639 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.011582 25639 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.013717 25554 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.013841 25639 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.014178 25554 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:19.014577 25554 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.926537 25543 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:19.024503 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 55487.8us
I20260709 13:08:19.025527 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:19.022596 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 63000.6us
I20260709 13:08:18.939422 25694 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.023962 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:18.924789 25211 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.026420 21296 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:19.030699 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:19.036682 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:18.906315 25683 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.040870 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:19.041987 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.046693 21220 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:08:19.046988 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.048434 21223 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:18.926539 25378 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:19.056413 21264 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:19.022276 25664 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.070508 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:19.032637 25211 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:19.085819 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.947996 25723 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:08:19.051579 25606 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:19.054642 25676 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.064136 25684 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.127396 25396 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:19.128018 25378 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:19.130544 25683 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.088878 25211 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.182734 25396 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:19.136488 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2160) took 1145 ms. Trace:
W20260709 13:08:19.142367 21217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2719) took 1760 ms (client timeout 1501 ms). Trace:
I20260709 13:08:19.194309 21146 rpcz_store.cc:276] 0709 13:08:17.990880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.378977 (+388097us) service_pool.cc:224] Handling call
0709 13:08:19.136307 (+757330us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540017cd54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.136435 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307387648}
I20260709 13:08:19.041720 25577 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:08:19.199913 25396 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.116994 25623 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.201321 25623 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:19.201362 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.202091 25623 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.085137 25383 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.203691 25383 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:19.204242 25383 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.086346 25536 raft_consensus.cc:2764] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:08:19.207824 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.194465 21217 rpcz_store.cc:269] 0709 13:08:17.381648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.381761 (+   113us) service_pool.cc:224] Handling call
0709 13:08:19.142105 (+1760344us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540038ca54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.142270 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497316096}
I20260709 13:08:19.209705 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.210516 21217 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:19.149501 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:19.211686 21294 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.149765 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.216395 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.217159 21221 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:19.181680 25676 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.218254 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.220093 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.221675 21221 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:19.152330 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:19.159543 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.072803 25674 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:08:19.131865 25717 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.229696 25685 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:19.230181 25685 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:19.231040 25685 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.231833 25717 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.232331 25685 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.143157 25450 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.235522 25450 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.237828 21294 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:19.128309 25697 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.202876 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.221076 21217 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:19.181512 25684 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:19.252034 21810 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:19.243173 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:19.218207 25676 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.272029 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1692) took 1401 ms. Trace:
I20260709 13:08:19.272509 21150 rpcz_store.cc:276] 0709 13:08:17.871082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.871212 (+   130us) service_pool.cc:224] Handling call
0709 13:08:18.249607 (+378395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.250312 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.268190 (+1017878us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540031c9d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.271951 (+  3761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838711168}
I20260709 13:08:19.275379 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.164469 25424 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.278877 25675 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:19.181915 25606 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.268819 25684 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.299187 21814 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:19.224079 25543 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:19.302106 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.312112 21150 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:19.298421 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.308986 25675 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:19.309310 25578 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.316679 21149 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:19.333112 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:19.334064 21150 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:19.313292 25717 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:19.316496 25543 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.317919 25675 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.350811 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:19.355156 21142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1693) took 1476 ms (client timeout 1722 ms). Trace:
W20260709 13:08:19.355722 21142 rpcz_store.cc:269] 0709 13:08:17.879366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.252721 (+373355us) service_pool.cc:224] Handling call
0709 13:08:19.354959 (+1102238us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540026a2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.355098 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49171328}
I20260709 13:08:19.357295 21151 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:19.360704 21142 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:19.363961 25591 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.003s
W20260709 13:08:19.364137 25704 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.673s	user 0.003s	sys 0.000s
I20260709 13:08:19.364456 25591 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:19.366555 25591 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:19.366935 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1698) took 1104 ms. Trace:
I20260709 13:08:19.367350 21142 rpcz_store.cc:276] 0709 13:08:18.258126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.360149 (+1102023us) service_pool.cc:224] Handling call
0709 13:08:19.360507 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.361844 (+  1337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.362115 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.367830 21811 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:19.367936 25697 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.368681 21142 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:19.369926 25450 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.371881 21149 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:19.369982 25659 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.380000 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2148) took 1440 ms. Trace:
I20260709 13:08:19.380481 21144 rpcz_store.cc:276] 0709 13:08:17.939100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.299029 (+359929us) service_pool.cc:224] Handling call
0709 13:08:19.379772 (+1080743us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400214b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.379931 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887210880}
W20260709 13:08:19.440282 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.454391 21292 consensus_meta.cc:287] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
I20260709 13:08:19.455399 21292 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:19.455900 21292 pending_rounds.cc:85] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 4
I20260709 13:08:19.456218 21292 pending_rounds.cc:107] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:19.456573 21292 raft_consensus.cc:2889] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.422111 25725 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.461372 25725 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:19.507009 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.343736 25717 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.511353 25612 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.513927 25725 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.514227 25612 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.360546 25543 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.378750 25659 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:19.512859 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 820) took 2084 ms. Trace:
W20260709 13:08:19.422211 25743 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:08:19.517680 25554 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.503s	user 0.002s	sys 0.009s
I20260709 13:08:19.551798 25554 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:19.552453 25734 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:08:19.552980 25612 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.553810 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 817) took 2136 ms. Trace:
I20260709 13:08:19.554072 25554 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.554198 21148 rpcz_store.cc:276] 0709 13:08:17.419166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.430313 (+ 11147us) service_pool.cc:224] Handling call
0709 13:08:17.430629 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.835358 (+1404729us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b180043f480. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd72bfb 00007f2b6dd7d64b
0709 13:08:18.835483 (+   125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.835511 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.835962 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.983195 (+147233us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:18.983249 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.983364 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.553519 (+570155us) raft_consensus.cc:1685] finished
0709 13:08:19.553537 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.553733 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109954,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15131,"spinlock_wait_cycles":11224320,"thread_start_us":277392,"threads_started":2,"wal-append.queue_time_us":246472}
W20260709 13:08:19.515381 25732 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:08:19.559896 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.547233 21143 rpcz_store.cc:276] 0709 13:08:17.428168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.514881 (+ 86713us) service_pool.cc:224] Handling call
0709 13:08:17.515117 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.955405 (+440288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.512620 (+1557215us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540040ea54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:19.512804 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011075840}
I20260709 13:08:19.515429 25717 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:19.518265 25591 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.515566 25668 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:08:19.512058 25526 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:19.571162 25526 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.574398 25526 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.575470 25606 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.633481 25211 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:19.636672 25745 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
W20260709 13:08:19.616806 25564 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.004s
I20260709 13:08:19.644405 25564 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.645892 25684 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.646703 25564 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:19.637517 25672 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.000s
I20260709 13:08:19.670977 25676 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.651616 25383 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.666864 25612 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:19.665663 25526 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:19.673161 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2155) took 1717 ms. Trace:
W20260709 13:08:19.674134 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.608340 25424 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.674896 21151 rpcz_store.cc:276] 0709 13:08:17.955883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.508890 (+553007us) service_pool.cc:224] Handling call
0709 13:08:19.357061 (+848171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.357825 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.672887 (+315062us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540026a2d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:19.673079 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949870976}
W20260709 13:08:19.612496 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 99320.9us
I20260709 13:08:19.593286 25591 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:19.682437 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.023s	sys 0.042s
W20260709 13:08:19.682885 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.023s	sys 0.042s
W20260709 13:08:19.683177 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 658021us
I20260709 13:08:19.689767 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:19.695780 21218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.010s
W20260709 13:08:19.696832 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.698004 21776 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:19.704154 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:19.685949 25564 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.685544 25586 ts_tablet_manager.cc:1929] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:08:19.708422 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:19.695586 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.009s
W20260709 13:08:19.710820 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.009s
W20260709 13:08:19.711472 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 641025us
I20260709 13:08:19.703480 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:19.673399 25623 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.667444 25659 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.706753 25749 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:08:19.677160 25526 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.717922 25554 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:19.771831 25554 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.772290 25554 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:19.772536 25711 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:19.773131 25711 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:19.773420 25554 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.718923 25697 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:19.720142 25742 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.404s	user 0.001s	sys 0.004s
I20260709 13:08:19.774192 25711 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:19.708508 25564 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.777180 25564 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:19.720693 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:19.708882 25586 log.cc:1199] T df140636c4344f32a0253fef2a907c50 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/df140636c4344f32a0253fef2a907c50
W20260709 13:08:19.778149 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 57535.4us
I20260709 13:08:19.780329 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:19.781129 21812 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.001s
I20260709 13:08:19.781540 21812 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:19.781726 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:19.725754 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:19.732359 25676 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.681313 25612 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.706601 25543 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:19.710246 25211 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:19.700014 21218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.005s	sys 0.010s
I20260709 13:08:19.782918 21300 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:19.777675 25554 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.783984 25564 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.787479 25586 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55540 (request call id 92) took 4263 ms. Trace:
I20260709 13:08:19.782094 25547 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.795356 21299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.015s	sys 0.034s
I20260709 13:08:19.793687 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:19.788450 25749 consensus_queue.cc:1243] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:19.801216 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.789182 25659 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.792774 25711 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:19.798631 21299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.015s	sys 0.034s
I20260709 13:08:19.809499 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.811175 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:19.792598 25697 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.792263 25750 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.818048 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.818172 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:19.818763 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:19.837334 21224 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:19.819275 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.795892 25684 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.805110 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:19.797287 25564 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.792548 25322 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:19.825603 25697 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.826550 25591 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.815400 25650 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.784819 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:19.799938 25729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.042s	sys 0.038s
I20260709 13:08:19.831079 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.798584 25543 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:19.835572 25383 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:19.824941 25749 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:19.846935 21805 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
W20260709 13:08:19.847252 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.841666 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.038s	sys 0.158s
W20260709 13:08:19.888665 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.038s	sys 0.159s
I20260709 13:08:19.888900 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:19.889038 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 861925us
I20260709 13:08:19.889487 21805 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:19.890489 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.891049 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:19.891126 21805 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:19.893112 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.894294 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.895177 21805 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:19.896173 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:19.896898 21805 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:19.897898 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:19.871943 21296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.001s	sys 0.013s
I20260709 13:08:19.838815 25750 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.842414 25564 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:19.843068 25627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.022s	sys 0.057s
I20260709 13:08:19.800137 25547 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.848294 25650 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.885123 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:19.885427 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:19.898994 21296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.001s	sys 0.013s
I20260709 13:08:19.901738 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:19.843593 25697 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:19.929976 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.874521 25729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.042s	sys 0.048s
I20260709 13:08:19.901533 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:19.972815 25650 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:19.995685 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 94267.4us
I20260709 13:08:19.997352 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:19.999835 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:20.000489 21143 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.000285 25697 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:19.899287 25749 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:19.956853 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.845418 25534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.006s	sys 0.008s
I20260709 13:08:19.962688 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.013356 21220 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.880400 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.014309 21222 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:19.964880 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:19.859983 25211 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.010872 21143 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
W20260709 13:08:19.875211 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 90501.5us
I20260709 13:08:19.969952 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.018599 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:19.973585 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.020599 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:19.967777 21217 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:19.966899 21148 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:19.993223 25623 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:19.961621 25627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.022s	sys 0.057s
W20260709 13:08:20.014947 25534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.007s	sys 0.009s
I20260709 13:08:19.952373 21144 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:19.905305 25750 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.016273 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:20.121491 21150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.071s
W20260709 13:08:20.121845 21150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.071s
I20260709 13:08:19.979168 21151 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:20.023000 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:20.132076 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:20.132815 21148 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:20.133790 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:20.024971 21813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.025s	sys 0.060s
W20260709 13:08:20.134891 21813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.025s	sys 0.060s
I20260709 13:08:20.028451 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:20.136673 21143 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:20.138064 21143 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:20.029175 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.134441 21148 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:20.024789 25697 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:19.906085 25711 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 13:08:20.006660 25675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.001s	sys 0.017s
I20260709 13:08:20.016819 25211 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.111621 21220 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:20.046304 25751 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:20.112710 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 92226.8us
I20260709 13:08:20.085176 25543 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:20.112114 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 82035.4us
W20260709 13:08:20.187462 25675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.003s	sys 0.024s
I20260709 13:08:19.796406 25586 rpcz_store.cc:276] 0709 13:08:15.524074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.530230 (+  6156us) service_pool.cc:224] Handling call
0709 13:08:16.101631 (+571401us) ts_tablet_manager.cc:1151] Deleting tablet df140636c4344f32a0253fef2a907c50
0709 13:08:16.136431 (+ 34800us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:19.065078 (+2928647us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:19.681992 (+616914us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:19.787385 (+105393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692918,"tablet-delete.queue_time_us":545827,"thread_start_us":180092,"threads_started":1}
I20260709 13:08:20.201768 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:20.210523 21191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.020s	sys 0.024s
W20260709 13:08:20.210980 21191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.020s	sys 0.025s
W20260709 13:08:20.044382 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.013481 25723 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:20.175781 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:20.174688 21149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.048s	sys 0.076s
W20260709 13:08:20.212563 21149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.049s	sys 0.076s
W20260709 13:08:20.182266 21142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.005s	sys 0.019s
W20260709 13:08:20.213083 21142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.006s	sys 0.019s
I20260709 13:08:20.009625 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:20.189601 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:20.214468 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 204911us
I20260709 13:08:20.215237 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:20.081864 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.189543 25211 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.219867 25623 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.259181 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:20.260882 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:20.213732 25434 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.224021 25627 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:20.230192 25751 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.215687 25554 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.291601 25711 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:20.290683 25450 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.227559 25623 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.329133 25434 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.339629 25711 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:20.340737 25450 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:20.346239 25650 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:20.351734 21807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.064s	sys 0.136s
I20260709 13:08:20.315017 25684 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.314816 25591 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:20.363886 21807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.065s	sys 0.136s
I20260709 13:08:20.220710 25723 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:20.334048 25753 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:08:20.392678 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1282) took 1566 ms. Trace:
I20260709 13:08:20.371169 25450 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.399611 25723 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.402869 21807 rpcz_store.cc:276] 0709 13:08:18.826627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.346779 (+520152us) service_pool.cc:224] Handling call
0709 13:08:19.347069 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.351518 (+  4449us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:19.354377 (+  2859us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.354676 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.354922 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.737537 (+382615us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18004430e0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:20.388246 (+650709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.388319 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.388389 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.388479 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.392595 (+  4116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31679,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":34153,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"spinlock_wait_cycles":24758144,"thread_start_us":1033043,"threads_started":1}
I20260709 13:08:20.327989 25748 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:08:20.410989 21807 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:20.414252 21147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.036s	sys 0.041s
W20260709 13:08:20.415408 21263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.014s	sys 0.015s
W20260709 13:08:20.415688 21147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.037s	sys 0.041s
W20260709 13:08:20.416020 21263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.014s	sys 0.015s
W20260709 13:08:20.416482 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 763592us
W20260709 13:08:20.419512 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 158724us
I20260709 13:08:20.353871 25434 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:20.405918 25509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.008s	sys 0.023s
I20260709 13:08:20.429585 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:20.437129 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:20.431835 25756 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:08:20.394377 25591 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.460469 25723 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:20.503175 21812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 1029) took 1908 ms (client timeout 1992 ms). Trace:
I20260709 13:08:20.505861 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:20.510259 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1703) took 2053 ms. Trace:
W20260709 13:08:20.426424 25738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.021s	sys 0.027s
I20260709 13:08:20.462248 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:20.462822 25638 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.467585 21776 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:20.474623 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.475971 25758 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:08:20.477022 25757 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:08:20.519907 25747 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:08:20.506946 25623 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.556890 25717 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.557102 25623 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:20.557426 25717 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.557235 25450 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.557778 25623 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.522699 25591 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:20.552649 25738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.022s	sys 0.027s
I20260709 13:08:20.477916 25749 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:20.493558 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:20.560335 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 66838.8us
I20260709 13:08:20.494045 25526 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.561362 25526 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.561728 25536 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:20.561806 25526 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.428737 25434 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.432482 25627 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.495337 25711 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.529204 21142 rpcz_store.cc:276] 0709 13:08:18.456893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.369916 (+913023us) service_pool.cc:224] Handling call
0709 13:08:19.370416 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.370967 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.370997 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.371540 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.213527 (+841987us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.213577 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.213656 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.510025 (+296369us) raft_consensus.cc:1685] finished
0709 13:08:20.510047 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.510204 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"thread_start_us":841614,"threads_started":1,"wal-append.queue_time_us":1076797}
I20260709 13:08:20.519649 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2743) took 1495 ms. Trace:
I20260709 13:08:20.566125 21218 rpcz_store.cc:276] 0709 13:08:19.023937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.025236 (+  1299us) service_pool.cc:224] Handling call
0709 13:08:19.025581 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.043298 (+ 17717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.043356 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.043901 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.794582 (+750681us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:19.794622 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.798936 (+  4314us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.519350 (+720414us) raft_consensus.cc:1685] finished
0709 13:08:20.519377 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.519571 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6627,"raft.queue_time_us":62121,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4769,"thread_start_us":676060,"threads_started":1,"wal-append.queue_time_us":870490}
I20260709 13:08:20.525149 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2737) took 1504 ms. Trace:
W20260709 13:08:20.527757 21812 rpcz_store.cc:269] 0709 13:08:18.596971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.620746 (+ 23775us) service_pool.cc:224] Handling call
0709 13:08:20.502913 (+1882167us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54006c02d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:20.503064 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032770432}
I20260709 13:08:20.553650 21144 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:20.554499 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 86983.3us
I20260709 13:08:20.571605 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:20.572559 25659 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 13:08:20.572633 25760 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.562963 25627 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.562288 25536 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.397312 25684 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:20.428648 25509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.008s	sys 0.023s
I20260709 13:08:20.568504 21299 rpcz_store.cc:276] 0709 13:08:19.020616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.020754 (+   138us) service_pool.cc:224] Handling call
0709 13:08:19.021087 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.119312 (+ 98225us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:19.141514 (+ 22202us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.821240 (+679726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.821301 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.821342 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.524818 (+703476us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b540001d454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:20.524887 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.525081 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3264,"prepare.queue_time_us":29344,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":79,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1556,"spinlock_wait_cycles":225171328,"thread_start_us":679283,"threads_started":1,"wal-append.queue_time_us":1010497}
I20260709 13:08:20.508255 25650 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.521505 25723 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:20.514014 25672 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:20.576076 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:20.506534 25547 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.557915 25717 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.519992 25554 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:20.588176 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.574150 25749 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.593442 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:20.579027 25536 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:20.586568 21779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.003s	sys 0.028s
W20260709 13:08:20.609784 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.029s
W20260709 13:08:20.596357 21292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.011s	sys 0.020s
W20260709 13:08:20.612771 21292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.011s	sys 0.021s
I20260709 13:08:20.565909 25638 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.619618 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:20.583853 25738 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.518909 25750 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:20.622502 21296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.014s
W20260709 13:08:20.630153 21296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.014s	sys 0.014s
W20260709 13:08:20.617929 25725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.012s	sys 0.021s
W20260709 13:08:20.623190 21217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.009s
I20260709 13:08:20.625468 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:20.635492 21217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.009s
W20260709 13:08:20.622937 21221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.002s	sys 0.017s
I20260709 13:08:20.594197 25659 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.593137 25554 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:20.628122 25686 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:20.595332 25767 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:20.636873 21221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.018s
W20260709 13:08:20.634840 25725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.012s	sys 0.022s
I20260709 13:08:20.648840 21807 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:20.620501 25450 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.655897 21144 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:20.630587 25738 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:20.645740 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 831) took 1572 ms. Trace:
I20260709 13:08:20.594051 25672 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.660005 25675 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.684197 25322 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.696547 25564 consensus_meta.cc:287] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 13:08:20.696318 25322 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:20.697372 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:20.697940 21151 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.678526 25694 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.710832 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:20.711807 21812 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:20.649260 25659 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.665112 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2162) took 2664 ms. Trace:
I20260709 13:08:20.646710 25554 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:20.652012 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 462504us
I20260709 13:08:20.660349 25650 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.634316 25623 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.731426 25650 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.731657 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:20.733641 25650 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.734107 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:20.734599 25509 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:20.735347 25509 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:20.735946 25509 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:20.736048 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:20.737195 24941 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.737715 24941 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:20.736913 25509 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.738175 24941 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.696951 25564 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.752220 21811 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:20.683220 25723 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.753453 25564 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.753751 25322 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.754536 25564 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.755906 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:20.757267 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:20.758148 21151 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:20.739046 25554 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.759557 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2741) took 1613 ms. Trace:
I20260709 13:08:20.760049 21296 rpcz_store.cc:276] 0709 13:08:19.146322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.151235 (+  4913us) service_pool.cc:224] Handling call
0709 13:08:19.151642 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.161786 (+ 10144us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:19.968598 (+806812us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.631243 (+662645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.639815 (+  8572us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.639982 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.640030 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.640119 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.759340 (+119221us) raft_consensus.cc:1685] finished
0709 13:08:20.759364 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.759497 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45537,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":5005,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":14895,"thread_start_us":1359220,"threads_started":2,"wal-append.queue_time_us":501223}
I20260709 13:08:20.762115 25554 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.755118 25564 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.774802 25564 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.775967 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:20.777724 25751 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.780217 21115 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:20.782895 25751 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.784859 25659 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.785827 25684 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.786623 25526 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.788328 25638 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.658625 25767 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:20.790820 25767 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.789326 24941 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.735443 21150 rpcz_store.cc:276] 0709 13:08:18.000550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.356179 (+1355629us) service_pool.cc:224] Handling call
0709 13:08:19.463604 (+107425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.511942 (+ 48338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.512011 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.512550 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.122156 (+609606us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:20.664472 (+542316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.664722 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.664816 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.664865 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:20.664882 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.665044 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47848,"prepare.queue_time_us":511281,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":67035,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":34336,"thread_start_us":1048891,"threads_started":2,"wal-append.queue_time_us":858923}
I20260709 13:08:20.682955 25211 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:20.807883 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 825) took 1771 ms (client timeout 2228 ms). Trace:
W20260709 13:08:20.808413 21146 rpcz_store.cc:269] 0709 13:08:19.036229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.279056 (+242827us) service_pool.cc:224] Handling call
0709 13:08:20.807649 (+1528593us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540031bfd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:20.807813 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039606144}
W20260709 13:08:20.797077 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.013s	sys 0.016s
W20260709 13:08:20.809890 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.013s	sys 0.016s
W20260709 13:08:20.811115 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 813769us
W20260709 13:08:20.802511 21190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.018s	sys 0.022s
W20260709 13:08:20.818811 21808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1199) took 2307 ms (client timeout 1895 ms). Trace:
I20260709 13:08:20.708712 25675 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:20.827047 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:20.828140 21190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.018s	sys 0.022s
W20260709 13:08:20.829315 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.832466 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.833249 21218 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.834678 21220 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:20.837674 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.839588 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:20.827199 21808 rpcz_store.cc:269] 0709 13:08:18.507180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.507302 (+   122us) service_pool.cc:224] Handling call
0709 13:08:20.813524 (+2306222us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:20.813652 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32270592}
I20260709 13:08:20.713472 25694 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.846472 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.847237 21226 raft_consensus.cc:2368] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
W20260709 13:08:20.824092 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.843209 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.803184 25738 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:20.850565 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.851150 21223 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:20.845715 21115 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:20.805764 25534 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:20.842300 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:20.854739 21808 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:20.825273 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.855990 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 183408us
W20260709 13:08:20.856669 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.858744 21296 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.859380 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.858798 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:20.859962 21299 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:20.861034 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.862555 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.863137 21293 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:20.816430 25627 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:20.848080 25696 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 2.322s	user 0.004s	sys 0.003s
I20260709 13:08:20.866711 21224 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:20.867439 21218 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:20.869130 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:20.866219 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.872824 21812 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:20.876572 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.876597 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.878130 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.881320 21298 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.881278 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:20.880554 21291 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
W20260709 13:08:20.860325 25708 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.011s	sys 0.011s
I20260709 13:08:20.886461 21297 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:20.887264 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.888346 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.896835 21294 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:20.890395 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.898089 21808 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:20.900096 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.903100 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.903923 21218 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:20.904747 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:20.909755 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.910653 21218 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:20.849787 25638 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:20.914330 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:20.915899 21293 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:20.926542 21298 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:20.930446 21296 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.930614 21300 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:20.930490 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:20.932224 21295 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:20.932659 21808 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.877077 25697 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.930712 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:20.935765 21294 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:08:20.936955 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:20.937222 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:20.888051 25774 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.886940 25591 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:20.909005 25708 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.011s	sys 0.011s
I20260709 13:08:20.944813 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.054025 21297 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:21.054503 25784 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:20.889535 25543 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:21.055048 25784 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.055382 25543 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:20.949263 21808 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:21.057474 25784 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:21.058068 25784 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:21.058324 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:21.059553 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:21.060566 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.061406 21225 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:21.061910 21808 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.062191 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:21.062629 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1280) took 2251 ms. Trace:
I20260709 13:08:20.937872 21295 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
W20260709 13:08:20.935446 25679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.009s	sys 0.018s
I20260709 13:08:21.063149 21810 rpcz_store.cc:276] 0709 13:08:18.811635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.943658 (+132023us) service_pool.cc:224] Handling call
0709 13:08:18.944024 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.269363 (+325339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.062314 (+1792951us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540035aa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:21.062537 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679807232}
W20260709 13:08:21.063971 25679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.009s	sys 0.018s
I20260709 13:08:21.064121 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2745) took 1491 ms. Trace:
I20260709 13:08:21.064554 21292 rpcz_store.cc:276] 0709 13:08:19.572764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.572966 (+   202us) service_pool.cc:224] Handling call
0709 13:08:19.573356 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.574025 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.574067 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.574594 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.614892 (+1040298us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.614930 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.614998 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.063883 (+448885us) raft_consensus.cc:1685] finished
0709 13:08:21.063908 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.064061 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":1039959,"threads_started":1,"wal-append.queue_time_us":1448713}
I20260709 13:08:21.067051 21808 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.019840 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.020393 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.068583 21222 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:21.072940 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1201) took 1271 ms. Trace:
I20260709 13:08:21.073451 21811 rpcz_store.cc:276] 0709 13:08:19.801113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.801246 (+   133us) service_pool.cc:224] Handling call
0709 13:08:21.072690 (+1271444us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54004ee154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:21.072871 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102106496}
I20260709 13:08:21.020560 25788 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:21.023954 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.024688 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:21.031527 25750 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.078264 25672 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.085415 25679 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.086007 25679 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.088442 25679 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.088529 25564 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.089193 25564 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.090488 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:21.091423 21147 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:20.872627 25623 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:08:21.034248 25211 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:20.938432 25526 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:20.913981 25767 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:08:21.115428 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.116372 21294 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:21.036793 25694 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.040402 25675 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.049491 25684 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:20.924531 25638 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.051316 25591 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:21.052161 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:21.093145 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.094369 21147 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:21.147845 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.149080 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.032030 25774 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.094614 21151 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:08:21.094899 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.943683 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:21.095444 21808 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:21.058431 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:21.102936 21144 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.929931 25783 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.131659 21150 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [8.6-12.8]
I20260709 13:08:21.134645 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.157258 21292 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:20.945230 25583 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.099355 25781 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.057474 25543 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.110441 25526 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.030887 25536 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.106318 25679 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:21.163847 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.167034 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.177492 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:21.178586 25434 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 13:08:21.179278 25638 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:21.179931 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.211741 21144 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:21.188410 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:21.184568 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 207103us
I20260709 13:08:21.140666 25684 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.215130 21150 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:21.219409 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:21.218000 25434 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.230198 25434 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.151679 25750 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:21.177008 25717 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.003s
I20260709 13:08:21.232511 21224 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:21.181535 25526 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.247613 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.138236 25773 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:08:21.225936 25684 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.212173 25785 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:21.252645 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.253958 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.243531 25627 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.248329 21144 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:21.254691 21147 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:21.234735 24941 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.266212 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.182430 25781 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.267398 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:21.164847 25783 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.268940 25774 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.249752 25564 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.277549 21812 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:21.278885 21812 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:21.283763 25780 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:08:21.288704 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 464833us
I20260709 13:08:21.269440 25627 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.303618 24941 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.304123 24941 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.305404 25627 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:21.306210 24941 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.308331 21150 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:21.311524 25536 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.231598 25679 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:21.313015 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 467356us
I20260709 13:08:21.313822 25679 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.314272 25536 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:21.315917 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:21.316571 25536 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.316998 25536 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:21.317257 21291 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:21.317698 21291 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:21.261030 25591 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.320093 25679 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:21.321557 25534 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:21.246536 25717 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.323926 25717 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.246297 25750 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.322175 25534 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.225244 25584 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:21.317830 25536 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.254432 25672 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.328696 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1283) took 2501 ms. Trace:
I20260709 13:08:21.332145 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1190) took 2892 ms. Trace:
W20260709 13:08:21.317925 25749 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.000s
I20260709 13:08:21.334429 21814 rpcz_store.cc:276] 0709 13:08:18.826924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.346824 (+519900us) service_pool.cc:224] Handling call
0709 13:08:21.327948 (+1981124us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:08:21.328163 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.328398 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.328434 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.328488 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:21.328517 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.328563 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.328650 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10436992}
W20260709 13:08:21.341784 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 452041us
I20260709 13:08:21.345456 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:21.346520 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:21.349610 21217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.020s	sys 0.048s
W20260709 13:08:21.350132 21217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.020s	sys 0.048s
I20260709 13:08:21.183883 21151 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 9: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:21.346033 21147 raft_consensus.cc:2376] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10. Re-sending same reply.
I20260709 13:08:21.365842 21223 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:21.318640 21291 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.368173 21291 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.336831 21813 rpcz_store.cc:276] 0709 13:08:18.439672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.454142 (+ 14470us) service_pool.cc:224] Handling call
0709 13:08:18.473781 (+ 19639us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:08:18.507600 (+ 33819us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:19.313567 (+805967us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b180042e920. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:08:20.135323 (+821756us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.669326 (+534003us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:20.679483 (+ 10157us) log.cc:844] Serialized 78 byte log entry
0709 13:08:20.679646 (+   163us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:20.679928 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.697596 (+ 17668us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.859533 (+161937us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.873863 (+ 14330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.874193 (+   330us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.327865 (+453672us) raft_consensus.cc:1685] finished
0709 13:08:21.327886 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.332067 (+  4181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35584,"prepare.queue_time_us":462863,"prepare.run_cpu_time_us":168,"prepare.run_wall_time_us":9561,"raft.queue_time_us":167686,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":62505,"spinlock_wait_cycles":8158208,"thread_start_us":1456452,"threads_started":3,"wal-append.queue_time_us":746073}
I20260709 13:08:21.372141 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:21.372442 21150 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:21.375924 21144 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:21.378398 25788 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.378877 25788 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:21.379279 25788 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.386412 21291 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:08:21.386873 21291 pending_rounds.cc:85] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 5
I20260709 13:08:21.387095 21291 pending_rounds.cc:107] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:08:21.387354 21291 raft_consensus.cc:2889] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.334196 25383 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.398413 25788 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.430565 25678 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.431555 25788 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.432144 25788 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:21.399910 25789 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:08:21.436363 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2161) took 3443 ms. Trace:
I20260709 13:08:21.436442 25684 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.436751 21145 rpcz_store.cc:276] 0709 13:08:17.992587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.851484 (+858897us) service_pool.cc:224] Handling call
0709 13:08:18.851789 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.859503 (+  7714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.859534 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.491889 (+1632355us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b2c000014c8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:20.492306 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.865894 (+373588us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.888119 (+ 22225us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.331885 (+443766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.331963 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.436069 (+104106us) raft_consensus.cc:1685] finished
0709 13:08:21.436170 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.436303 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42740,"prepare.queue_time_us":22291,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":164622,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":4958,"spinlock_wait_cycles":9829120,"thread_start_us":792623,"threads_started":2,"wal-append.queue_time_us":714352}
I20260709 13:08:21.438423 25684 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.440351 25678 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.440961 25678 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.441833 25623 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:21.442245 25623 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:21.443755 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 716) took 1472 ms. Trace:
I20260709 13:08:21.444262 21217 rpcz_store.cc:276] 0709 13:08:19.970861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.027688 (+ 56827us) service_pool.cc:224] Handling call
0709 13:08:20.027986 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.635971 (+607985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.636014 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.636588 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.350614 (+714026us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:21.350659 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.350747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.443481 (+ 92734us) raft_consensus.cc:1685] finished
0709 13:08:21.443508 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.443666 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":299311,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3967,"thread_start_us":1273680,"threads_started":2,"wal-append.queue_time_us":778020}
I20260709 13:08:21.417254 25783 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.340574 25672 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.415649 25750 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:20.690555 21149 rpcz_store.cc:276] 0709 13:08:19.073769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.372640 (+298871us) service_pool.cc:224] Handling call
0709 13:08:19.476808 (+104168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.514366 (+ 37558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.514396 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.514829 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.213024 (+698195us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:20.645071 (+432047us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.645353 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.645445 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.645496 (+    51us) raft_consensus.cc:1685] finished
0709 13:08:20.645514 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.645671 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34723,"prepare.queue_time_us":452066,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1738,"raft.queue_time_us":40805,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":36185,"thread_start_us":1118919,"threads_started":2,"wal-append.queue_time_us":919256}
I20260709 13:08:21.443061 25623 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.450124 25623 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.453598 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.454246 21291 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.454864 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:21.461143 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.464475 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.465603 21292 raft_consensus.cc:2410] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:21.468448 25450 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.469146 25450 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:21.470237 25450 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.471740 25819 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.476944 25781 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:21.484561 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 269842us
I20260709 13:08:21.485771 21190 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.486620 25773 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:21.487030 25773 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:21.487897 25773 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.428969 25612 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.260815 25785 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:21.491780 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 224626us
I20260709 13:08:21.445386 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1276) took 2650 ms. Trace:
I20260709 13:08:21.493561 21806 rpcz_store.cc:276] 0709 13:08:18.795158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.799192 (+  4034us) service_pool.cc:224] Handling call
0709 13:08:20.814280 (+2015088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.814457 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.814480 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.814520 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.814551 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.814601 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.445215 (+630614us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400477550. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:21.445325 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4627068800}
I20260709 13:08:21.494647 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:21.496106 25767 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:21.497427 25767 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:21.497723 25678 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.498092 25785 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:21.498733 25672 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.499462 25543 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:21.500324 25708 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:21.500681 25708 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:21.501341 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.501488 25708 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.502683 25708 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.504465 25752 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.505007 25752 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:21.505949 25752 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.507622 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.509379 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.509588 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.510769 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.497539 25773 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.511751 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:21.511906 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.512542 21296 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:21.512669 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 51632.1us
I20260709 13:08:21.507663 25396 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.514604 25810 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.512048 25748 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.512358 25650 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.513329 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:18.558934 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.506645 21291 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
W20260709 13:08:21.518592 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.449333 25587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.096s	user 0.008s	sys 0.030s
I20260709 13:08:21.519052 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.521189 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.522008 21292 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:21.510432 25583 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.285806 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet df140636c4344f32a0253fef2a907c50 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
W20260709 13:08:21.519975 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 576349us
W20260709 13:08:21.522646 21033 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 1.23678e+06us
I20260709 13:08:21.524101 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.524796 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.525018 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.525345 21295 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.517940 21778 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.526340 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.527949 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.522845 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:21.529196 21264 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:21.498960 25767 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:21.539985 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:21.559762 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1195) took 3100 ms. Trace:
I20260709 13:08:21.562870 21146 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:21.563416 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.527737 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:21.520421 25587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.186s	user 0.009s	sys 0.030s
I20260709 13:08:21.568846 21224 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:21.570339 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.578584 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.578960 21220 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:21.573580 21291 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.580720 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.574677 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:21.575019 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 59509.7us
I20260709 13:08:21.582319 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.583201 21298 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:21.583698 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56035.9us
I20260709 13:08:21.511914 25746 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.594028 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:21.594143 21291 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:21.630577 21291 pending_rounds.cc:85] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:21.630838 21291 pending_rounds.cc:107] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:21.631057 21291 raft_consensus.cc:2889] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.595647 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 715) took 1625 ms. Trace:
I20260709 13:08:21.582585 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:21.519831 25700 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:21.623378 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.560221 21809 rpcz_store.cc:276] 0709 13:08:18.459854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.460692 (+   838us) service_pool.cc:224] Handling call
0709 13:08:18.460959 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.468845 (+  7886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.468887 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.481688 (+ 12801us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.798550 (+2316862us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b18004583e0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:08:21.191442 (+392892us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:21.529014 (+337572us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.529456 (+   442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.529558 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.529611 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:21.559549 (+ 29938us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.559707 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28465,"prepare.queue_time_us":56591,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":35,"raft.queue_time_us":16673,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":24177,"spinlock_wait_cycles":20491136,"thread_start_us":676132,"threads_started":2,"wal-append.queue_time_us":2797007}
I20260709 13:08:21.527825 25750 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:21.655872 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 278806us
I20260709 13:08:21.640465 21223 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:21.643085 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.531026 25751 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:21.652365 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72865us
W20260709 13:08:21.652431 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 69903.4us
I20260709 13:08:21.530246 25639 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.564606 25819 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.683386 21220 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:21.684260 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:21.660744 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:21.662214 21291 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.566855 25627 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.530476 25785 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.593653 25686 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.683606 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:21.579425 25672 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.679363 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.580310 25717 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.637576 25803 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.682551 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:21.686187 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 175192us
I20260709 13:08:21.632061 21221 rpcz_store.cc:276] 0709 13:08:19.970205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.027557 (+ 57352us) service_pool.cc:224] Handling call
0709 13:08:20.027812 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.028005 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:20.650194 (+622189us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.131312 (+481118us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.446093 (+314781us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180022db00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:21.483917 (+ 37824us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b180022db00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b71c4e58f 00007f2b6ac8d571 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd
0709 13:08:21.595230 (+111313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.595404 (+   174us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:21.595446 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.595503 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.595601 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341419,"prepare.queue_time_us":857606,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4239,"raft.queue_time_us":80801,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":34294,"spinlock_wait_cycles":69431936,"thread_start_us":1482522,"threads_started":3,"wal-append.queue_time_us":619081}
I20260709 13:08:21.618232 25547 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:21.694219 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 378991us
I20260709 13:08:21.699548 21298 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.559082 24941 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
W20260709 13:08:21.704206 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.641242 25778 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.593961 25805 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.688462 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.682911 25697 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.655504 25750 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.718567 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.722697 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.724460 21296 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:21.642545 25700 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:21.688458 25801 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:08:21.665328 25751 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.773476 25751 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.777904 25584 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.778339 25584 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:21.711966 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.703495 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:21.780351 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 76977us
I20260709 13:08:21.695906 25672 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.742857 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:21.743893 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60334.8us
I20260709 13:08:21.530853 25650 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.617538 25612 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:08:21.789701 25612 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.789870 25686 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.790195 25612 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:08:21.753669 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 43521.6us
I20260709 13:08:21.791326 25650 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:21.752574 21224 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:21.641798 25729 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:08:21.707074 25760 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:21.772313 25700 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.782855 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:21.783612 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.804636 21221 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:21.709568 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.722011 25717 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.787703 21223 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:21.794011 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.805519 21218 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:21.750736 25697 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:21.756455 25750 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:21.839164 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45262.3us
I20260709 13:08:21.778903 25746 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.847559 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.862411 21805 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:21.862762 21805 pending_rounds.cc:85] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 8
I20260709 13:08:21.862990 21805 pending_rounds.cc:107] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:21.793783 25672 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.755100 25819 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:21.748914 25725 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.729441 25785 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.746666 25587 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:21.863214 21805 raft_consensus.cc:2889] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.863214 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:21.755235 25767 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:08:21.865052 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.806759 25450 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.840871 25717 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:21.857638 25694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.051s	sys 0.091s
I20260709 13:08:21.870366 21295 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:21.871116 25807 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:08:21.845331 25434 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:21.791354 25612 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:21.875684 25534 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:08:21.876209 25746 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.867334 25811 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.844980 25684 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.844851 25627 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.879730 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.744994 25778 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:21.875254 21291 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:21.882910 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:21.850354 25584 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.898839 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:21.973691 21293 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:21.859088 25697 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.868054 25819 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:21.906616 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 164719us
W20260709 13:08:21.907766 25694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.052s	sys 0.091s
I20260709 13:08:21.896227 25776 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.901131 25591 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:21.982359 21219 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:21.908479 25587 consensus_queue.cc:1243] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:21.979790 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:21.953346 25711 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.894003 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:21.994259 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:21.995287 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 101371us
I20260709 13:08:21.996269 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:21.963747 25772 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:21.956283 25282 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.894970 25725 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:21.984791 25751 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:21.988675 25752 consensus_queue.cc:1175] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e66e7254b764832b244bb5b07b4a208" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:21.992087 25785 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:21.966126 25684 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:21.960320 25760 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:21.993485 25591 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:21.998190 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 136467us
I20260709 13:08:21.906334 25817 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:08:22.014885 25725 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:22.000694 25790 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:21.907938 25450 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.000496 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:21.989070 25434 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:22.001994 25584 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.955948 25814 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:08:21.956203 25534 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.032307 25211 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:08:21.997725 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 198899us
I20260709 13:08:21.994508 25711 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:21.999452 25543 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.076844 25543 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:22.077265 25543 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.999583 25686 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.001983 25587 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.016898 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:22.017773 25805 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.018822 25536 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.019364 25730 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:21.999672 25749 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:08:22.011814 25526 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 13:08:22.000931 25623 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:22.027204 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.028666 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.081750 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1041) took 2278 ms. Trace:
I20260709 13:08:22.029803 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.092223 21809 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:22.000001 25282 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:22.004698 25708 consensus_meta.cc:287] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 13:08:22.030315 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.093263 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.093436 21808 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:22.026508 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:22.094343 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:22.094658 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 68249.1us
I20260709 13:08:22.035915 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.095422 25686 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:22.096242 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.094338 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.097350 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.098018 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.098460 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.009685 25684 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.039510 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.098723 21809 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:22.038064 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.100168 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.100519 21811 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:22.100906 21809 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:22.013960 25817 consensus_queue.cc:1059] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:22.037714 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:21.982049 25819 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.024235 25591 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.997668 25776 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.045871 25534 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:22.040925 25725 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:08:22.047729 25676 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:22.053635 21812 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:22.041890 25434 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.109002 25676 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.109519 25676 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.109907 25676 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.063881 25778 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:22.084993 25583 consensus_meta.cc:287] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.555s	user 0.001s	sys 0.009s
I20260709 13:08:22.111567 25583 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:22.112090 25773 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.001s
I20260709 13:08:22.111985 25526 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.114283 25526 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:22.115115 21294 raft_consensus.cc:2368] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14.
I20260709 13:08:22.064293 21813 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:22.119287 25725 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:22.121887 25434 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.057750 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.122195 25612 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:22.122581 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 64938.8us
I20260709 13:08:22.023862 25751 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.035480 25509 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:08:22.042440 25816 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:22.071380 25450 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.126204 25627 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.090873 25805 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.126307 25450 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:22.126729 25627 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:22.092046 25536 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.127683 25627 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.128785 25450 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.036791 25767 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.075699 25760 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.129334 25536 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:22.090566 25383 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.130235 25383 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:22.131070 25383 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.076391 25746 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.081720 25750 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.131848 25700 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.132513 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.090165 25730 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:22.134420 21807 raft_consensus.cc:2368] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:22.134127 25730 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.135548 25730 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.136489 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.137059 21225 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.138442 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.041031 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.082059 25270 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:22.139540 21810 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:22.139744 25270 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:22.140107 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.140610 25270 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.141181 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.141916 25270 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.142233 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:22.109104 25831 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:08:22.091831 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 64706.6us
I20260709 13:08:22.141253 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.131542 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2175) took 1024 ms. Trace:
I20260709 13:08:22.097384 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:22.095290 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:22.114217 25672 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:22.088006 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 71180us
I20260709 13:08:22.128095 25805 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:22.144035 21221 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.144562 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.144256 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:22.084215 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 84314.6us
I20260709 13:08:22.163960 21222 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:22.143568 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.164970 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.166092 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.147909 21191 leader_election.cc:400] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14.
I20260709 13:08:22.147979 25778 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:22.168485 25778 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.147989 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.169593 21220 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.148388 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.170392 21298 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:22.170512 25778 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:22.148653 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 53453.4us
I20260709 13:08:22.143225 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.146018 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.173485 21294 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:22.145992 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.150563 21296 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.143929 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.178375 21298 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:22.151718 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.181074 21225 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:22.181754 21814 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.147734 21148 rpcz_store.cc:276] 0709 13:08:21.107235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.107396 (+   161us) service_pool.cc:224] Handling call
0709 13:08:21.107779 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.108158 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.108196 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.128065 (+ 19869us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.674802 (+546737us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:21.674841 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.674909 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.131325 (+456416us) raft_consensus.cc:1685] finished
0709 13:08:22.131344 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.131489 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34805,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9553,"thread_start_us":494675,"threads_started":1,"wal-append.queue_time_us":735129}
I20260709 13:08:22.092191 21805 rpcz_store.cc:276] 0709 13:08:19.803036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.959026 (+155990us) service_pool.cc:224] Handling call
0709 13:08:19.959410 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.890766 (+1931356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.081458 (+190692us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54004781d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:22.081677 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4375750528}
I20260709 13:08:22.177327 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.149039 25509 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.189402 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.150067 25711 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.190600 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.191215 21218 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.191515 25711 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.189519 25509 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.188145 25526 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.183292 21224 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:22.195596 25814 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.200626 25814 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.195911 25509 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.201113 25814 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.129165 25450 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:22.203063 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.200271 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.203348 25450 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.204715 25805 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.204913 25450 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.196276 25526 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.208515 25526 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:22.212569 21048 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 364) took 26677 ms (client timeout 15000 ms). Trace:
I20260709 13:08:22.212975 25819 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.213573 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:22.214453 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.216069 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet df140636c4344f32a0253fef2a907c50 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:55540
I20260709 13:08:22.217911 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.222728 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.223345 21226 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.225342 21221 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:22.182348 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.231444 21220 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:22.226186 25839 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.147856 25749 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.239530 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.244664 21295 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:22.253808 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.198009 21218 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:22.246977 21264 leader_election.cc:400] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:22.247956 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.248425 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.254956 21264 leader_election.cc:403] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.255249 21809 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:22.256217 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.257223 21807 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:22.257843 21806 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:22.258250 21116 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:22.253634 21805 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:22.260643 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:22.198189 25591 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.263698 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:22.265138 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.257525 25810 raft_consensus.cc:2764] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:22.215144 25819 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:22.234932 25839 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.375470 21299 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:22.384004 21226 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:22.162391 25783 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:08:22.347962 21814 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:22.349153 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.350284 21807 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:08:22.360179 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 113354us
I20260709 13:08:22.389541 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.391618 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.390894 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:22.355036 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 94460.5us
I20260709 13:08:22.363466 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:22.364853 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.398108 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:22.363839 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.399677 21114 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:22.400245 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.373795 21805 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [8.9-12.11]
W20260709 13:08:22.213037 21048 rpcz_store.cc:269] 0709 13:07:55.535506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.535756 (+   250us) service_pool.cc:224] Handling call
0709 13:08:22.212466 (+26676710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.320372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.320998 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.321051 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:08:16.321070 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:16.322116 (+  1046us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.322212 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.322239 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:16.323111 (+   872us) tablet.cc:701] Row locks acquired
0709 13:08:16.323161 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:08:16.326794 (+  3633us) write_op.cc:270] Start()
0709 13:08:16.326962 (+   168us) write_op.cc:276] Timestamp: P: 1783602496326549 usec, L: 0
0709 13:08:16.326981 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.327751 (+   770us) log.cc:844] Serialized 3646 byte log entry
0709 13:08:17.096708 (+768957us) op_driver.cc:464] REPLICATION: finished
0709 13:08:17.212251 (+115543us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6ac700ac 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b717b0ef0
0709 13:08:17.994788 (+782537us) write_op.cc:301] APPLY: starting
0709 13:08:17.995387 (+   599us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.305999 (+310612us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.306027 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.318382 (+ 12355us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.318626 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:08:18.318669 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:18.318933 (+   264us) log.cc:844] Serialized 89 byte log entry
0709 13:08:18.510656 (+191723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.510794 (+   138us) write_op.cc:454] Released schema lock
0709 13:08:18.510848 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.589276 (+ 78428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.589305 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1773,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":887488,"apply.run_cpu_time_us":63960,"apply.run_wall_time_us":564597,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":232603,"prepare.run_cpu_time_us":14042,"prepare.run_wall_time_us":134392,"raft.queue_time_us":241874,"raft.run_cpu_time_us":27424,"raft.run_wall_time_us":409874,"replication_time_us":769550,"spinlock_wait_cycles":3088768,"thread_start_us":927968,"threads_started":5,"wal-append.queue_time_us":863141,"wal-append.run_cpu_time_us":56765,"wal-append.run_wall_time_us":2248559}]]}
I20260709 13:08:22.264206 25623 consensus_queue.cc:1059] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:22.370985 25383 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.387339 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.360052 25842 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.351702 25536 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.405539 24941 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:22.386605 25839 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.401839 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:22.420493 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:22.200150 25543 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.346408 25672 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:22.425247 25815 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:22.352099 25659 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.424837 25717 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.385809 25803 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:22.434224 25790 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.437119 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 272683us
I20260709 13:08:22.544409 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.437850 25767 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:22.438517 25774 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:22.546363 21225 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.386946 25697 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.439311 21046 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 6, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 6 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:22.446908 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44547.6us
I20260709 13:08:22.554579 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:22.554744 21190 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:22.451576 25810 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:22.455806 25750 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.457983 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:22.460865 25282 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.562314 25282 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.562690 25543 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.406023 25811 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.142s
W20260709 13:08:22.473798 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.477880 25838 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.431s	user 0.004s	sys 0.000s
I20260709 13:08:22.479280 25700 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.481281 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:22.568557 21295 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:22.419384 21219 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:22.486905 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:22.365346 25776 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.391502 25686 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:22.570082 25686 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.570470 25686 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:22.492655 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72232.9us
I20260709 13:08:22.572592 25591 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:22.573179 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:22.510272 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.269961 25749 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.361944 25843 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:22.421216 25785 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.587785 25785 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:22.588243 25785 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.587538 21046 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 2 to 5, 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1), VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2), VOTER 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3), VOTER 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 7 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:22.483561 25211 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:22.589813 21046 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 10, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.425019 25802 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.591837 25211 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:22.592706 25211 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.597889 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.530434 25773 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:22.600656 21299 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:22.580716 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:22.582942 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:22.608872 21297 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.425247 25383 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.614948 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.615988 21293 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:22.600492 25773 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.439621 25766 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:22.653630 25766 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:22.487807 25678 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:08:22.609807 25781 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.655194 25781 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.655392 25844 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.655681 25781 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.655880 25844 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:22.656769 25844 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.546782 25322 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:22.658965 25322 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:22.660064 25322 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.615855 25778 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:22.663298 25778 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:22.535861 25760 consensus_queue.cc:1059] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:08:22.547281 25659 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:22.630481 25684 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.531s	user 0.003s	sys 0.004s
I20260709 13:08:22.678450 25583 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.675401 25783 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:22.611940 25811 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.617131 25591 raft_consensus.cc:2764] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:22.682446 25659 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:22.638255 25814 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.639487 25803 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.556162 25790 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.644251 25749 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:22.650478 21217 raft_consensus.cc:2410] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:08:22.652675 21297 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:22.654639 25802 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.543102 25536 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.667661 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 87038.4us
W20260709 13:08:22.675686 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 121051us
W20260709 13:08:22.669782 25612 consensus_meta.cc:287] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.005s
I20260709 13:08:22.691658 25678 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.698661 21295 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:22.699584 25790 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:22.665480 25844 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:22.715235 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 371578us
I20260709 13:08:22.610582 25509 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.720770 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.721289 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.765239 21151 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:22.724908 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.725399 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.766806 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.725494 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.769613 21147 raft_consensus.cc:2393] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:22.727623 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.718746 24941 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:22.716754 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.770663 21145 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:22.755793 21292 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:08:22.772920 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.756148 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:22.723246 21146 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:22.774730 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.775609 21149 raft_consensus.cc:2410] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:22.775771 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:22.738938 21046 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.802366 21150 raft_consensus.cc:1240] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [8.6-12.8]
I20260709 13:08:22.781165 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:22.689852 25684 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.807567 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.784411 24941 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.809312 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.816277 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.819100 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.819932 21151 raft_consensus.cc:2393] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:22.823858 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.825168 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.825407 21150 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:22.768414 25612 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.816355 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:22.829350 21293 raft_consensus.cc:2410] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:22.774073 25790 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:22.834370 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 53307.7us
W20260709 13:08:22.810968 25526 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.006s
I20260709 13:08:22.780081 25700 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.740688 25536 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.745244 25774 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:08:22.745334 25678 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:22.798671 21210 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.036s	sys 0.062s
I20260709 13:08:22.838718 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.838723 25805 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:22.925114 21142 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.834988 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.869330 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:22.768723 25547 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.839792 21296 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.876929 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:22.881506 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:22.942891 21144 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.908542 21210 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.039s	sys 0.062s
I20260709 13:08:22.724278 25802 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:22.868026 25450 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:08:22.817344 25845 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.916563 21223 raft_consensus.cc:2376] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11. Re-sending same reply.
I20260709 13:08:22.925117 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.844175 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.883212 21145 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:22.867786 25676 consensus_meta.cc:287] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.006s
I20260709 13:08:22.946520 25547 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.837121 25785 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.975456 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.923779 25805 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.953349 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:22.953842 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.947688 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:22.885215 25697 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:22.915328 25711 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.001s
I20260709 13:08:22.970104 21809 raft_consensus.cc:2410] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:22.924578 25859 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:22.867368 25790 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:22.993520 21222 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:22.984951 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.994796 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.995592 21226 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:22.868577 25526 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.874540 25700 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:22.884546 25861 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:23.002956 21291 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:23.009356 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.989202 25805 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.020538 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:22.832734 25612 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:22.989506 25211 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.954754 25623 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:23.036639 21148 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 8.
I20260709 13:08:23.039152 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:22.970155 25676 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.045590 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.051405 21223 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.014822 25773 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:23.062345 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 289485us
I20260709 13:08:23.066097 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:22.988755 25857 raft_consensus.cc:2764] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:08:23.083283 25857 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.085527 25766 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.086851 25766 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.034531 25814 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:23.093096 25834 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.047s	user 0.003s	sys 0.005s
I20260709 13:08:23.095691 25717 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.097386 25790 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:23.037791 25211 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.071553 25860 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:23.072500 25855 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:08:23.074376 25847 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:08:23.075419 25509 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.076889 25547 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:23.078398 25526 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:23.079836 25686 consensus_meta.cc:287] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:08:23.081169 25802 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.082463 25678 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.054172 25612 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.101354 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.045856 21144 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
W20260709 13:08:23.103981 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.104628 21046 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 2 to 8, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 8 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.999104 25859 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.112823 21218 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:23.134249 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 246872us
I20260709 13:08:23.141717 21223 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:23.106674 25211 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.133869 25773 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:23.142549 25684 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:23.177030 21150 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 5.
I20260709 13:08:23.180575 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet df140636c4344f32a0253fef2a907c50 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
I20260709 13:08:23.198506 25612 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.157356 25678 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:23.163189 25752 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:23.224869 25678 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.225013 25752 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.226902 25678 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.204573 25870 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:23.208545 25766 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:23.212908 25781 consensus_meta.cc:287] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.004s
I20260709 13:08:23.215036 25211 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:23.215667 25282 consensus_meta.cc:287] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.001s
W20260709 13:08:23.230880 25856 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:08:23.219511 25676 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.221087 25859 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.221920 25700 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:23.174124 25773 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:23.224195 25839 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.000s
I20260709 13:08:23.175180 25536 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.146160 25686 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:23.204706 21097 auto_rebalancer.cc:629] Failed to schedule move for tablet a4a7d35cd96a44f7ab838841678c5b17: Illegal state: Replica f81bf1abd0b34f518d1f2b79cc4dba77 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:08:23.227452 25851 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:08:23.227872 25785 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.226975 25752 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:23.228590 25867 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:23.265702 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2763) took 1739 ms. Trace:
W20260709 13:08:23.218636 25842 consensus_meta.cc:287] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.000s
I20260709 13:08:23.266956 25842 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:23.267804 25686 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.268193 21298 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.234781 25781 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:23.241403 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 397301us
I20260709 13:08:23.243516 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2775) took 1039 ms. Trace:
I20260709 13:08:23.269914 21225 rpcz_store.cc:276] 0709 13:08:22.204349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.243219 (+ 38870us) service_pool.cc:224] Handling call
0709 13:08:22.365973 (+122754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.546915 (+180942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.243184 (+696269us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000fc654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:23.243438 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414292864}
W20260709 13:08:23.258286 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 93430.2us
W20260709 13:08:23.238855 25846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.009s
I20260709 13:08:23.264623 25773 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.266224 21300 rpcz_store.cc:276] 0709 13:08:21.526380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.537658 (+ 11278us) service_pool.cc:224] Handling call
0709 13:08:21.594132 (+ 56474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.595620 (+  1488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.595648 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.171831 (+576183us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b180009b980. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a
0709 13:08:22.172271 (+   440us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b2c0006e2e8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:22.172725 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.432920 (+260195us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:22.433047 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.433204 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.265421 (+832217us) raft_consensus.cc:1685] finished
0709 13:08:23.265450 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.265628 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9637,"raft.queue_time_us":23594,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":47053,"spinlock_wait_cycles":127291136,"thread_start_us":259490,"threads_started":1,"wal-append.queue_time_us":664007}
I20260709 13:08:23.294788 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2774) took 1107 ms. Trace:
I20260709 13:08:23.296309 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:23.297349 21814 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.298004 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:23.298480 21811 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:23.299391 21294 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:23.299985 21811 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.302037 21297 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:23.274428 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.275306 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:23.295156 21220 rpcz_store.cc:276] 0709 13:08:22.187865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.232218 (+ 44353us) service_pool.cc:224] Handling call
0709 13:08:22.232577 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.232936 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.232961 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.233346 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.704078 (+470732us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:22.704130 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.704192 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.294599 (+590407us) raft_consensus.cc:1685] finished
0709 13:08:23.294622 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.294735 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1869,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":82,"thread_start_us":311062,"threads_started":1,"wal-append.queue_time_us":622236}
I20260709 13:08:23.317946 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2772) took 1130 ms. Trace:
I20260709 13:08:23.277253 25781 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.266237 25805 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.279843 25211 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:23.280653 25848 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.736s	user 0.004s	sys 0.000s
I20260709 13:08:23.283857 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52772 (request call id 1225) took 1035 ms. Trace:
I20260709 13:08:23.330019 21809 rpcz_store.cc:276] 0709 13:08:22.248389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.255985 (+  7596us) service_pool.cc:224] Handling call
0709 13:08:23.283660 (+1027675us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54004e9b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:23.283803 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639564032}
I20260709 13:08:23.287271 21808 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:23.287752 25564 raft_consensus.cc:3055] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.242913 25839 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.291294 21806 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.291587 25700 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.343662 25700 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.344053 25211 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:23.344561 25211 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.345739 25700 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.313048 21296 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.303860 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:23.346553 25211 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.312454 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.313376 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:23.348445 21813 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:23.278752 25543 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.312175 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.351208 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:23.325345 21224 rpcz_store.cc:276] 0709 13:08:22.187308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.224137 (+ 36829us) service_pool.cc:224] Handling call
0709 13:08:22.224434 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.684307 (+459873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.684349 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.684920 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.945966 (+261046us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.946030 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.317599 (+371569us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54000eced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:23.317644 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.317688 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:23.317701 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.317890 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41798,"raft.queue_time_us":40532,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5268,"spinlock_wait_cycles":971712768,"thread_start_us":260607,"threads_started":1,"wal-append.queue_time_us":415750}
W20260709 13:08:23.239296 25322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.012s	sys 0.004s
W20260709 13:08:23.353403 25322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.004s
W20260709 13:08:23.327548 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52336.5us
W20260709 13:08:23.274793 25846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.009s
W20260709 13:08:23.333820 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59489.4us
I20260709 13:08:23.335829 25564 raft_consensus.cc:740] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:23.355405 25564 consensus_queue.cc:260] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.356654 25564 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.336448 25873 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.338912 21299 raft_consensus.cc:1240] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.340744 25781 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.360721 25781 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.361096 25752 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.362094 25872 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:23.362964 25781 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.352818 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.352162 25813 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:23.367678 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.371609 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.373855 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:23.377478 25697 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.381582 21294 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.383149 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:23.343154 25839 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.332804 25587 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.315776 25547 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:08:23.393527 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:23.364229 25543 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:23.369916 25700 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:23.460716 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.393036 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.385052 25870 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:23.472235 25840 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:23.479115 25882 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 13:08:23.464497 21294 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
W20260709 13:08:23.469164 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 75760.2us
I20260709 13:08:23.483491 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:23.368678 25731 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:08:23.484995 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:23.484650 25543 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.485908 25879 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.485989 25543 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.486168 25877 consensus_queue.cc:1059] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:23.486717 25879 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.467494 25773 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.493088 25805 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.493635 25870 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:23.494520 21295 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:23.494299 25870 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.381045 25450 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:23.482154 25752 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.497848 25870 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.499848 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.501668 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.503183 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.503850 21224 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:23.516043 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.516918 21224 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:23.471627 21299 raft_consensus.cc:2410] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:23.518144 25778 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.519032 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.516237 25836 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:23.520113 25836 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:23.521166 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 725) took 1384 ms. Trace:
I20260709 13:08:23.520978 25836 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.521510 21217 rpcz_store.cc:276] 0709 13:08:22.136397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.144340 (+  7943us) service_pool.cc:224] Handling call
0709 13:08:23.520977 (+1376637us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000cfdd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:23.521114 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119379712}
I20260709 13:08:23.522119 25836 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.525900 25612 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.525974 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.526804 21298 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:23.527247 21300 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:08:23.527391 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.527783 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.528007 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:23.528354 21294 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:23.528644 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.531085 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:23.532406 25536 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.532995 25536 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.534118 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:23.534845 25752 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.532495 25849 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.987s	user 0.003s	sys 0.002s
I20260709 13:08:23.535723 25752 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:23.536401 25752 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:23.536856 25752 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.537174 25752 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:23.537544 25752 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.534883 25536 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.540380 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:23.545583 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:23.547390 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 164124us
I20260709 13:08:23.549207 21776 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.550060 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.552412 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.553315 21298 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:23.554653 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.555451 21298 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.562698 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.551488 25805 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:08:23.566926 25805 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.567308 25805 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:23.567404 25587 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.567750 25810 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.568117 25805 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.569306 25805 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.568254 25810 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.567878 25587 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.572346 25810 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.572364 25587 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.574765 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.575551 21296 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:23.577121 21191 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:23.577968 25587 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.578361 25587 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.578696 25587 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.568619 21299 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.551394 25543 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.564836 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.587304 21300 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:23.595351 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.585865 25543 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:23.555943 25846 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:23.561703 25874 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:08:23.608948 25850 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.017s	user 0.003s	sys 0.003s
I20260709 13:08:23.621323 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:23.622506 21297 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:23.609081 25846 consensus_queue.cc:1243] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:23.611450 25711 consensus_queue.cc:1175] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.8-13.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:23.613363 25672 raft_consensus.cc:3055] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.643787 25672 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:23.645015 25672 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.605041 25543 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.627184 25612 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.627332 25813 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:23.645536 25383 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.627128 21298 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:23.646397 25672 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:23.660506 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 277441us
I20260709 13:08:23.670368 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:23.650061 25752 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.681973 25752 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.658608 25612 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.685284 25587 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.693079 25587 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.699294 25612 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.687131 25813 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.700305 25766 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.700708 25766 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:23.701489 25766 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.702471 25766 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.706789 25873 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:23.707211 25873 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:23.707494 25776 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:23.708006 25776 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:23.708202 25873 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.708881 25776 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.709439 25873 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.748485 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1707) took 1034 ms. Trace:
I20260709 13:08:23.749591 21222 rpcz_store.cc:276] 0709 13:08:22.713516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.097457 (+383941us) service_pool.cc:224] Handling call
0709 13:08:23.097826 (+   369us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:23.103657 (+  5831us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:23.362415 (+258758us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b180033d120. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd8d5e5 00007f2b6dd8d568
0709 13:08:23.467846 (+105431us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.615859 (+148013us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:23.616830 (+   971us) log.cc:844] Serialized 78 byte log entry
0709 13:08:23.617025 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:23.617754 (+   729us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.618109 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.618407 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.627022 (+  8615us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.704838 (+ 77816us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b180033d120. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:23.747491 (+ 42653us) raft_consensus.cc:1685] finished
0709 13:08:23.747576 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.748117 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5354,"prepare.queue_time_us":381655,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":5911,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":13915,"spinlock_wait_cycles":9198592,"thread_start_us":167040,"threads_started":2,"wal-append.queue_time_us":189102}
I20260709 13:08:23.757388 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2188) took 1002 ms. Trace:
I20260709 13:08:23.757925 21143 rpcz_store.cc:276] 0709 13:08:22.755128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.766512 (+ 11384us) service_pool.cc:224] Handling call
0709 13:08:23.756784 (+990272us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b540026a2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:23.757102 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047202560}
I20260709 13:08:23.760773 25450 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.761464 25450 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:23.765563 25282 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.766139 25282 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:23.766281 21300 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:23.767772 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.763559 25450 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.768556 21299 raft_consensus.cc:1240] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:23.769881 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.772825 25282 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.775673 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:23.776016 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 105610us
I20260709 13:08:23.786139 25322 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:23.786929 25322 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:23.796258 21224 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.796135 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.797449 21298 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.797950 25322 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.798765 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:23.802942 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.803341 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:23.803833 25434 raft_consensus.cc:3055] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:23.804031 21222 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:23.804382 25434 raft_consensus.cc:740] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:23.806360 21263 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:23.807621 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.807400 25270 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.809866 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:23.806156 25434 consensus_queue.cc:260] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:23.773308 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 223983us
I20260709 13:08:23.769986 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2777) took 1187 ms. Trace:
I20260709 13:08:23.769986 25450 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.776013 25282 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.814929 21291 rpcz_store.cc:276] 0709 13:08:22.582067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.582602 (+   535us) service_pool.cc:224] Handling call
0709 13:08:22.582854 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.007133 (+424279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.769402 (+762269us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:23.769788 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965629824}
I20260709 13:08:23.836704 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.843050 25612 raft_consensus.cc:2764] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:23.844569 25686 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.846318 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.846407 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.850747 25892 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.836727 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.851933 25813 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.852891 21219 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:23.817839 25547 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.864091 25591 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.864977 25591 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:23.872016 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.872921 21220 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:23.878093 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:23.879930 21807 raft_consensus.cc:1240] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.889014 21225 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:23.809387 25270 consensus_queue.cc:1059] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:08:23.863305 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 57001.3us
I20260709 13:08:23.903545 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.889909 21217 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:23.907866 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:23.908144 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.908834 21806 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
W20260709 13:08:23.916836 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.917346 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.918735 25813 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.919728 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.922297 21223 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:23.922664 25813 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.923385 25813 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.924096 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.927295 25813 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:23.929459 21810 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.931041 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:23.932546 25612 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.932667 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:23.933529 21148 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:23.933346 25612 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.934775 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:23.935508 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.935917 25612 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:23.937547 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:23.938928 25612 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.905150 25434 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.959237 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:23.964810 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:23.939486 25612 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:23.965415 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:23.976253 21220 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:23.978760 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.979192 25564 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:23.978760 21115 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.764s (SENT) [suppressed 13 similar messages]
I20260709 13:08:23.980644 21217 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:08:23.983942 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.989305 21150 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:08:24.002125 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 64821.8us
I20260709 13:08:24.005632 25781 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:24.007396 25781 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.007941 25781 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:24.008545 25879 raft_consensus.cc:3055] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:24.009050 25879 raft_consensus.cc:740] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:24.009428 25781 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.010102 25879 consensus_queue.cc:260] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:23.971047 25612 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:24.016847 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:23.772442 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.018496 21805 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:24.023911 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:24.026000 25900 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.026835 21298 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:24.026747 25900 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.027771 25672 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.028741 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.029956 25672 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.024255 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.033147 21813 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.035648 21191 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.013696 25564 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:24.039279 25564 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.042949 25270 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.043566 25270 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:24.043962 25879 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.044866 25270 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.053574 25672 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:24.059798 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.060702 21298 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:24.061898 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:24.063747 25547 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.064146 25547 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.064539 25547 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.057526 21219 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:24.077726 21813 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:24.082641 25900 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.083664 25672 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.084764 25778 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.084453 25672 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.087661 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.088578 21300 raft_consensus.cc:2393] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:24.089013 25543 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.077291 21114 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.090204 21226 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.014514 25781 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.092549 25711 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.106858 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75339.1us
W20260709 13:08:24.131726 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 106941us
W20260709 13:08:24.134347 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 83104.2us
I20260709 13:08:24.135891 25776 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.136534 25776 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.136873 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.138125 25813 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.138845 25813 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.141139 25813 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.140542 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.141762 25813 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.142558 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:24.143373 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.143474 21295 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:24.150836 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.140789 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.154224 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:24.105818 25591 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:24.141023 25776 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:24.151703 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 173102us
I20260709 13:08:24.143388 25813 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.167847 21151 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:24.193797 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.193265 21294 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:24.174675 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.193610 21114 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:24.236289 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.161867 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:24.237430 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 72637.8us
I20260709 13:08:24.163021 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.243391 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.244299 21148 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:24.249215 25591 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.249647 25591 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:24.250058 25591 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.250051 25672 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:24.257020 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 93889.3us
W20260709 13:08:24.250309 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 110038us
I20260709 13:08:24.267732 21295 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:24.271708 21226 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:24.169550 25900 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.165050 25676 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.158628 25879 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.201406 25543 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:24.291620 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51578.7us
I20260709 13:08:24.295609 25672 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.318097 25805 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.318749 25805 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:24.318929 25672 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.319339 25805 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.319682 25672 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.154662 25711 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.322041 25672 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:24.163312 25322 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
W20260709 13:08:24.295897 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 141528us
I20260709 13:08:24.298086 25591 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.287459 25676 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.303395 25879 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.339712 25879 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.277503 25900 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.317391 21151 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:24.317780 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 163099us
W20260709 13:08:24.267174 25909 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:24.328869 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.335498 25874 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.335531 25270 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.336593 21189 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.337111 25676 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.347834 25900 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.353430 25591 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:24.355518 25536 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:24.356235 21297 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:24.340893 25879 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 13:08:24.360379 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.357156 21114 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.386991 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:24.413600 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.327174 25711 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:24.420636 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 84187.7us
I20260709 13:08:24.404047 21297 pending_rounds.cc:85] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 9
I20260709 13:08:24.421432 21150 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:24.421932 21297 pending_rounds.cc:107] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:24.435865 21297 raft_consensus.cc:2889] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:24.436288 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 91358.8us
I20260709 13:08:24.446255 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.405148 25547 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:24.447124 25282 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.005s
W20260709 13:08:24.455948 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.456379 25383 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:24.435529 25270 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.470782 25383 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:24.485216 25383 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:24.485132 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.485900 21293 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:24.485128 25890 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.488135 25890 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.519335 25817 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:24.520385 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 177179us
I20260709 13:08:24.490713 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:24.521786 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:24.531646 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.535604 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 113877us
W20260709 13:08:24.539568 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57799.9us
W20260709 13:08:24.535023 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 86581us
W20260709 13:08:24.546002 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.483465 25450 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.556604 21218 raft_consensus.cc:2410] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:24.557855 21291 raft_consensus.cc:2368] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10.
I20260709 13:08:24.551812 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:24.583845 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 47142.2us
I20260709 13:08:24.556551 25874 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:24.597186 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 100673us
I20260709 13:08:24.556516 25450 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.608148 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.579676 25270 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.614424 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.615607 25890 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.600061 25874 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.599563 25450 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.627601 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.628454 21293 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:24.631819 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 74980us
I20260709 13:08:24.633278 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.634310 25874 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:24.639916 25612 consensus_meta.cc:287] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:08:24.640259 25547 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.640347 25612 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.642864 25612 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.644358 25892 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.645188 25892 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.645669 25892 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.612844 25879 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:24.654924 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 68013.4us
I20260709 13:08:24.648164 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:24.657593 21296 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:24.661423 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 224476us
I20260709 13:08:24.666320 25927 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.667349 21191 leader_election.cc:400] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10.
I20260709 13:08:24.667728 21191 leader_election.cc:403] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.656050 25879 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.612609 25805 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.654769 25270 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.643157 25450 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.670388 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.668678 25817 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.675189 25892 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.677717 25817 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.678133 25817 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.678295 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.678742 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.678965 21299 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:24.680476 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:24.693147 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:24.693425 25923 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.693919 21223 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
W20260709 13:08:24.695608 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 78594.5us
I20260709 13:08:24.696333 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:24.671201 25879 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.698239 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:24.698343 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:24.700742 21222 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:24.701673 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:24.688937 25890 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:24.702257 25450 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.702514 21224 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:24.704825 21221 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:24.696349 21219 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:24.713069 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:24.694670 25564 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:24.694590 25927 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10.
I20260709 13:08:24.684522 25547 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:24.720947 21299 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:08:24.725648 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45515.3us
I20260709 13:08:24.728235 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:24.708000 25270 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:24.748275 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.729979 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59698.2us
I20260709 13:08:24.776592 25805 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.778725 21223 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:24.784068 25711 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:24.784538 25711 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:24.785573 25711 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.789021 21220 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:24.787042 25711 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.741748 25813 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.727353 25873 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:24.751880 25926 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.803396 25846 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.802774 25890 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.731771 25547 consensus_queue.cc:1243] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:24.805585 25846 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:24.814332 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.747150 25383 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.820196 25930 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.820647 25918 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.821247 25918 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.824486 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.807128 25873 consensus_queue.cc:1243] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:24.799635 25900 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.830139 25846 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.830560 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.831568 25846 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.832882 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.833832 21147 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:24.834229 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.835126 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.835981 21142 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:24.836009 21145 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:24.836454 25270 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.836884 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.828579 25926 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:24.827435 25322 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:24.839269 25322 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.839944 25322 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:24.840381 25322 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:24.841866 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 493381us
I20260709 13:08:24.842617 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.843593 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.844260 21143 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.844323 25928 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.845332 25928 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.845451 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.845604 25887 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.845877 25928 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:24.846320 21293 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:24.846240 25887 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.846907 25928 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.848116 21146 raft_consensus.cc:1240] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:24.848343 25928 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.848637 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.849232 21147 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.849164 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.850351 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.851876 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.852988 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.853389 25547 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:24.818940 25890 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.855333 25450 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.855743 25450 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:24.853720 21149 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:24.856740 25450 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.841444 25322 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.837114 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.872301 21145 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:08:24.880295 25901 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.634s	user 0.006s	sys 0.000s
I20260709 13:08:24.880643 25918 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.885092 25900 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.892771 25270 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:24.893410 25270 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.896013 25434 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:24.896775 25434 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.900358 25920 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.900846 25890 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.901057 25920 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.900513 25270 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.903365 25450 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.903425 25543 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.907655 25543 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.906366 21299 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:24.909977 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2799) took 1097 ms. Trace:
I20260709 13:08:24.909468 21143 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:24.892313 21047 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 6 to 8, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 8 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:24.912670 21047 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 4 to 5, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 5 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:24.915037 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.917327 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.914561 21047 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 9 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:24.917557 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.918103 25672 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.919773 25672 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:24.919624 25874 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.920306 25672 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.920950 21144 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.922056 25874 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.923467 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.923382 25817 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.924104 21144 raft_consensus.cc:2376] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12. Re-sending same reply.
I20260709 13:08:24.924994 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.918479 21263 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.925709 25817 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.925992 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.910370 21292 rpcz_store.cc:276] 0709 13:08:23.812726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.815973 (+  3247us) service_pool.cc:224] Handling call
0709 13:08:23.817297 (+  1324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.848711 (+ 31414us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:23.848747 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.849388 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.107652 (+258264us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:24.107709 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.107796 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.879574 (+771778us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:24.909694 (+ 30120us) raft_consensus.cc:1685] finished
0709 13:08:24.909715 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.909924 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13430,"raft.queue_time_us":18199,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":82,"spinlock_wait_cycles":62878080,"thread_start_us":257713,"threads_started":1,"wal-append.queue_time_us":395962}
I20260709 13:08:24.926611 21144 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
W20260709 13:08:24.928772 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.919888 21145 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:24.931213 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.932243 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.933241 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.934120 21778 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:24.913712 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.935290 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.935757 21146 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:24.935672 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:24.935034 25892 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:24.935308 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.936389 25892 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.936777 25892 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.936784 25778 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.937536 25778 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:24.909615 25543 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.944499 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:24.944893 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:24.943058 25543 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.946259 25543 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.948400 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.903061 25920 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:24.951675 25778 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:24.952198 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 225203us
I20260709 13:08:24.904592 25887 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:24.952359 25676 consensus_meta.cc:287] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.005s
I20260709 13:08:24.953068 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:24.953213 25676 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:24.953742 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 110805us
I20260709 13:08:24.955664 25676 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.955763 25434 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:24.957656 25672 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:24.958295 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.958492 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.958853 25282 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.959519 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.960464 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:24.998270 21296 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:24.966007 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:24.966838 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:24.970070 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:25.004419 21149 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:24.971320 21218 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:08:24.994488 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.008056 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:25.008849 21295 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.009666 21292 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:25.000495 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.008328 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.018797 21151 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:24.919304 21047 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:25.025756 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:24.972069 25543 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:25.037868 21813 raft_consensus.cc:2410] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:25.030079 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.032912 21047 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 9, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 9 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.039731 21218 pending_rounds.cc:85] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 10
I20260709 13:08:25.040144 21218 pending_rounds.cc:107] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:25.040392 21218 raft_consensus.cc:2889] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.030453 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:25.029482 21294 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:25.029539 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:25.042778 21149 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.037159 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:25.018074 25612 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:25.023150 25813 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:25.056255 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:24.973335 25887 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:08:25.029932 25686 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:25.082901 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:25.085703 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:25.089136 21145 raft_consensus.cc:2410] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:25.044489 25711 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.106849 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 153897us
I20260709 13:08:25.081771 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.090399 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.155067 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.156234 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:25.155712 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 336924us
I20260709 13:08:25.155018 21047 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 9 to 12, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:25.055416 25383 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.062180 25813 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.159595 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:25.179994 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:25.180843 21145 raft_consensus.cc:2376] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12. Re-sending same reply.
I20260709 13:08:25.190672 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:25.193528 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.190502 21047 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:25.159998 25898 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.712s	user 0.003s	sys 0.003s
I20260709 13:08:25.199597 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.201885 25672 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:25.202538 25672 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:25.203439 25931 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.239534 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.207571 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.216275 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.214458 21149 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:25.218935 21147 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
W20260709 13:08:25.219394 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.246078 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.222865 21150 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:25.223378 21142 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:25.205544 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.108001 25781 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:25.155745 25282 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:25.284346 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 424624us
I20260709 13:08:25.289638 21295 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:25.081650 25879 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:25.254669 21047 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:25.276154 21808 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:25.207208 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:25.184716 25920 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.283813 21809 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:25.184971 25813 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.202973 25672 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.313019 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:25.314617 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 107470us
I20260709 13:08:25.316560 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:25.322371 21810 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.306591 21223 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:25.225818 25918 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:25.332581 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.254594 25434 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.336622 21295 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:25.336292 21047 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 12, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:25.342095 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 280935us
I20260709 13:08:25.191349 25711 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.306154 25270 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.345583 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:25.353916 21223 raft_consensus.cc:2376] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13. Re-sending same reply.
I20260709 13:08:25.222131 25892 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.352128 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:25.319759 25874 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.356449 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:25.321542 25930 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.324141 25564 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:25.323765 25890 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.334198 25918 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.203905 25931 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.363452 21047 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 8, leader changed from <none> to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 8 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:25.362131 21046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 255) took 29341 ms (client timeout 15000 ms). Trace:
W20260709 13:08:25.358712 25928 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
I20260709 13:08:25.345407 25591 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.346274 25900 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:25.378396 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:25.409955 25900 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.410181 21223 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.410568 25900 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.378420 25918 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.320781 25920 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.393082 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:25.397482 21114 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.331386 25282 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.324728 25781 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.407199 21806 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:25.401705 21047 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 9 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:25.369411 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 287089us
I20260709 13:08:25.420082 21223 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:25.405355 25887 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:25.460036 25921 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:25.461304 25934 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:25.464607 25672 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.371544 25874 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.441207 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:25.372429 25930 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.406773 25686 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:25.492209 21114 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:25.496002 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 305739us
I20260709 13:08:25.496431 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:25.506947 21223 raft_consensus.cc:2376] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9. Re-sending same reply.
I20260709 13:08:25.487520 21047 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 9, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 9 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.452843 25322 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:25.504150 21810 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:25.393113 25890 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.517839 25846 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.521922 25846 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:25.522167 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:25.522791 21223 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:25.455384 25928 consensus_queue.cc:1059] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:08:25.526593 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:25.498044 25887 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:25.507496 25922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.027s	sys 0.018s
I20260709 13:08:25.536706 21047 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:25.522959 25932 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:08:25.437698 25612 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:25.540963 25672 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.544083 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:25.582211 21223 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.539994 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:25.559921 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:25.544323 25956 raft_consensus.cc:3055] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:25.558998 25922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.028s	sys 0.019s
W20260709 13:08:25.596254 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 155103us
I20260709 13:08:25.583742 21047 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 10, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.522826 25846 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.615744 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:25.621517 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2813) took 1076 ms. Trace:
I20260709 13:08:25.625945 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.630934 25874 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.632138 25961 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:08:25.594202 25956 raft_consensus.cc:740] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:25.633810 25956 consensus_queue.cc:260] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:25.635058 25956 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.635646 25929 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.634909 21047 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 10, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:25.636170 25929 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.637336 21047 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 6 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.638324 25929 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.639389 25928 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.640214 25958 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:25.640076 25928 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.640813 25958 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:25.640996 25612 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.642215 25928 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.601030 25434 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:25.643039 25434 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:25.644032 25955 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:08:25.634836 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:25.645231 25434 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.645670 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:25.649933 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.652670 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:25.653282 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 54044.7us
I20260709 13:08:25.598582 25564 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:25.679919 25564 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.642902 25958 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:25.685622 21217 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:25.655961 25892 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:25.660387 25879 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:25.661976 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.662149 25591 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:25.666183 25450 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.762s	user 0.004s	sys 0.004s
I20260709 13:08:25.671370 25711 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.672616 25282 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:25.673614 25944 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:08:25.674261 25890 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:25.676010 25930 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.695477 21114 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.712368 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.639452 21806 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:25.622076 21297 rpcz_store.cc:276] 0709 13:08:24.545167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.545323 (+   156us) service_pool.cc:224] Handling call
0709 13:08:24.562539 (+ 17216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.654818 (+ 92279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.654891 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.690320 (+ 35429us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.979520 (+289200us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:24.979574 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.979880 (+   306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.621228 (+641348us) raft_consensus.cc:1685] finished
0709 13:08:25.621257 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.621446 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50428,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":323745,"threads_started":2,"wal-append.queue_time_us":481781}
I20260709 13:08:25.653285 21300 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:25.689888 25776 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.689996 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.690339 25547 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.691601 21295 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:25.691025 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:25.691956 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:25.704233 21810 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:25.677532 25781 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:25.678619 25920 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:25.379441 21046 rpcz_store.cc:269] 0709 13:07:55.827829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.940658 (+112829us) service_pool.cc:224] Handling call
0709 13:08:25.155185 (+29214527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.275482 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:23.276007 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:23.276039 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:23.276056 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:23.314895 (+ 38839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:23.314993 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:23.315020 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:23.315541 (+   521us) tablet.cc:701] Row locks acquired
0709 13:08:23.315560 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:23.315694 (+   134us) write_op.cc:270] Start()
0709 13:08:23.315799 (+   105us) write_op.cc:276] Timestamp: P: 1783602503315648 usec, L: 0
0709 13:08:23.315815 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:08:23.335231 (+ 19416us) log.cc:844] Serialized 2116 byte log entry
0709 13:08:23.544742 (+209511us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.669602 (+124860us) write_op.cc:301] APPLY: starting
0709 13:08:23.675480 (+  5878us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.691984 (+ 16504us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.692756 (+   772us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.699227 (+  6471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.699452 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:08:23.699494 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:23.699738 (+   244us) log.cc:844] Serialized 57 byte log entry
0709 13:08:23.699906 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.700009 (+   103us) write_op.cc:454] Released schema lock
0709 13:08:23.700053 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.700393 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.700411 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":116984,"apply.run_cpu_time_us":7937,"apply.run_wall_time_us":37158,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":12898,"prepare.run_cpu_time_us":28161,"prepare.run_wall_time_us":124936,"raft.queue_time_us":63940,"raft.run_cpu_time_us":26942,"raft.run_wall_time_us":58187,"replication_time_us":228775,"thread_start_us":183646,"threads_started":4,"wal-append.queue_time_us":62002,"wal-append.run_cpu_time_us":9785,"wal-append.run_wall_time_us":1327483}]]}
I20260709 13:08:25.690140 25892 raft_consensus.cc:2764] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:25.691964 25958 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.694813 25591 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.710289 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:25.694604 25676 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.705807 25322 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:25.718412 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:25.716997 21217 raft_consensus.cc:2410] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:25.717145 21298 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:25.717482 21047 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 6 to 9, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 9 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:25.725368 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 109667us
I20260709 13:08:25.733402 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.652213 25686 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:25.738461 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.750826 21293 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:25.755600 21047 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:25.760221 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.758821 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.763147 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:25.766335 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.756757 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:25.723218 21223 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:25.748891 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.702953 25900 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:25.768308 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 421434us
W20260709 13:08:25.759590 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.828989 21297 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:25.829526 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.973063 21298 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:25.872041 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:25.775471 21810 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:25.876468 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.718641 25929 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:25.717813 25961 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.883602 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 115309us
W20260709 13:08:25.883780 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 127105us
I20260709 13:08:25.991890 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:25.889173 25672 raft_consensus.cc:2764] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:08:25.889348 25322 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.891661 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.891848 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.892338 25952 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.998147 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:25.998395 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 106816us
I20260709 13:08:25.998840 21298 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:25.875036 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:25.874398 21292 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:25.999521 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:25.882849 25926 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:25.900539 21116 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:25.902243 25957 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:08:25.724160 25931 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:25.906059 21224 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:25.753237 25921 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.908440 21047 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.919481 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:25.741539 25547 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.870754 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09568f2c2c854929b369d24083d81717"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
W20260709 13:08:26.019985 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 57546us
I20260709 13:08:26.020359 21217 raft_consensus.cc:606] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.014055 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.020756 21217 raft_consensus.cc:614] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.016600 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:25.748500 25676 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.883821 25270 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:25.954165 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:25.910375 25879 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.950090 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:25.956485 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.032557 21814 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:25.914189 25958 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:08:25.957509 21806 pending_rounds.cc:85] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 9
W20260709 13:08:25.957809 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 194756us
I20260709 13:08:25.960469 25900 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:25.737403 25776 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:25.935778 21809 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:25.830289 21223 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:26.009115 25928 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:25.966264 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 192831us
I20260709 13:08:25.910140 25543 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.964608 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2796) took 1026 ms. Trace:
W20260709 13:08:25.971498 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.047580 21300 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:25.988902 21226 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.740247 25887 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.052534 21298 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:26.053423 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 153000us
I20260709 13:08:26.054109 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:26.003044 21293 raft_consensus.cc:2393] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:26.005622 21190 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.006655 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2795) took 1057 ms. Trace:
I20260709 13:08:26.020102 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.055190 21222 rpcz_store.cc:276] 0709 13:08:24.937633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.939444 (+  1811us) service_pool.cc:224] Handling call
0709 13:08:24.939729 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.939951 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:25.658272 (+718321us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b180042fe20. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf
0709 13:08:25.658426 (+   154us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.994650 (+336224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.994715 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:25.994774 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.994845 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.994960 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7085,"prepare.queue_time_us":397418,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":25935,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":21122,"spinlock_wait_cycles":7718656,"thread_start_us":743720,"threads_started":2}
I20260709 13:08:26.036417 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.037459 21806 pending_rounds.cc:107] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:26.058857 21806 raft_consensus.cc:2889] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:26.059072 21807 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.037950 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:26.004843 25890 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.061872 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2806) took 1001 ms. Trace:
I20260709 13:08:26.010640 25778 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.044272 21047 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.065526 21263 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:26.062287 21223 rpcz_store.cc:276] 0709 13:08:25.045502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.829446 (+783944us) service_pool.cc:224] Handling call
0709 13:08:25.829878 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.046578 (+216700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.046779 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:26.047482 21221 rpcz_store.cc:276] 0709 13:08:24.937970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.939466 (+  1496us) service_pool.cc:224] Handling call
0709 13:08:24.939820 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.940098 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:25.337425 (+397327us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.963992 (+626567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.964081 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:25.964187 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.964314 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.964516 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16893,"prepare.queue_time_us":439162,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":85699,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":800538,"threads_started":3,"wal-append.queue_time_us":386570}
I20260709 13:08:26.073990 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.074956 21810 raft_consensus.cc:2393] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.077772 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.072248 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.001629 25961 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.076292 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:26.086234 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 80718.8us
I20260709 13:08:26.086980 21190 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.083498 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.080327 21047 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 10 to 11, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 11 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.090126 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.097951 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.098899 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.067806 25805 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.101670 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:26.046078 25929 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:26.015746 25926 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.138635 25973 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:26.139991 25959 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:26.140663 25926 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.141158 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2803) took 1159 ms. Trace:
I20260709 13:08:26.127105 21222 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:26.141496 21220 rpcz_store.cc:276] 0709 13:08:24.981968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.982131 (+   163us) service_pool.cc:224] Handling call
0709 13:08:24.982538 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.040984 (+ 58446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.041012 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.072266 (+ 31254us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.440579 (+368313us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:25.440624 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.440699 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.140945 (+700246us) raft_consensus.cc:1685] finished
0709 13:08:26.140971 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.141105 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94812,"raft.queue_time_us":30160,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14219,"thread_start_us":239702,"threads_started":1,"wal-append.queue_time_us":807631}
I20260709 13:08:26.142663 21226 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:26.133405 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:26.128988 21219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.030s
I20260709 13:08:26.144151 25971 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.144522 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.145315 25978 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.146404 25968 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.146989 25968 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:26.147462 25968 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.146003 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.026984 25952 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.132750 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.150763 21810 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.150800 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.151401 25974 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.132627 25811 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.152206 25974 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.152642 25811 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.136346 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.137039 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.154315 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.155408 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.151472 25952 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.156508 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.157483 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.158392 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.136449 25920 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.139859 25969 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.159631 25920 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:26.144373 21219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.030s
I20260709 13:08:26.160099 25920 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.161131 21812 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:26.162034 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.162657 21812 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:26.163925 21812 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:26.131053 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:26.151516 21811 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.167695 25969 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.168249 25969 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:26.168648 25969 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.134573 25805 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.133410 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.170258 25805 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.171517 21807 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.172833 21807 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.175762 25547 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:26.128772 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:26.177341 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 72384.7us
I20260709 13:08:26.144678 25971 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.074218 25672 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.106022 21805 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.067873 25928 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.106487 25778 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.152709 25974 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.168570 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.130980 25612 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.179642 21811 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:26.137367 25929 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.200162 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.203965 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.186468 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:26.072412 25543 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.210000 25676 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.082139 25890 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.199698 25270 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.212604 25890 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:26.213223 21220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:26.213780 21220 raft_consensus.cc:606] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:26.214128 21220 raft_consensus.cc:614] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.204098 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2804) took 1165 ms. Trace:
I20260709 13:08:26.214438 25969 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.201210 25612 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.215777 25612 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:26.216137 25813 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.882s	user 0.011s	sys 0.000s
I20260709 13:08:26.215026 21218 rpcz_store.cc:276] 0709 13:08:25.038680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.039081 (+   401us) service_pool.cc:224] Handling call
0709 13:08:25.039488 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:25.049354 (+  9866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.049398 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:25.054526 (+  5128us) log.cc:844] Serialized 52 byte log entry
0709 13:08:25.200740 (+146214us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b480021c258. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b72ca3aa1 00007f2b72c9ab37 00007f2b72c9a9ca 00007f2b72d9226f 00007f2b72d91f37 00007f2b72da655c 00007f2b72da6508 00007f2b72da6488 00007f2b72da6443 00007f2b72da56ec 00007f2b71ccfa96
0709 13:08:25.439164 (+238424us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:25.439222 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.439347 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.196804 (+757457us) raft_consensus.cc:1685] finished
0709 13:08:26.196831 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.204035 (+  7204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6133,"raft.run_cpu_time_us":2800,"raft.run_wall_time_us":145016,"spinlock_wait_cycles":13780352,"thread_start_us":278727,"threads_started":1,"wal-append.queue_time_us":610563}
I20260709 13:08:26.216609 25813 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.217945 21813 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.220278 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.220422 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.221174 21810 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:26.222152 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.222992 21810 raft_consensus.cc:2368] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:26.179176 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.184610 25672 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:26.209455 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.236117 21811 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:26.234892 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.238799 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.239498 21300 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:26.239998 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.240590 21298 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:26.185588 25971 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.241138 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:26.186689 25981 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:26.249544 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.208374 25973 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:26.263751 21264 leader_election.cc:336] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.616s (SENT)
I20260709 13:08:26.188710 25926 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:08:26.275764 25928 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.275867 25926 consensus_queue.cc:1243] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:26.278497 21814 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:26.280099 25776 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:26.280727 25892 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.281206 25892 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.281653 25892 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.269780 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:26.268599 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:26.284397 25962 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 13:08:26.285879 25985 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.286258 25985 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.286572 25985 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:26.287563 25951 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.335s	user 0.002s	sys 0.002s
I20260709 13:08:26.290797 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.275342 25973 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:26.296200 25973 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.297658 25968 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.299407 21814 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.295646 25928 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.294600 25805 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.299538 21221 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.273535 25969 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:26.263809 25964 log.cc:927] Time spent T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:08:26.298923 25978 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.264573 25981 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.263921 25890 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.369737 21222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574f49e93265460891ff981be2cee774"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
W20260709 13:08:26.369398 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 267134us
I20260709 13:08:26.319478 25711 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.332640 25813 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:26.334586 25778 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.374902 25977 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:08:26.370844 25981 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.397114 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:26.389437 25591 consensus_meta.cc:287] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
W20260709 13:08:26.397533 21264 leader_election.cc:336] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.643s (SENT)
I20260709 13:08:26.368543 25978 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:26.534538 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.502959 25961 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:26.400724 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 324488us
I20260709 13:08:26.404006 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.390381 25778 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:26.465868 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.401093 25938 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.446048 25591 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.403460 25879 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:26.404803 25918 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.950s	user 0.008s	sys 0.003s
I20260709 13:08:26.444793 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2797) took 1506 ms. Trace:
I20260709 13:08:26.401369 25711 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:26.493353 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.584082 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.485924 21814 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:26.586014 21814 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:26.499548 25975 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:26.480113 25963 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.490s	user 0.005s	sys 0.005s
I20260709 13:08:26.501360 21807 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:26.502056 25970 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:26.503605 25968 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:26.481542 25982 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:08:26.480973 25979 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:08:26.512207 25805 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:26.513355 25989 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:26.514106 25920 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.625595 25920 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:26.515643 25953 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:08:26.518874 21813 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:26.482412 25986 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:26.606076 25994 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:26.597734 25970 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.527994 21218 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:26.528334 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.528621 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.529325 25969 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.529989 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:26.530138 21190 leader_election.cc:400] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:26.631737 21217 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:26.631798 21190 leader_election.cc:403] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:26.632699 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 102708us
I20260709 13:08:26.634059 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:26.530181 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.635355 21294 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:26.531432 21293 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:26.531500 25974 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.532267 25672 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.533715 25282 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:26.373734 25890 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.535506 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:26.679109 21300 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.547237 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:26.572803 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.573150 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:26.679983 21115 leader_election.cc:336] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.764s (SENT)
I20260709 13:08:26.584718 21297 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:26.541451 25873 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:26.595544 21296 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.597055 21264 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:26.574170 25879 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.603390 21222 raft_consensus.cc:606] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.687449 21222 raft_consensus.cc:614] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.606887 25998 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:26.579955 25938 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.560390 25933 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:26.586802 25985 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.610910 25778 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.611634 25805 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:26.587719 25918 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.612835 25978 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.614480 25591 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:26.616008 25956 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.001s
I20260709 13:08:26.618474 25892 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:26.623695 25988 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.257s	user 0.001s	sys 0.001s
I20260709 13:08:26.627137 21223 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:26.670478 21220 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:26.677945 25922 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:26.680742 21224 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:26.578048 21219 rpcz_store.cc:276] 0709 13:08:24.938273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.938386 (+   113us) service_pool.cc:224] Handling call
0709 13:08:24.938673 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.938907 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:25.335374 (+396467us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.176137 (+840763us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:26.403776 (+227639us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.444417 (+ 40641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:26.444475 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:26.444520 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.444590 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.444721 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15958,"prepare.queue_time_us":790830,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":119973,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":11480320,"thread_start_us":1394461,"threads_started":4,"wal-append.queue_time_us":371119}
I20260709 13:08:26.694286 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:26.675801 25920 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.681160 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:26.680372 25781 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.701161 25976 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.752s	user 0.000s	sys 0.007s
I20260709 13:08:26.701458 25873 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.692589 25879 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.675732 25969 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.600194 25975 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.735927 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.736560 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:26.739527 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 749) took 1398 ms. Trace:
I20260709 13:08:26.682400 25282 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.731879 25672 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.703514 25543 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.701480 25890 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:26.754534 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 69382.7us
I20260709 13:08:26.697597 25270 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.707545 25778 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.760833 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.764890 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.816468 21143 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:26.778507 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.780545 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.779597 21145 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:26.780867 21225 rpcz_store.cc:276] 0709 13:08:25.333423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.645429 (+312006us) service_pool.cc:224] Handling call
0709 13:08:26.731995 (+1086566us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54000ec4d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:26.732124 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140122368}
I20260709 13:08:26.761641 21298 pending_rounds.cc:85] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 3
I20260709 13:08:26.818915 21298 pending_rounds.cc:107] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:26.819249 21298 raft_consensus.cc:2889] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:26.820170 21146 raft_consensus.cc:2368] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
W20260709 13:08:26.788270 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 94047.5us
I20260709 13:08:26.789752 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.779028 25547 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.765424 25965 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.825275 25965 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.826552 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:26.827963 25965 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:26.771240 25985 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.821097 21150 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:26.811836 21142 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:26.767385 25937 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.830542 25937 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.831931 21144 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:26.833102 25937 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.833811 25547 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:26.773186 25938 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:26.823740 26010 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:26.835139 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.769680 25974 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:26.863868 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.757987 25973 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.864791 21810 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:26.871173 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.872007 21220 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:26.872467 25805 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.873066 25805 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.874504 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.783056 25781 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.837198 25270 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:26.879191 21142 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:26.761384 26006 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:08:26.819994 26011 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.874666 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:26.884879 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.891157 21813 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:26.843415 25890 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.887953 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:26.757921 25922 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:26.896986 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 138989us
I20260709 13:08:26.899021 21812 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 8. Current term is 10. Ops: []
I20260709 13:08:26.901051 21805 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:26.878237 25612 consensus_meta.cc:287] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
I20260709 13:08:26.895219 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:26.895601 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:26.877879 25813 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.836341 25778 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.880545 25711 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:26.913539 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 233711us
I20260709 13:08:26.905936 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.915952 21142 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.857227 25938 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:26.903079 25974 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.848382 26010 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:26.877400 25998 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:08:26.921440 26005 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:08:26.921775 26008 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:08:26.921339 25270 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.923090 25922 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:26.923656 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.924293 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:26.927729 25892 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:26.916319 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.940042 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:26.941103 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.951022 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.952059 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:26.969343 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 111841us
I20260709 13:08:26.973834 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.974709 21219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:26.981340 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:26.929857 25974 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.994654 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.996354 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:26.903784 25564 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:08:26.998370 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.997347 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:26.998972 21220 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:26.967072 25547 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.996505 21226 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:26.914690 25813 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.999585 21221 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:26.977463 25999 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.914979 25612 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:26.967104 25970 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:27.002206 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 322338us
W20260709 13:08:27.080051 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 173167us
I20260709 13:08:27.015152 21142 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
W20260709 13:08:27.066982 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 179396us
I20260709 13:08:26.998612 25974 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.071527 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:27.066982 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 148729us
W20260709 13:08:27.111153 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.120471 21190 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:27.122184 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 138311us
I20260709 13:08:27.122450 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.122912 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:27.125990 21226 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:27.067426 25282 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.073120 25969 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.128691 21300 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:27.131249 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:27.131428 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 228448us
I20260709 13:08:27.135288 21295 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.138392 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.141709 21142 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:27.085338 25999 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.138697 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:27.138705 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.143038 21296 raft_consensus.cc:3060] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.139931 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:27.143819 21300 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.128052 25922 consensus_queue.cc:1059] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:08:27.144729 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.146155 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.147011 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.147605 21143 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:27.128347 25873 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.151439 21805 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:27.151527 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.152431 21292 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:27.132555 25965 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.126789 26006 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:27.140424 25970 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:27.156651 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.156734 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.157006 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:27.166585 21142 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.142817 25543 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.134758 25975 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.166458 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:27.157092 26013 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:08:27.176014 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1251) took 1222 ms. Trace:
I20260709 13:08:27.157048 26027 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:27.193410 21189 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:27.177120 26023 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:27.177875 26021 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:08:27.156303 25282 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.183805 25813 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:27.185791 25971 consensus_meta.cc:287] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.001s
I20260709 13:08:27.154383 25781 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:27.157363 26009 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:08:27.168550 26006 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.187664 25543 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.154584 25887 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.190860 21811 rpcz_store.cc:276] 0709 13:08:25.953241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.273806 (+320565us) service_pool.cc:224] Handling call
0709 13:08:26.274136 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.698976 (+424840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.699017 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.702407 (+  3390us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.788319 (+ 85912us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:26.818706 (+ 30387us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.819111 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.819303 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.928261 (+108958us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b180041fa40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419
0709 13:08:26.928879 (+   618us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001f4354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:26.928930 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.175766 (+246836us) raft_consensus.cc:1685] finished
0709 13:08:27.175790 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.175944 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2365,"prepare.queue_time_us":34907,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":28158,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":4821,"spinlock_wait_cycles":1011170816,"thread_start_us":85195,"threads_started":1,"wal-append.queue_time_us":286110}
I20260709 13:08:27.155740 25778 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.197587 21296 raft_consensus.cc:2468] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:27.167311 25969 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.199894 21142 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:27.166033 25973 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.199678 25282 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.205662 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:27.195448 25975 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.209002 21300 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
W20260709 13:08:27.264518 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.307662 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:27.204932 26015 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.304437 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 87250.1us
I20260709 13:08:27.312275 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:27.212392 25890 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:08:27.228834 25282 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.313622 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:27.314692 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 89024.1us
I20260709 13:08:27.239758 26027 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.318536 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.206591 25971 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.320206 21142 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:27.309854 26022 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.217994 25813 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:08:27.217518 25965 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:08:27.313889 25887 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.316794 25975 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:27.332540 26029 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.333010 25971 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.333341 26010 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.335484 26039 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:27.321005 26027 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.318826 26024 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:27.339747 26030 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.224117 25969 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.345417 25776 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:27.345669 25950 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:27.346606 21142 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:27.461553 26027 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.483865 25969 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.466964 26030 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.484958 25921 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.485463 25921 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:27.486362 25921 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:27.452178 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 855115us
I20260709 13:08:27.491387 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:27.492770 25900 raft_consensus.cc:3055] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.493321 25900 raft_consensus.cc:740] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:27.494767 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:27.495290 25591 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.455703 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.346571 25999 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.498380 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.499017 21809 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:27.500001 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:27.500317 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.500998 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.501178 21291 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:27.502080 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.502799 21809 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 6: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:27.387641 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:27.504554 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:27.385185 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:27.504565 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.453051 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.386495 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.506150 21805 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:27.506560 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.379086 25995 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.376859 25890 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:27.461323 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 914246us
I20260709 13:08:27.509884 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:27.511338 25995 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.512035 25995 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.512879 26006 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:27.514767 26017 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.386s	user 0.006s	sys 0.000s
I20260709 13:08:27.516202 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:27.517037 25890 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:27.517447 25879 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.730s	user 0.003s	sys 0.007s
I20260709 13:08:27.517856 25879 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:27.467952 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 74201us
I20260709 13:08:27.523325 25954 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.506064 25999 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:27.518028 25890 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.525360 25999 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:27.526122 25890 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.531522 25591 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:27.532254 25591 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:27.533334 25591 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.534896 25956 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:27.504237 25612 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.459503 25975 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:27.536125 21220 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:27.536684 25975 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.537392 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.315292 26015 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.459997 26039 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:27.392289 25958 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:27.331554 25981 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.005s
I20260709 13:08:27.449630 26011 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:27.466866 26029 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.485052 26030 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.511930 25543 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.331410 26022 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:27.418867 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.514952 25995 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.324401 25813 consensus_queue.cc:1243] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:27.545513 25922 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.559906 25922 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:27.560199 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.559906 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.507725 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:27.507359 21191 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:27.562108 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.544034 25981 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.517993 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:27.562104 26006 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.544189 26011 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:27.563911 25543 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.541518 26039 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.564442 25543 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:27.564553 26011 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.565096 26039 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.565733 26011 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.565382 25543 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.546124 26029 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.384773 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.563692 26006 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.568526 21811 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:27.569237 26022 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.569888 26006 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.536280 25612 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.571126 25612 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.543501 25711 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:27.572624 25711 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:27.535444 25956 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.448566 25965 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:27.467428 26024 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:27.476663 26046 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:27.538767 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.539328 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.526371 25999 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.539656 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:27.505438 21808 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.553319 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.575659 21147 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:27.507107 21810 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:27.554641 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.554729 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.576826 21142 raft_consensus.cc:2393] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:08:27.548369 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.560823 25922 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:27.562649 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 55394.8us
I20260709 13:08:27.502739 25973 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:27.463528 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 116271us
I20260709 13:08:27.577521 21226 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:27.548098 25921 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.589211 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.589897 21225 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:27.590036 21291 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:27.580037 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.478852 26010 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:08:27.582612 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.562723 21146 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:27.586256 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.592101 21226 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:27.586364 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.593106 21293 raft_consensus.cc:2393] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:27.593950 25956 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.587289 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.596287 21300 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:27.588202 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:27.510157 25900 consensus_queue.cc:260] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.540892 26015 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.597591 21296 raft_consensus.cc:2393] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:27.598024 21217 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:27.602056 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 84216.5us
W20260709 13:08:27.539139 25920 consensus_meta.cc:287] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.780s	user 0.007s	sys 0.002s
I20260709 13:08:27.602123 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.603318 21300 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:27.604036 21142 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:27.604552 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.605257 21300 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:27.605455 21142 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:27.577775 25981 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.617132 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.611639 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:27.616505 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.617127 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.577507 25954 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:27.620934 21143 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:27.617543 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.623134 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.619118 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:27.626098 21150 raft_consensus.cc:2393] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:27.589303 25973 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:27.589257 25958 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.625133 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:27.624615 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:27.629477 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:27.634321 21296 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:27.630098 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.636225 21145 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:27.637396 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:27.637921 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.623754 21143 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:27.628880 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.659947 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:27.639015 21807 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:27.660465 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:27.662746 21807 pending_rounds.cc:85] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 9
I20260709 13:08:27.663424 21807 pending_rounds.cc:107] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:08:27.638814 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 86805.5us
I20260709 13:08:27.663925 21807 raft_consensus.cc:2889] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.664574 21778 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:27.660955 21295 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.631989 21222 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:27.589733 25813 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:27.622085 25900 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.638499 21151 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:27.628801 26024 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.668843 25968 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.610569 25920 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:27.630887 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:27.670714 21142 raft_consensus.cc:2376] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14. Re-sending same reply.
I20260709 13:08:27.693015 21299 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:27.638725 25978 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:08:27.680022 25270 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.621186 25995 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:27.641882 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:27.706374 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 64627us
W20260709 13:08:27.674758 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50192.8us
W20260709 13:08:27.675808 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 47810.6us
I20260709 13:08:27.707783 21191 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.708431 21776 leader_election.cc:400] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:27.708814 21776 leader_election.cc:403] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.638460 25933 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.677802 21300 raft_consensus.cc:1240] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.677951 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:27.711484 21293 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.711910 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:27.629716 25974 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
W20260709 13:08:27.681568 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.635020 25973 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.683279 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:27.724319 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 99739.1us
I20260709 13:08:27.662881 21149 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:27.696106 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 65281.3us
I20260709 13:08:27.725368 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:27.726351 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:27.726925 21814 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.626636 25928 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.679756 25887 raft_consensus.cc:2804] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:27.707381 21219 raft_consensus.cc:606] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.730180 21219 raft_consensus.cc:614] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:27.712463 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.733300 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.722540 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:27.684906 25612 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:27.734813 21221 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:27.669467 26050 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:27.666530 25711 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.728477 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:27.737259 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:27.743745 21813 raft_consensus.cc:2368] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:27.738451 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.719857 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:27.702591 25938 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.706148 25270 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.702384 26024 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.629240 25954 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.710358 25933 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.728039 26035 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.686185 26037 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:27.754475 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:08:27.721812 25920 raft_consensus.cc:3060] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.720666 26006 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.746034 25938 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.770445 21809 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:27.756013 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.699829 25968 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.783543 25879 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:27.783757 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.755908 25270 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.711194 25995 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:27.902773 21264 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709): Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.519s (SENT)
I20260709 13:08:27.904201 25995 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:27.785796 25954 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:27.729803 25974 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:27.905396 21147 raft_consensus.cc:2368] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:27.906450 25974 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.775949 25933 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.772323 26050 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.790814 21149 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:27.724186 26022 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.812500 25711 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:27.793113 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.794205 21814 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:27.796435 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:27.737620 25926 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.772116 21218 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:27.755726 26029 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.810040 21190 leader_election.cc:400] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:27.931845 21190 leader_election.cc:403] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.816408 21813 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:27.811175 21805 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
W20260709 13:08:27.890653 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.893023 25968 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.938243 26022 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:27.943835 26049 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:08:27.945403 21222 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:27.813041 25938 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.901901 25805 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:27.929455 25933 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:27.931784 26029 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.812430 26052 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.794260 25547 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.731667 25591 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:08:27.956359 21293 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
W20260709 13:08:27.959686 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.970798 21808 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:08:27.970913 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 237707us
W20260709 13:08:27.971818 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 163164us
I20260709 13:08:27.998970 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.749148 25928 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:27.842358 25282 consensus_meta.cc:287] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.004s
I20260709 13:08:27.980855 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:27.982460 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.012537 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.012441 21809 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:27.990617 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:27.981379 26022 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:27.995198 26054 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:08:27.993579 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:28.016355 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.995211 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.000484 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.017408 21222 raft_consensus.cc:2410] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:27.951820 25965 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:28.013854 21810 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:27.978219 26029 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.978885 25887 raft_consensus.cc:697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:28.025558 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:27.953013 26030 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:28.018975 26027 consensus_meta.cc:287] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.003s
I20260709 13:08:28.029826 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.010159 25547 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.037292 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.040436 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.041045 21222 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:28.043529 21226 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:28.041917 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.009153 25776 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:28.047887 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.048070 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:28.048888 21810 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:28.050501 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.053761 26052 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:28.061432 26042 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.571s	user 0.001s	sys 0.001s
I20260709 13:08:28.061959 25270 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.063434 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2821) took 1202 ms. Trace:
I20260709 13:08:28.063723 25887 consensus_queue.cc:237] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.063838 21224 rpcz_store.cc:276] 0709 13:08:26.860630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.861635 (+  1005us) service_pool.cc:224] Handling call
0709 13:08:26.885794 (+ 24159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.003998 (+118204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:27.071638 (+ 67640us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.207224 (+135586us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.207470 (+   246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.217379 (+  9909us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.224455 (+  7076us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:27.224570 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.224715 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.060863 (+836148us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:28.063197 (+  2334us) raft_consensus.cc:1685] finished
0709 13:08:28.063218 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.063375 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7703,"prepare.queue_time_us":55096,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":820,"raft.queue_time_us":89230,"spinlock_wait_cycles":52372736,"thread_start_us":170902,"threads_started":2,"wal-append.queue_time_us":364387}
I20260709 13:08:28.066099 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.066610 21224 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.068735 25928 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.046016 25981 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.068864 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.070874 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.071455 21223 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.071837 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2819) took 1213 ms. Trace:
W20260709 13:08:28.073207 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.074970 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.072338 21217 rpcz_store.cc:276] 0709 13:08:26.858126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.858269 (+   143us) service_pool.cc:224] Handling call
0709 13:08:26.887523 (+ 29254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.602434 (+714911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.071556 (+469122us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:28.071766 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633502080}
I20260709 13:08:28.035653 25930 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.082196 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.074667 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:28.076648 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.082979 21810 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.076949 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.035126 26060 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.082108 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:28.037837 25991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.011s	sys 0.013s
I20260709 13:08:28.022054 25965 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.083760 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.039449 25900 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:28.083009 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.085932 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.018741 25282 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.087925 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:28.088114 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.036456 26027 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.044423 26061 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.092603 21807 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:28.092007 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.093262 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.039587 25999 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:28.097018 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.087759 26052 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:28.095476 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.105507 21808 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:28.102093 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:28.087872 25991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.012s	sys 0.014s
I20260709 13:08:28.107247 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1072) took 2144 ms. Trace:
I20260709 13:08:28.094172 26050 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.109637 21220 raft_consensus.cc:2368] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14.
I20260709 13:08:28.111068 26027 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.111228 25282 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.112952 25965 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.113911 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2840) took 1373 ms. Trace:
W20260709 13:08:28.114284 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 385849us
I20260709 13:08:28.115113 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:28.116134 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50268 (request call id 33) took 1186 ms. Trace:
I20260709 13:08:28.116338 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:28.116557 21219 rpcz_store.cc:276] 0709 13:08:26.929964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.930142 (+   178us) service_pool.cc:224] Handling call
0709 13:08:28.115929 (+1185787us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b540038ac54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:28.116035 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657671040}
I20260709 13:08:28.116971 25933 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.117230 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:28.118462 21263 leader_election.cc:400] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:28.118705 21263 leader_election.cc:403] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.119520 26056 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.119961 26056 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.120278 26056 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.097625 26035 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:28.123687 26057 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.125070 25900 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:28.127473 25995 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.127926 25995 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.128275 25995 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.076618 25547 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:08:28.104619 26039 consensus_meta.cc:287] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.002s
I20260709 13:08:28.149396 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.152878 21223 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:28.086130 25973 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:28.129112 26011 consensus_meta.cc:287] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.006s
I20260709 13:08:28.108500 21812 rpcz_store.cc:276] 0709 13:08:25.959689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.290728 (+331039us) service_pool.cc:224] Handling call
0709 13:08:26.291034 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.899598 (+608564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.103476 (+1203878us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400293954. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:28.103645 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397693184}
I20260709 13:08:28.143844 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.114261 21298 rpcz_store.cc:276] 0709 13:08:26.740074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.740204 (+   130us) service_pool.cc:224] Handling call
0709 13:08:26.761417 (+ 21213us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:27.392122 (+630705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.392151 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:27.452597 (+ 60446us) log.cc:844] Serialized 78 byte log entry
0709 13:08:27.632698 (+180101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:27.674310 (+ 41612us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.721958 (+ 47648us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.943247 (+221289us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:28.113431 (+170184us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b180041d340. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:08:28.113601 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.113671 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.113713 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:28.113723 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.113851 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546215,"prepare.queue_time_us":41453,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":1362797,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":35285,"spinlock_wait_cycles":22011136,"thread_start_us":218105,"threads_started":2,"wal-append.queue_time_us":204295}
I20260709 13:08:28.161273 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:28.129057 25921 consensus_meta.cc:287] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:08:28.131551 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.157447 21810 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:28.103932 25887 raft_consensus.cc:2764] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:28.105299 26052 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:28.159097 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 63710.3us
I20260709 13:08:28.160413 21223 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:08:28.196193 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 114198us
I20260709 13:08:28.150700 25954 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.148391 25999 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.158325 25920 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.167045 25956 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.206604 21148 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:28.197500 25900 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.168145 25928 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.202941 21264 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:28.167312 26059 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.210798 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.211941 21219 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:28.158902 25938 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.200301 26039 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.222259 21219 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.228003 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.208972 25591 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:28.211444 25956 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.232501 25921 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:28.232720 26011 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:28.234026 25933 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.227135 25999 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:28.240024 21264 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:28.246505 21223 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.220012 25612 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.224562 25991 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.270206 21222 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:28.218694 25928 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.244804 25270 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.245299 25591 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.280093 25612 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.278923 21146 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:28.225517 26039 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.286302 21806 raft_consensus.cc:2468] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:28.291990 25954 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:28.258354 26052 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.298087 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.298372 21148 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.299700 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.302984 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:28.304001 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 64067.8us
I20260709 13:08:28.309378 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.311955 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.312743 21293 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:28.316972 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.317816 21293 raft_consensus.cc:2368] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:28.318660 21224 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:28.323606 26080 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.347354 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.347080 21224 raft_consensus.cc:1217] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-13.10]   Dedup: 6.7->[9.8-13.10]
W20260709 13:08:28.347713 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 112266us
I20260709 13:08:28.347069 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.352381 21296 raft_consensus.cc:2410] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:28.348191 21224 pending_rounds.cc:85] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 7
I20260709 13:08:28.354655 21224 pending_rounds.cc:107] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:08:28.354979 21224 raft_consensus.cc:2889] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.315469 26036 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.316486 25918 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.322417 26074 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.320130 26011 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.358176 21806 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:28.362854 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 56410.9us
I20260709 13:08:28.364004 21814 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:28.294567 25612 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:28.364531 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.356561 26047 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.868s	user 0.000s	sys 0.005s
I20260709 13:08:28.369017 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.369649 21296 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:28.369736 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.369554 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.371479 21297 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.356037 25929 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.354557 25973 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.359848 26052 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.356149 26080 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:28.372450 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:28.358033 25813 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.364893 26074 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.387637 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:28.435133 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.403388 21115 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:28.375380 26081 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.462121 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:28.462297 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59475us
I20260709 13:08:28.403875 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.463099 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.467451 21296 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:28.401919 26074 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.434031 26011 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:28.445683 26057 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.443795 25956 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.441344 25938 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.445489 26079 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.487897 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.491739 25922 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.494576 21264 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:28.495540 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.495952 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.496450 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.497064 21292 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.497432 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 763) took 1545 ms. Trace:
I20260709 13:08:28.497848 21218 rpcz_store.cc:276] 0709 13:08:26.951623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.951763 (+   140us) service_pool.cc:224] Handling call
0709 13:08:28.497260 (+1545497us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540038ac54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:28.497366 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718440832}
I20260709 13:08:28.392326 26078 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:08:28.499589 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:28.499683 25591 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.500448 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.500982 21291 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.503765 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:28.504976 21191 leader_election.cc:400] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
W20260709 13:08:28.505358 21225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 768) took 1529 ms (client timeout 1572 ms). Trace:
I20260709 13:08:28.505595 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.505767 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.506683 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.506863 21191 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:28.467768 25933 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.507884 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:28.505777 21225 rpcz_store.cc:269] 0709 13:08:26.975644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.994396 (+ 18752us) service_pool.cc:224] Handling call
0709 13:08:28.505155 (+1510759us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540035b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:28.505302 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359709568}
W20260709 13:08:28.512427 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.510715 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.521070 21776 leader_election.cc:400] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14.
I20260709 13:08:28.521426 21776 leader_election.cc:403] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.499011 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.521981 21218 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:28.516283 25994 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.510080 26022 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11.
I20260709 13:08:28.524233 26078 raft_consensus.cc:2804] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.524883 26078 raft_consensus.cc:697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:28.525542 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.525795 26078 consensus_queue.cc:237] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.527558 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.528342 21806 raft_consensus.cc:2393] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 11: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:28.516687 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.529531 21144 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:28.527118 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.531316 25938 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.524483 25994 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.534024 21292 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:28.533272 21191 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:28.531567 25591 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.539546 21217 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:28.539331 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:28.578300 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.542311 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.577754 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 44559.5us
I20260709 13:08:28.582224 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:28.540036 21297 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
W20260709 13:08:28.578769 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 62374.2us
I20260709 13:08:28.507503 26015 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.587088 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.591631 21297 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.512642 25978 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.514706 25921 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.587638 25890 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.489323 26039 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.595594 21225 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:28.596612 25929 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:28.402096 25954 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.509696 26030 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.597955 21291 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:28.591660 26057 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:28.602430 26056 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.677156 26057 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.678205 21296 raft_consensus.cc:2368] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14.
I20260709 13:08:28.678884 26056 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:28.514216 26036 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:28.400840 25813 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.608069 21147 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.592973 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:28.535692 25922 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:28.591565 26077 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:28.612115 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:28.549240 26022 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:28.612828 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 73615.9us
W20260709 13:08:28.640580 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43551us
I20260709 13:08:28.474015 26081 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.596055 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.548861 25591 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:28.657667 25921 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.710394 21809 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: [8.9-13.12]
I20260709 13:08:28.692236 25887 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:28.693537 26030 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:28.693931 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 101074us
W20260709 13:08:28.695495 26086 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:28.591212 25973 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:28.699028 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.596424 25918 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.592371 26015 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.733830 26015 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:28.656507 25975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.044s	sys 0.056s
I20260709 13:08:28.706983 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:28.707196 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:28.737581 21807 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.737679 21810 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:28.738170 21295 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:28.708674 21811 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:28.519528 26079 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:28.612634 25999 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.592198 26084 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:08:28.705574 25929 consensus_queue.cc:1243] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:28.732016 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:28.680699 25322 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:28.711081 25781 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.709487 26022 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:28.593003 26038 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:08:28.595367 25956 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:08:28.745102 21812 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:28.474138 26080 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.731094 25918 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:28.751313 26044 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.754078 21147 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:28.756992 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.684006 26036 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.759501 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.738572 25887 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.761063 26081 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:28.737192 26030 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:28.771842 25813 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:28.773324 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.776274 25994 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:28.741587 25975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.045s	sys 0.072s
W20260709 13:08:28.743439 26055 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 1.079s	user 0.004s	sys 0.000s
I20260709 13:08:28.782512 21293 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:28.788233 21811 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:28.784351 25918 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.787027 21225 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:28.789147 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.752879 25900 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.754653 25612 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:28.777592 26022 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:28.797574 26051 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.118s	user 0.003s	sys 0.000s
I20260709 13:08:28.792037 26057 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:28.805223 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.781808 25972 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:08:28.798879 26082 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:08:28.780256 25781 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.807014 21225 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:28.789170 26044 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.733237 21191 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:28.810204 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:28.823493 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 90375us
I20260709 13:08:28.825004 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:28.730507 21221 raft_consensus.cc:2376] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11. Re-sending same reply.
I20260709 13:08:28.816161 21225 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.835477 21807 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:28.744333 25973 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:28.849116 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55550 (request call id 2828) took 1241 ms. Trace:
I20260709 13:08:28.855856 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.859336 21142 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.855646 21226 rpcz_store.cc:276] 0709 13:08:27.607898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.611428 (+  3530us) service_pool.cc:224] Handling call
0709 13:08:28.848869 (+1237441us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54000fc654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:28.849044 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976151808}
I20260709 13:08:28.859828 21142 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:28.865342 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.866215 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:28.867497 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:28.811457 25900 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:28.870141 26093 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:28.877199 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:28.870004 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.877767 21151 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.878404 21149 raft_consensus.cc:2410] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:28.864924 21142 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:28.847574 25975 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:28.881086 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:28.876704 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:28.882669 21225 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.893144 21143 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 15: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:28.895183 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:28.867182 25961 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.898876 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 960) took 1505 ms. Trace:
I20260709 13:08:28.877084 25890 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14.
W20260709 13:08:28.903718 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 162083us
I20260709 13:08:28.808717 26030 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:28.910156 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 168078us
I20260709 13:08:28.910948 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:28.912562 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:28.909633 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:28.899420 21294 rpcz_store.cc:276] 0709 13:08:27.393335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.449313 (+ 55978us) service_pool.cc:224] Handling call
0709 13:08:27.470593 (+ 21280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.479351 (+  8758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.479399 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.505080 (+ 25681us) log.cc:844] Serialized 52 byte log entry
0709 13:08:27.675413 (+170333us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:27.675455 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.675516 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.699888 (+1024372us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:28.884190 (+184302us) raft_consensus.cc:1685] finished
0709 13:08:28.884212 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.898791 (+ 14579us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1280,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2211,"spinlock_wait_cycles":5954432,"thread_start_us":91601,"threads_started":1,"wal-append.queue_time_us":104903}
I20260709 13:08:28.922423 21151 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
W20260709 13:08:28.929363 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.937829 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.987108 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 59672.1us
I20260709 13:08:28.990306 21097 placement_policy_util.cc:248] tablet df140636c4344f32a0253fef2a907c50: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 13:08:29.066946 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.920217 25921 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.091168 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 1095) took 1014 ms. Trace:
I20260709 13:08:28.921943 25938 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.092597 21808 rpcz_store.cc:276] 0709 13:08:28.076605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.076735 (+   130us) service_pool.cc:224] Handling call
0709 13:08:29.090991 (+1014256us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540012edd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:29.091113 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50192128}
I20260709 13:08:29.095695 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:29.096697 21807 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.927464 25994 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.095752 21189 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.121028 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2839) took 1202 ms. Trace:
I20260709 13:08:29.124991 21807 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:29.125869 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:29.126391 21807 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.132689 21807 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:29.135720 21300 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:29.121605 21219 rpcz_store.cc:276] 0709 13:08:27.918862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.254695 (+335833us) service_pool.cc:224] Handling call
0709 13:08:28.271492 (+ 16797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.281941 (+ 10449us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:28.388711 (+106770us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.534689 (+145978us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.548168 (+ 13479us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.581295 (+ 33127us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:28.581340 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.581404 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.120735 (+539331us) raft_consensus.cc:1685] finished
0709 13:08:29.120773 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.120952 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13212,"prepare.queue_time_us":179803,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":656,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5765,"thread_start_us":181815,"threads_started":2,"wal-append.queue_time_us":363103}
W20260709 13:08:29.092981 25995 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.964s	user 0.006s	sys 0.008s
I20260709 13:08:29.145588 21297 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.148778 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:29.158412 25958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.481s	user 0.066s	sys 0.042s
W20260709 13:08:29.158979 25958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.066s	sys 0.042s
I20260709 13:08:29.160394 21811 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:29.087100 26079 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:28.937430 25999 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 13:08:29.089663 25961 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:29.245116 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.280402 21300 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:29.094213 25938 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:29.273993 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.165313 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:29.279845 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:29.071269 26024 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:08:29.105013 25892 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.124068 26036 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.293728 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.295650 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:28.937300 25973 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.159768 25994 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:29.275151 26056 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.316593 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.323197 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.328307 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.285475 25938 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.290694 25887 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:29.163458 26038 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:08:29.163679 25995 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.320691 26036 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:29.305428 25813 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.346166 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 250413us
I20260709 13:08:29.369928 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:29.370837 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 381900us
I20260709 13:08:29.329267 25781 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.376492 21812 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:29.381963 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:29.382386 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.382717 21151 raft_consensus.cc:3060] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.383278 21144 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:29.297530 25892 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.370995 26099 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:29.376559 26078 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.384814 25813 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.377496 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:29.395443 25887 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.399574 21151 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:29.399946 25961 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.400471 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:29.347621 26044 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.363883 26036 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:29.343209 26056 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.367435 25975 raft_consensus.cc:697] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:29.399459 25543 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:29.403771 26059 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.174s	user 0.008s	sys 0.005s
I20260709 13:08:29.428151 21294 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:29.161945 25958 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:29.427493 25887 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:29.435693 26011 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.004s
W20260709 13:08:29.454741 26029 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.425s	user 0.013s	sys 0.000s
I20260709 13:08:29.538661 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.538877 26029 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.539465 26105 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.439360 26107 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:29.540059 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.540397 26036 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.541193 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.426597 26078 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.541438 21220 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.488374 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.454638 26059 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12.
I20260709 13:08:29.504922 25892 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:29.454478 25543 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.506548 25958 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.435427 25994 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.548977 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.510875 26056 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.512871 25900 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:29.454900 26111 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:29.454924 26094 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.547s	user 0.000s	sys 0.001s
I20260709 13:08:29.480129 26011 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.537699 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 777) took 1455 ms. Trace:
I20260709 13:08:29.475839 26102 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.561931 21217 rpcz_store.cc:276] 0709 13:08:28.082126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.088002 (+  5876us) service_pool.cc:224] Handling call
0709 13:08:29.537531 (+1449529us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540038c054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:29.537642 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992301312}
W20260709 13:08:29.503192 26100 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:08:29.542794 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.566113 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.541042 26029 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:29.474284 21225 consensus_meta.cc:287] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
W20260709 13:08:29.462961 25918 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.652s	user 0.003s	sys 0.006s
I20260709 13:08:29.546398 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:29.572674 21225 raft_consensus.cc:2468] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:29.573462 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.549592 21151 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:29.464614 25995 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.464123 25887 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.560020 25890 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:29.526935 26022 consensus_meta.cc:287] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.002s
I20260709 13:08:29.563100 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:29.588440 21808 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:29.589314 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:29.563897 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:29.564198 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:29.554298 25933 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 1.015s	user 0.006s	sys 0.006s
I20260709 13:08:29.545411 25564 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:29.544759 25956 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.598366 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:29.582623 25672 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.543052 21143 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:29.555073 25892 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.578451 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.465801 25813 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:29.604598 25564 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:29.583714 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 213872us
I20260709 13:08:29.610489 25892 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.611825 21189 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:29.612632 26029 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:29.612730 25956 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.613279 26029 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:29.613971 25543 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.614202 26029 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.612637 25564 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:29.598250 25933 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.591001 25890 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.571483 26102 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.621516 25890 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.622166 26102 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.622095 25672 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.570012 26111 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:29.624119 26078 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.624086 26111 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:29.625147 26074 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.140s	user 0.008s	sys 0.004s
I20260709 13:08:29.625560 26074 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.627684 21151 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:29.465022 25975 consensus_queue.cc:237] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:29.595461 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 293064us
W20260709 13:08:29.577924 26015 consensus_meta.cc:287] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.001s
I20260709 13:08:29.566730 21145 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:29.577214 25918 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.592276 26022 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:29.581817 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 416604us
I20260709 13:08:29.628489 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.634140 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.628901 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:29.630009 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.630646 21808 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:29.614939 25956 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.632272 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.633040 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 891) took 1107 ms. Trace:
I20260709 13:08:29.636197 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.638655 21299 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
W20260709 13:08:29.671592 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.676950 21225 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.634027 26102 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.679471 26102 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.689777 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:29.690644 21145 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
W20260709 13:08:29.713443 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77321.2us
I20260709 13:08:29.714473 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:29.715209 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 82999us
W20260709 13:08:29.689693 26103 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:29.639848 26107 raft_consensus.cc:2764] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:29.730278 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.638293 21148 rpcz_store.cc:276] 0709 13:08:28.520394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.520810 (+   416us) service_pool.cc:224] Handling call
0709 13:08:28.527629 (+  6819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.528002 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:28.528034 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.528490 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.794213 (+265723us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:28.794262 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.794323 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.627242 (+832919us) raft_consensus.cc:1685] finished
0709 13:08:29.627277 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.627398 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9163,"raft.queue_time_us":2837,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":265342,"threads_started":1,"wal-append.queue_time_us":333870}
I20260709 13:08:29.746701 21222 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:29.747957 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.750527 25900 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:29.751183 25918 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.753093 26022 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.753813 25900 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:29.756072 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.756914 25900 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.756683 25938 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.758949 25938 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.699236 26074 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.728863 26105 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:29.762243 21778 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.634277 26015 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.732012 26121 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:29.768338 26105 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.771433 26121 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:29.771761 26105 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:29.771983 26121 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:29.772439 26015 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.775429 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1278) took 1069 ms. Trace:
I20260709 13:08:29.709021 25672 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:29.731810 25922 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:29.776013 21806 rpcz_store.cc:276] 0709 13:08:28.706358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.740245 (+ 33887us) service_pool.cc:224] Handling call
0709 13:08:28.740628 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.083322 (+342694us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:29.345528 (+262206us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.634238 (+288710us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.638246 (+  4008us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.638387 (+   141us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:29.709352 (+ 70965us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.709594 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.709694 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.775068 (+ 65374us) raft_consensus.cc:1685] finished
0709 13:08:29.775100 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.775331 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84177,"prepare.queue_time_us":516613,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":27813,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":16588,"thread_start_us":838308,"threads_started":3,"wal-append.queue_time_us":412766}
I20260709 13:08:29.778169 25922 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:29.778568 21221 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:29.796196 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.818146 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:29.820981 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.779934 25890 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.828420 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:29.842957 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.826948 21263 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.846946 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.845683 21222 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:29.847908 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:29.849310 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:29.765071 26115 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:08:29.852144 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:29.856586 21116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.885s (SENT) [suppressed 32 similar messages]
I20260709 13:08:29.862684 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:29.863365 26056 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:29.825675 26080 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.825487 26074 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.845566 25672 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:29.813905 26015 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:08:29.826524 26110 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:29.779124 25922 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.845584 25805 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.860652 26079 raft_consensus.cc:2804] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:29.859683 26078 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.859577 25956 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.868893 25994 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.894925 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.867980 25995 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:29.869241 25921 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:29.892081 25672 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.916735 21149 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:29.898206 25805 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.893028 26056 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:29.926256 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.911131 26059 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.911917 25995 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.906822 25956 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:29.917429 25921 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:29.935849 26128 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:08:29.923198 26079 raft_consensus.cc:697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:29.925827 25805 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.937119 26079 consensus_queue.cc:237] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:29.939711 26136 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:29.940621 26056 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:29.946548 21293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2426) took 1454 ms (client timeout 1740 ms). Trace:
W20260709 13:08:29.947139 21293 rpcz_store.cc:269] 0709 13:08:28.492452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.495691 (+  3239us) service_pool.cc:224] Handling call
0709 13:08:29.946300 (+1450609us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540001ac54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:29.946453 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657336576}
I20260709 13:08:29.948659 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.949432 21293 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:29.952371 25900 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.952428 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.954770 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1277) took 1248 ms. Trace:
I20260709 13:08:29.955240 21805 rpcz_store.cc:276] 0709 13:08:28.706015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.706153 (+   138us) service_pool.cc:224] Handling call
0709 13:08:29.091807 (+385654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:29.117079 (+ 25272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.117124 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:29.159875 (+ 42751us) log.cc:844] Serialized 52 byte log entry
0709 13:08:29.556963 (+397088us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:29.819121 (+262158us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.822776 (+  3655us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.885906 (+ 63130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.886020 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.886080 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:29.886097 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.954561 (+ 68464us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540012edd0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:29.954692 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80371,"prepare.queue_time_us":80329,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":10358,"raft.queue_time_us":205218,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":46388,"spinlock_wait_cycles":834233856,"thread_start_us":560674,"threads_started":3,"wal-append.queue_time_us":311619}
I20260709 13:08:29.957105 26105 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.919831 25892 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:29.960019 25956 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:29.962414 21296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2417) took 1481 ms (client timeout 1655 ms). Trace:
W20260709 13:08:29.962831 21296 rpcz_store.cc:269] 0709 13:08:28.481436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.481646 (+   210us) service_pool.cc:224] Handling call
0709 13:08:29.962188 (+1480542us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540022e7d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:29.962346 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418411776}
I20260709 13:08:29.963481 25995 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.963963 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.964705 21296 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:29.965945 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.966753 25892 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:29.967111 25892 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.967468 25892 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.894760 26080 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.975085 25892 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:29.891659 26074 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:29.921217 25672 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.984606 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.985214 21222 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:29.977541 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:29.986217 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:29.986956 21293 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:29.989799 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:29.980225 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 123670us
I20260709 13:08:29.983177 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:29.991755 21814 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.003954 21300 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
W20260709 13:08:29.984340 26114 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:30.008342 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.008641 21805 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:29.994998 26105 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.014577 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2847) took 1086 ms. Trace:
I20260709 13:08:30.015022 21219 rpcz_store.cc:276] 0709 13:08:28.927779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.325274 (+397495us) service_pool.cc:224] Handling call
0709 13:08:29.325602 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.695367 (+369765us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:29.695420 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.696447 (+  1027us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.819961 (+123514us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:29.819991 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.820062 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.014367 (+194305us) raft_consensus.cc:1685] finished
0709 13:08:30.014389 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.014517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150448,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5627,"thread_start_us":417486,"threads_started":2,"wal-append.queue_time_us":283535}
I20260709 13:08:30.016844 26080 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.016909 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.018594 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:29.998884 25900 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.019629 25900 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.020016 25900 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.985391 26115 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.037261 26115 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.020910 26011 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.041020 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.040812 26011 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.004810 25890 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.043537 25890 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.043967 25890 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.020234 26074 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.024314 21219 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:30.029858 26102 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.034416 25956 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.036113 26121 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.053467 21814 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:30.057988 21219 raft_consensus.cc:1275] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:30.043095 26011 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:30.064213 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 167788us
I20260709 13:08:30.065793 26143 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.020370 25591 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.066562 25591 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.066329 26143 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.068753 26143 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.059165 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:30.071442 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.077793 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:30.080451 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.081278 21294 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
W20260709 13:08:30.082156 21146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1750) took 2465 ms (client timeout 1611 ms). Trace:
I20260709 13:08:30.083345 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:30.082592 21146 rpcz_store.cc:269] 0709 13:08:27.612562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.618836 (+  6274us) service_pool.cc:224] Handling call
0709 13:08:30.077639 (+2458803us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400066154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:30.077745 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218838272}
I20260709 13:08:30.084892 25805 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.062642 26113 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:30.084091 26056 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:30.087020 25805 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.078044 26011 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.091147 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:30.096593 21814 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.098351 26121 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.095069 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.099422 26074 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.101814 26079 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.105674 25900 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.107404 25958 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.107936 25958 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.108489 25956 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.108633 25995 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.109078 25956 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.109577 25956 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.109853 25958 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.110294 21142 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.111716 21296 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:30.111909 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.093008 25921 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.117588 21814 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:30.118359 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:30.119199 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.077082 26148 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:30.133332 21776 leader_election.cc:336] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.572s (SENT)
I20260709 13:08:30.133795 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.120533 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:30.121254 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2420) took 1630 ms. Trace:
I20260709 13:08:30.122910 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:30.097594 26056 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.137686 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:30.138204 21814 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.139389 21142 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:30.140085 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2251) took 1282 ms. Trace:
I20260709 13:08:30.132846 21115 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:30.135550 21295 rpcz_store.cc:276] 0709 13:08:28.490647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.499352 (+  8705us) service_pool.cc:224] Handling call
0709 13:08:30.121068 (+1621716us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400033c54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:30.121200 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546726656}
I20260709 13:08:30.140479 21142 rpcz_store.cc:276] 0709 13:08:28.857388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.858852 (+  1464us) service_pool.cc:224] Handling call
0709 13:08:28.859184 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.109717 (+1250533us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b58007151d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcd60aa 00007f2b6dd58447 00007f2b6dd70fe7 00007f2b6dd727de 00007f2b6dd7cb49 00007f2b6dd7d416 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4
0709 13:08:30.139765 (+ 30048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.140008 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70738304}
I20260709 13:08:30.149904 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.150710 21219 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:30.147007 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.159755 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.335021 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:30.339597 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 206826us
I20260709 13:08:30.343487 21814 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:30.344463 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.345355 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.346242 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.143080 26059 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.356103 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.390983 21219 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:30.391891 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.392709 21219 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:30.393196 26079 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.393743 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.356808 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:30.357767 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:30.143828 26056 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.145977 26074 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.347558 26115 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.401162 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:30.401721 21222 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.388593 21808 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:30.388774 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 251140us
I20260709 13:08:30.403013 21219 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:30.404553 21812 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.144361 25958 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.388698 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2845) took 1463 ms. Trace:
W20260709 13:08:30.144608 25676 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:08:30.350553 21814 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:30.397276 21218 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:30.139569 26011 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:30.350629 25921 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.406134 21295 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:30.143987 26078 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.247s
I20260709 13:08:30.410537 21226 rpcz_store.cc:276] 0709 13:08:28.924952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.925093 (+   141us) service_pool.cc:224] Handling call
0709 13:08:28.925383 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.925559 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:30.111010 (+1185451us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.388297 (+277287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.388359 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:30.388412 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.388485 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.388638 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1396143,"prepare.queue_time_us":1185668,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1471,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3455,"thread_start_us":276916,"threads_started":1}
I20260709 13:08:30.412066 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.413192 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.424960 26110 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.448269 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.398300 25994 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.429173 21299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2857) took 2131 ms (client timeout 1885 ms). Trace:
I20260709 13:08:30.431284 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.434543 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.390125 25956 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.390535 26059 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.452811 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.453297 21224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 776) took 2358 ms. Trace:
W20260709 13:08:30.451994 21299 rpcz_store.cc:269] 0709 13:08:28.297666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.297812 (+   146us) service_pool.cc:224] Handling call
0709 13:08:30.428906 (+2131094us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540001b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:30.429052 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2883971328}
I20260709 13:08:30.407770 26105 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.460112 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.460291 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.409950 26015 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.471331 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.472705 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 779) took 2390 ms. Trace:
I20260709 13:08:30.482654 21220 rpcz_store.cc:276] 0709 13:08:28.082699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.504141 (+421442us) service_pool.cc:224] Handling call
0709 13:08:28.504402 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.541863 (+1037461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.472387 (+930524us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400116a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.472624 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384572800}
I20260709 13:08:30.438591 26102 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.435839 26120 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.452214 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:30.441368 26133 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.453382 26110 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.460709 26059 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.457419 25921 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:30.498230 21222 raft_consensus.cc:2410] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:30.521078 21221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2844) took 1596 ms. Trace:
I20260709 13:08:30.521488 21221 rpcz_store.cc:276] 0709 13:08:28.924317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.925998 (+  1681us) service_pool.cc:224] Handling call
0709 13:08:28.926271 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.779093 (+852822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.520889 (+741796us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400116054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.521023 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959691008}
I20260709 13:08:30.457476 21224 rpcz_store.cc:276] 0709 13:08:28.078933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.335753 (+256820us) service_pool.cc:224] Handling call
0709 13:08:28.346890 (+ 11137us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:08:28.362110 (+ 15220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:28.476175 (+114065us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.700307 (+224132us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:28.701187 (+   880us) log.cc:844] Serialized 78 byte log entry
0709 13:08:28.701364 (+   177us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:28.706055 (+  4691us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.706436 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.632800 (+926364us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800270c40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:30.107966 (+475166us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b1800270c40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:08:30.108150 (+   184us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.427037 (+318887us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800270c40. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:30.437395 (+ 10358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.437467 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.437506 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:30.437515 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.437681 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1389861,"prepare.queue_time_us":3000776,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":143,"raft.queue_time_us":3750,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":18665,"spinlock_wait_cycles":53913472,"thread_start_us":575168,"threads_started":3,"wal-append.queue_time_us":299572,"wal-append.run_cpu_time_us":2774,"wal-append.run_wall_time_us":1033675}
W20260709 13:08:30.509161 25672 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.002s
I20260709 13:08:30.522867 25672 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.525297 25672 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.525789 21291 raft_consensus.cc:2368] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:30.514400 25928 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.519721 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.527802 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 887) took 2018 ms. Trace:
I20260709 13:08:30.527961 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.528167 21147 rpcz_store.cc:276] 0709 13:08:28.508931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.515007 (+  6076us) service_pool.cc:224] Handling call
0709 13:08:28.515323 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.784755 (+269432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.527602 (+1742847us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b540040e554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.527754 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212991232}
I20260709 13:08:30.529284 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.534412 21116 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.535449 26038 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:30.535965 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.536664 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:30.462759 25994 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.542992 21300 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:30.539556 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 775) took 2461 ms. Trace:
I20260709 13:08:30.540836 21144 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:30.540890 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.485248 26105 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:30.541836 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 128778us
I20260709 13:08:30.544859 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.530203 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.500310 26133 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.488124 26015 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.499599 26120 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.551808 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.504463 25890 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.552654 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.553387 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:30.554433 25890 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.499327 26102 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.558404 21148 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.542986 25672 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.560664 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:30.561964 21296 raft_consensus.cc:2376] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12. Re-sending same reply.
I20260709 13:08:30.476263 26011 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.541640 25970 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.546164 26038 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.572229 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.547801 25900 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.550711 25999 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.583918 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:30.578384 21296 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:30.571171 25672 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.575616 25970 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.585852 25933 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.593532 25933 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.599900 25933 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.606865 21810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1279) took 1900 ms. Trace:
I20260709 13:08:30.613116 21810 rpcz_store.cc:276] 0709 13:08:28.706607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.738448 (+ 31841us) service_pool.cc:224] Handling call
0709 13:08:28.738768 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.401834 (+663066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.401877 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.402459 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.632898 (+230439us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:29.698218 (+ 65320us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.698499 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.606416 (+907917us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54004ea054. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.606472 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.606531 (+    59us) raft_consensus.cc:1685] finished
0709 13:08:30.606632 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.606782 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64905,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":11766,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":29308,"spinlock_wait_cycles":1523914624,"thread_start_us":230054,"threads_started":1,"wal-append.queue_time_us":374412}
I20260709 13:08:30.608676 25994 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.588037 25978 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.616357 26133 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.616703 25978 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.618650 25930 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.619311 25930 consensus_queue.cc:1243] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:30.610792 26015 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.583412 25921 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.612084 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2850) took 1032 ms. Trace:
I20260709 13:08:30.623090 21225 rpcz_store.cc:276] 0709 13:08:29.579592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.579720 (+   128us) service_pool.cc:224] Handling call
0709 13:08:29.579979 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.677552 (+ 97573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.611869 (+934317us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54000eced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.612028 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222432640}
I20260709 13:08:30.612155 26105 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.626212 21191 leader_election.cc:400] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14.
I20260709 13:08:30.626667 21191 leader_election.cc:403] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.649510 21191 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:30.659677 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.660758 21296 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:30.661422 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.664942 21295 pending_rounds.cc:85] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:30.665309 21295 pending_rounds.cc:107] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:30.665594 21295 raft_consensus.cc:2889] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.545296 21223 rpcz_store.cc:276] 0709 13:08:28.078608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.310582 (+231974us) service_pool.cc:224] Handling call
0709 13:08:28.319286 (+  8704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.319554 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:28.447584 (+128030us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.517131 (+1069547us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b1800085660. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6d9224bc 00007f2b6ac7048b 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a23a
0709 13:08:30.334350 (+817219us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.539121 (+204771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.539189 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:30.539267 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.539353 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.539492 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":816754,"prepare.queue_time_us":1015859,"prepare.run_cpu_time_us":5394,"prepare.run_wall_time_us":32689,"raft.queue_time_us":3574,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4047,"spinlock_wait_cycles":2481920,"thread_start_us":448367,"threads_started":3,"wal-append.queue_time_us":280760,"wal-append.run_cpu_time_us":1360,"wal-append.run_wall_time_us":1038374}
I20260709 13:08:30.669912 21191 leader_election.cc:400] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:30.670359 21191 leader_election.cc:403] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.619139 25978 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:30.677613 21263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.014s	sys 0.027s
I20260709 13:08:30.682508 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.683035 21300 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:30.685227 21263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.014s	sys 0.028s
I20260709 13:08:30.685447 21291 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:30.685551 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 517092us
I20260709 13:08:30.683419 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.686446 21299 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:30.589368 25999 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.690531 25999 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.662665 26105 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14.
W20260709 13:08:30.694554 21298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2408) took 2383 ms (client timeout 1528 ms). Trace:
I20260709 13:08:30.671099 26039 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:30.694984 21298 rpcz_store.cc:269] 0709 13:08:28.311189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.315955 (+  4766us) service_pool.cc:224] Handling call
0709 13:08:30.694320 (+2378365us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540022d3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:30.694482 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293932800}
I20260709 13:08:30.695473 26039 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.697028 26120 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.697314 21292 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.647836 25975 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.697669 26039 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.697727 21292 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:30.670755 26015 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.644532 26164 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.698709 21292 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.698992 26164 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.699890 21292 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.663743 26078 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.700987 26078 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.702950 26078 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.679553 25994 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:30.684058 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:30.706430 21148 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:30.679400 25961 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:08:30.707324 25781 consensus_queue.cc:1175] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:08:30.708340 26036 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.708933 26162 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.709424 26059 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.710484 21293 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.701200 26164 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.720003 21292 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:30.721184 21292 pending_rounds.cc:85] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:30.721539 21292 pending_rounds.cc:107] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:30.721905 21292 raft_consensus.cc:2889] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.729158 21218 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:30.724988 26038 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:30.731559 21151 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:30.731827 26038 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.732165 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.733208 21223 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:30.731869 21221 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:30.731949 25672 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.732426 26038 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:30.740763 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:30.742312 21222 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:30.717052 25975 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:30.746369 26038 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:30.747622 25591 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.004s
I20260709 13:08:30.747691 26038 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.748638 21297 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:30.747581 26056 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.749373 25995 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.751714 25970 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.754006 26102 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.756660 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1769) took 1219 ms. Trace:
I20260709 13:08:30.752872 26110 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:30.758698 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 205397us
I20260709 13:08:30.757051 21149 rpcz_store.cc:276] 0709 13:08:29.537658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.545951 (+  8293us) service_pool.cc:224] Handling call
0709 13:08:29.546347 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.919238 (+372891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.756408 (+837170us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540040cc54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:30.756605 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851146112}
I20260709 13:08:30.759681 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.762173 26102 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.762801 26102 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.763846 26059 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.762223 25892 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.764887 26102 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.762121 26162 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:30.774348 21224 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
W20260709 13:08:30.776837 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.777895 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:30.780030 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.751030 26056 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:30.738081 26158 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.799672 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.801155 21218 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:30.758894 25975 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.758306 26080 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.840737 21142 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.842485 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.806826 25591 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:30.844957 21217 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:30.847617 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:30.852738 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.836200 25928 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:30.854417 25591 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.862355 21221 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:30.739581 25933 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:30.905833 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 53173.1us
I20260709 13:08:30.803399 25805 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.855103 25928 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:30.837116 25672 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.863898 26113 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:30.918567 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2423) took 2420 ms. Trace:
I20260709 13:08:30.907027 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.918946 21292 rpcz_store.cc:276] 0709 13:08:28.491607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.577213 (+ 85606us) service_pool.cc:224] Handling call
0709 13:08:30.697184 (+2119971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.725354 (+ 28170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.911361 (+186007us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b540022d3d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:30.911553 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4874719488}
I20260709 13:08:30.807574 21189 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:30.863901 26160 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:30.798067 25995 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.797839 26059 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.903506 25930 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.923134 21146 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.915786 25928 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:30.806654 26158 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.957477 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.837643 25929 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 13:08:30.926414 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 74717.5us
I20260709 13:08:30.950461 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.947407 26110 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.924268 26113 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.924348 26133 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:30.846508 26024 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:08:30.977814 26075 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.978400 26075 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.910684 25591 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.979601 25591 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:30.980580 26075 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:30.980512 25591 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:30.958279 21149 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:30.912109 26036 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:30.959276 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.984509 21144 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:30.959596 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.923192 25956 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.864602 26080 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.924520 26104 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.864513 26148 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:08:30.965598 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.989598 21145 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.975900 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.990397 21151 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:30.975746 25928 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:30.982239 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:30.922772 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 115252us
I20260709 13:08:30.985390 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.986658 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:30.986891 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:30.962386 21147 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:08:30.994485 21218 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:30.994517 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:30.997963 21220 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:30.995554 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.999584 21218 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:31.001020 26113 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:31.003157 26157 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.502s	user 0.002s	sys 0.000s
I20260709 13:08:31.003681 25928 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:31.004380 26165 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:31.007550 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:31.007867 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.008718 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.009037 26163 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:31.009464 26163 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:30.984694 26133 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.010202 26163 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.011348 21149 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:31.011853 26133 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.008872 25933 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.012635 21220 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
W20260709 13:08:31.012867 26151 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.603s	user 0.004s	sys 0.000s
I20260709 13:08:30.989512 26036 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.014967 26036 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:30.999619 26130 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.015947 26130 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.016310 26130 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:31.016887 26168 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:08:31.011428 26161 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:08:31.023809 21151 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:31.021754 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.022079 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:31.020922 21145 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:31.020843 21150 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:31.024435 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:30.950867 26059 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.025980 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 111326us
I20260709 13:08:30.990635 26104 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.032687 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.032970 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.033573 21291 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:31.034232 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.034657 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:31.035233 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.037127 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:30.959584 25930 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.039489 26075 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:31.040725 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.041451 26075 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:31.041715 26162 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:31.041965 26075 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.042201 26162 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.042603 26162 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.043524 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.045783 21300 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:31.047384 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.047945 21298 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:31.048444 25672 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.039536 26078 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:31.029661 26059 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.040176 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.054097 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.056489 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.059414 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.062389 21291 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:31.063555 21291 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:31.068256 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.069231 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.070763 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.071820 21300 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:31.072415 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.072122 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.073495 21148 raft_consensus.cc:2368] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:31.036233 26104 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.075243 21143 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:31.076907 21151 raft_consensus.cc:1275] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:31.060299 26110 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.050841 26162 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.039776 26164 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:08:30.950667 26160 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.042919 26075 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.071769 25929 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.054986 26102 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:31.064771 26029 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:08:31.096378 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 63798.8us
I20260709 13:08:31.083002 26110 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.102469 21297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 2859) took 1808 ms (client timeout 1532 ms). Trace:
I20260709 13:08:31.099387 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:31.102922 21297 rpcz_store.cc:269] 0709 13:08:29.293778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.295379 (+  1601us) service_pool.cc:224] Handling call
0709 13:08:31.102257 (+1806878us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540022ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:31.102400 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3329852800}
I20260709 13:08:31.102212 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.103138 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:31.100072 26155 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.558s	user 0.000s	sys 0.002s
I20260709 13:08:31.107769 21294 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:08:31.103624 21145 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.104245 21149 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:31.104800 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.107430 26167 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.108209 21294 pending_rounds.cc:85] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 9
I20260709 13:08:31.109730 21294 pending_rounds.cc:107] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:08:31.110069 21294 raft_consensus.cc:2889] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.110572 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.110956 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.111199 21144 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 6.
I20260709 13:08:31.113512 21189 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:31.115067 26166 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:08:31.116317 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1365) took 2014 ms. Trace:
I20260709 13:08:31.109424 26167 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.116963 26015 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:31.116667 21807 rpcz_store.cc:276] 0709 13:08:29.102309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.133340 (+ 31031us) service_pool.cc:224] Handling call
0709 13:08:29.133642 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.134031 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.134058 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.533450 (+1399392us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b2c0004cf78. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:30.533971 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.804174 (+270203us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:30.804231 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.804318 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.116033 (+311715us) raft_consensus.cc:1685] finished
0709 13:08:31.116054 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.116259 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845,"raft.queue_time_us":124,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":26784,"spinlock_wait_cycles":269725312,"thread_start_us":269782,"threads_started":1,"wal-append.queue_time_us":414376}
I20260709 13:08:31.118300 26167 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.126850 25970 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.127291 25970 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.127648 25970 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.132431 26162 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.133649 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.134228 21297 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.126158 26130 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.141064 26130 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.144472 26098 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:31.144908 26098 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:31.145128 21297 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:31.150262 21145 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:31.114841 25961 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:31.108170 26110 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.147689 25970 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.145774 26098 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:31.154297 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 51257.3us
I20260709 13:08:31.200768 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.107844 26171 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.113330 25543 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.098364 25929 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.193380 26101 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:31.162350 25995 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.178316 25874 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.208130 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:31.197885 26155 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:31.215709 21263 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.219185 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.219787 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.221326 21263 leader_election.cc:400] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:31.230305 21297 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:31.196794 26059 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.209340 26078 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.208866 26101 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.213740 25805 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.212430 25995 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.231616 26184 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.231725 26160 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.232621 26075 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:31.244907 25930 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.232286 25672 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.240748 26078 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:31.244426 26182 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:31.275241 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 1.19189e+06us
I20260709 13:08:31.278941 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.280072 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.280575 21291 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.280639 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.281205 21292 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.282497 26143 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.283003 26143 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:31.283525 26169 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.274s	user 0.003s	sys 0.000s
I20260709 13:08:31.211696 26130 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:31.285151 26143 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.287232 21297 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:08:31.295583 21292 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:31.289507 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:31.299768 21218 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.219172 25874 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.263099 25995 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.321380 21218 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:31.322484 21114 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.323450 21291 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:31.272950 26078 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.285741 26143 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.325119 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:31.325529 26143 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.327817 26143 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.328372 26147 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.328907 26147 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:31.331383 26175 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:08:31.337926 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:31.353176 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 1.21979e+06us
W20260709 13:08:31.354360 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47789us
I20260709 13:08:31.355841 21807 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:31.364943 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52196us
I20260709 13:08:31.331095 26147 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.377717 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.379982 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:31.385443 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 163075us
I20260709 13:08:31.390151 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.391014 21810 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:31.391299 26074 consensus_queue.cc:1048] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:31.392462 21294 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:31.392807 21294 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.393610 21294 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.394764 21294 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.397369 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.397466 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.397734 21143 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:31.377054 26187 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 13:08:31.306365 25961 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:08:31.363736 25813 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.310665 26167 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:08:31.332823 26038 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:31.404107 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:31.412926 21217 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:31.381453 26011 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:31.377537 25676 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.422358 25874 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.422441 25676 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.377849 26099 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:31.362993 26115 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.411036 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.388813 26044 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.412117 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.446089 21810 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:31.442525 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.395872 26133 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.421499 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.424476 26011 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:31.425724 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.463887 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.465118 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.465852 21814 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:31.429149 21147 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:31.358906 26101 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:31.413363 25975 consensus_meta.cc:287] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260709 13:08:31.384977 26075 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.446979 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:31.398514 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.477917 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.478299 21812 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:31.471681 21264 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.460692 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.462334 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.480479 21808 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 6.
I20260709 13:08:31.481506 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.472258 21115 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.488816 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:31.490350 21807 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 9: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:31.492177 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.492702 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.495620 21806 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.497881 21293 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:31.498433 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.498915 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.445263 26184 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.501603 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.501984 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:31.502310 21151 raft_consensus.cc:2393] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:31.502038 26184 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.502380 26011 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.504468 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:31.505431 21217 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.475601 26130 consensus_queue.cc:1243] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:31.507743 21264 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:31.515039 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.495208 26029 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.496421 25929 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.503237 26198 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.535117 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.536041 21812 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:31.508407 26106 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:31.460286 26099 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.460186 26115 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.487013 25975 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.508318 25672 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.559952 25672 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.561103 26198 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:31.548621 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.549248 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.529091 26130 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.550393 26190 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.520309 26059 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.546737 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.541056 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1295) took 1490 ms. Trace:
I20260709 13:08:31.571130 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.573105 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.574393 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.575690 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.576323 21812 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.519170 25933 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:31.558511 21217 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:31.541683 26106 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:31.588071 21221 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:31.545312 26044 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.579469 21805 rpcz_store.cc:276] 0709 13:08:30.051104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.051326 (+   222us) service_pool.cc:224] Handling call
0709 13:08:30.072850 (+ 21524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.073112 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:30.081834 (+  8722us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.274551 (+1192717us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18003cb680. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:08:31.443632 (+169081us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.540612 (+ 96980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.540681 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:31.540756 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.540842 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.540986 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13071,"prepare.queue_time_us":248024,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":1199353,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":18862,"spinlock_wait_cycles":6064000,"thread_start_us":253964,"threads_started":2}
I20260709 13:08:31.589850 21220 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:31.596866 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 78035.3us
I20260709 13:08:31.591185 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:31.595937 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 55436.3us
I20260709 13:08:31.598621 21806 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.534077 26029 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:31.601438 26189 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:31.604664 26099 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.582406 26192 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.606216 25975 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.580096 26196 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.607302 21806 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:31.638250 25900 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.607574 26044 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.609517 26115 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.597681 26106 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:31.598812 21776 connection.cc:256] RPC call timeout handler was delayed by -1.0879382319999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 13:08:31.612645 25890 consensus_queue.cc:1059] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:31.612798 21778 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.614588 26184 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:31.566416 26193 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.615108 21294 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:31.650262 21294 pending_rounds.cc:85] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 10
I20260709 13:08:31.650610 21294 pending_rounds.cc:107] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:31.650907 21294 raft_consensus.cc:2889] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.614595 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.615312 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.614024 25995 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.568632 26102 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.600659 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:31.653694 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 55078.4us
I20260709 13:08:31.654476 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.656551 21805 raft_consensus.cc:1275] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:31.656963 25995 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.655359 26102 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.657727 21805 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.657950 26102 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.654588 26207 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.614972 26110 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.659822 21221 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:31.660415 26029 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.622627 21812 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:31.661386 26110 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.637575 26196 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:31.662534 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.634948 26192 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:31.618414 26104 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:08:31.640009 21806 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:31.641911 26044 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:31.651571 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:31.551275 26075 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.683791 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.590705 25887 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:31.663662 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:31.664022 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51322.6us
I20260709 13:08:31.664713 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.665270 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:31.662359 26196 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.682441 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:31.723007 26143 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:31.671079 25921 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.722867 25564 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:31.722415 26199 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.736116 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.726748 21294 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.726401 21778 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:31.732736 26158 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.733099 26106 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.652841 25900 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.662694 26184 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.674146 25676 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.682924 26115 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.676617 26207 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:31.736835 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 73244us
I20260709 13:08:31.743767 21294 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:31.676774 25890 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:31.744041 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50168.1us
I20260709 13:08:31.737025 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.760900 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.787593 21115 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.736460 26024 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.786906 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2881) took 1122 ms. Trace:
I20260709 13:08:31.791138 21295 rpcz_store.cc:276] 0709 13:08:30.664235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.664374 (+   139us) service_pool.cc:224] Handling call
0709 13:08:30.664738 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:30.686992 (+ 22254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.687027 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:31.330698 (+643671us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b2c0006e2e8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:31.331248 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 13:08:31.565131 (+233883us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:31.565164 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.565343 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.766780 (+201437us) raft_consensus.cc:1685] finished
0709 13:08:31.766799 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.786834 (+ 20035us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":13236,"spinlock_wait_cycles":67301120,"thread_start_us":233392,"threads_started":1,"wal-append.queue_time_us":306554}
I20260709 13:08:31.724614 26147 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:08:31.787791 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 50802.2us
I20260709 13:08:31.810997 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.748603 26110 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.812791 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.797890 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.788234 25564 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:31.767489 26199 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.799754 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.799772 26078 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.788483 25887 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:31.803766 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:31.794679 26106 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.804857 21299 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:31.768002 26207 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:31.790529 25975 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.807224 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:31.687041 26104 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.787772 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1294) took 1803 ms. Trace:
I20260709 13:08:31.746193 26143 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.821674 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.725016 26099 raft_consensus.cc:3055] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:31.838258 26099 raft_consensus.cc:740] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:31.838883 26176 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.788s	user 0.007s	sys 0.011s
I20260709 13:08:31.839468 26080 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.839151 26099 consensus_queue.cc:260] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.840418 26099 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:31.840515 26197 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:08:31.841672 26104 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.834514 25887 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:31.830112 26207 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.843184 26078 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.736830 26200 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:08:31.812465 26024 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.831303 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.833448 21300 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:31.821928 26171 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:31.831503 26212 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:31.830683 25975 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:31.836390 26184 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:31.836627 26162 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.837790 25564 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.813525 26110 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:31.832209 21811 rpcz_store.cc:276] 0709 13:08:29.984473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.996585 (+ 12112us) service_pool.cc:224] Handling call
0709 13:08:29.997028 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:29.997431 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.997469 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:29.998117 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 13:08:30.076870 (+ 78753us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:30.093005 (+ 16135us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.522996 (+1429991us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.767440 (+244444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.787522 (+ 20082us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.787568 (+    46us) raft_consensus.cc:1685] finished
0709 13:08:31.787578 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.787705 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1232962,"prepare.queue_time_us":234818,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":1368254,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":17713,"thread_start_us":521753,"threads_started":4,"wal-append.queue_time_us":324594,"wal-append.run_cpu_time_us":2196,"wal-append.run_wall_time_us":1007173}
I20260709 13:08:31.873579 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.846657 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.845469 26143 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.808688 26115 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.847966 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.788277 26146 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:31.851447 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1297) took 1760 ms. Trace:
I20260709 13:08:31.853642 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.881343 21142 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.863718 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.864013 25892 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.866127 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.867100 21812 raft_consensus.cc:1275] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:31.892592 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.870083 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:31.871410 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.894023 21145 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.812016 25890 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.847635 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.874125 21811 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:31.895762 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.881428 21809 rpcz_store.cc:276] 0709 13:08:30.090755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.090913 (+   158us) service_pool.cc:224] Handling call
0709 13:08:30.091323 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.279702 (+1188379us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:31.279742 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.280290 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.343473 (+ 63183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:31.343510 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.343588 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.840013 (+496425us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:31.841327 (+  1314us) raft_consensus.cc:1685] finished
0709 13:08:31.841347 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.851369 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1187964,"raft.queue_time_us":1286618,"spinlock_wait_cycles":30280960,"thread_start_us":62868,"threads_started":1,"wal-append.queue_time_us":226490}
I20260709 13:08:31.896790 26184 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.872663 25975 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.897622 25922 raft_consensus.cc:2764] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:31.897877 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:31.897943 26193 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:31.903216 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.903717 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.919759 21811 raft_consensus.cc:2410] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:31.920047 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.904958 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.920580 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.921440 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.905548 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.874396 26219 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.916023 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:31.916031 21151 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.916971 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 102609us
I20260709 13:08:31.923985 21191 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:31.917184 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.903900 26110 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.924052 21806 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:31.938935 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.925485 26219 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.905393 26192 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.919088 25892 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.876255 25676 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:31.944190 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:31.944729 26075 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:31.955293 26075 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.956152 26223 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.956527 26075 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:31.901206 26199 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:31.950192 26147 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.957020 26223 consensus_queue.cc:1048] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:31.965385 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1750) took 1277 ms. Trace:
I20260709 13:08:31.918637 26184 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:31.965746 21225 rpcz_store.cc:276] 0709 13:08:30.688506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.688709 (+   203us) service_pool.cc:224] Handling call
0709 13:08:30.703745 (+ 15036us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:30.725600 (+ 21855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.725643 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:30.736967 (+ 11324us) log.cc:844] Serialized 52 byte log entry
0709 13:08:30.904262 (+167295us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:30.904306 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.904398 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.838383 (+933985us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:31.962141 (+123758us) raft_consensus.cc:1685] finished
0709 13:08:31.962160 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.965326 (+  3166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21387,"raft.queue_time_us":30326,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5413,"spinlock_wait_cycles":19619584,"thread_start_us":157954,"threads_started":1,"wal-append.queue_time_us":304377}
I20260709 13:08:31.974704 21145 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 7.
I20260709 13:08:31.974802 21142 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:31.936296 26104 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.976585 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.917987 25921 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:31.915547 26179 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:31.977001 21151 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:31.979709 21809 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:31.982098 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.905478 26146 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.944597 25922 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:31.965214 26215 log.cc:927] Time spent T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:31.938247 26162 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:08:32.035310 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:31.949555 26219 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.986495 25813 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:32.040103 25813 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.987067 26229 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:31.988426 26196 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:31.991727 26113 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:31.957924 26075 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.002311 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.045861 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:32.013454 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:32.016268 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:31.978699 26104 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:31.985045 26184 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.039040 21809 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:08:32.039014 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 44632.3us
I20260709 13:08:31.957948 26218 consensus_queue.cc:1059] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:32.040664 26171 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.057521 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 130034us
I20260709 13:08:32.053303 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:32.061765 21191 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:32.062433 21805 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:31.943519 25887 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.047554 26113 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:32.035109 26038 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:32.040059 26179 consensus_queue.cc:1243] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:32.051308 26104 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.054603 26183 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.090003 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:32.037483 25961 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:32.041034 26102 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.061054 25672 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.093822 26029 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:32.095932 26221 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:08:32.101333 25890 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:32.103348 26059 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.105067 26113 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.056896 26192 consensus_queue.cc:1048] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:08:32.105690 26143 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.061743 26171 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.122856 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.125725 25928 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:32.197935 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 134105us
W20260709 13:08:32.198141 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 75365.3us
I20260709 13:08:32.217190 26110 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.219307 26110 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.198820 26029 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:32.221292 26029 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.198952 25928 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.126586 26207 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.201753 26196 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.124537 25672 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.223570 25672 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.224292 26207 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.226604 21811 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:32.207669 25890 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.228377 26098 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.228479 25890 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.230782 26113 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.231418 21807 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.231630 26044 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.231948 21809 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:32.232049 26044 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:32.232877 26044 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.233983 26044 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.234493 25890 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.214718 25900 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:32.234994 21147 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.214895 26143 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:32.215600 21812 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.238442 21811 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:32.216009 25970 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.243520 21812 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:32.124388 25961 consensus_queue.cc:1243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:32.246958 26163 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.248224 25672 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.219753 25975 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.254989 21297 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.190675 26178 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:32.263236 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:32.267329 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:32.268972 21226 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.264123 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:32.270038 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.271497 21292 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:32.272842 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.273039 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.273640 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:32.274591 21224 raft_consensus.cc:2368] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:32.276074 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.297138 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.298316 21222 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:32.301066 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.302111 21225 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:32.304874 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.229311 26219 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.325831 21225 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 14. Ops: []
W20260709 13:08:32.321735 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 234495us
I20260709 13:08:32.278033 26178 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.332482 26178 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.334149 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:32.334949 21807 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:32.336925 21191 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:32.339960 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.342978 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.342936 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.343750 21224 raft_consensus.cc:2368] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10.
I20260709 13:08:32.308677 26240 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:32.322084 26230 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:32.345747 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.393721 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.348527 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.349347 25961 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.350138 25813 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.351732 21225 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.394925 21226 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:32.354687 26024 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.356769 26104 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.358732 21294 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:32.359197 26098 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:32.359423 21146 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:32.361884 21295 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:32.363581 25672 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.368621 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:32.368911 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.370921 26056 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.371567 21114 leader_election.cc:400] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10.
I20260709 13:08:32.444761 21114 leader_election.cc:403] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.444856 21811 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.376289 26219 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:32.383970 26171 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.384662 26102 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.387279 25975 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.389168 21190 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:32.453612 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 64529.9us
W20260709 13:08:32.454296 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.454593 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:32.390239 26237 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.112s	user 0.002s	sys 0.010s
W20260709 13:08:32.428952 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.435153 21218 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.455897 26171 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.390748 26230 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.439881 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:32.460390 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:32.460690 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:32.461279 21294 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:32.453174 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.463214 21221 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:32.433511 25961 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:32.448681 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 79454.4us
I20260709 13:08:32.441275 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:32.464947 21218 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.465758 21294 pending_rounds.cc:85] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 6
I20260709 13:08:32.470229 21294 pending_rounds.cc:107] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:08:32.466809 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:32.471459 21294 raft_consensus.cc:2889] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.436064 26098 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:32.481230 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.483000 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.488353 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.490362 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:32.490664 26111 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:32.491710 26111 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:32.492056 26111 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:32.492887 26111 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.494159 26111 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:32.498492 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.498991 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.500456 26104 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.451751 26024 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.500864 21778 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:32.450526 26056 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.502709 26219 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:32.502974 26056 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.450335 26229 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:32.503428 26218 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.507309 26244 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.507766 26244 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:32.507942 26098 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.506006 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:32.508498 26244 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.509261 21807 raft_consensus.cc:2410] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:32.480435 25975 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:08:32.512283 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.513473 21114 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.459566 26230 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.520561 21114 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.462245 26029 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.521319 25970 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.477380 26102 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.524771 26219 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:32.527375 26167 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.528643 25813 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.509227 26098 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.547829 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.542407 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:32.554822 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 119734us
I20260709 13:08:32.558557 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.511597 26113 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.561034 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:32.542235 26111 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.564320 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:32.538530 26241 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.571148 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:32.547223 25970 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:32.616989 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 155123us
I20260709 13:08:32.196687 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.618070 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:32.606050 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:32.553987 26219 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:32.621305 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 57104.6us
I20260709 13:08:32.622543 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:32.558626 26024 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10.
W20260709 13:08:32.665266 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 43706.2us
I20260709 13:08:32.666105 21148 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:32.560150 26233 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:32.672856 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.568176 26056 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:32.553970 26178 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:08:32.677412 26261 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:32.679275 26219 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.680503 26219 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:32.631494 26230 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:32.589660 25928 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.558395 25672 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:08:32.561898 26239 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:32.692200 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 69720.5us
I20260709 13:08:32.504971 25961 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.620383 26104 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:32.687162 26208 log.cc:927] Time spent T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:08:32.686125 26106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.050s	sys 0.073s
I20260709 13:08:32.707430 26258 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.703644 26230 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.691383 26056 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:32.726243 26256 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.726749 26256 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.726972 26056 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.666204 26183 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.735666 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:32.694382 25928 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.686576 26162 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.724853 26230 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:32.736006 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:32.734699 21190 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:32.736420 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:32.739188 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:32.745177 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:32.723536 26106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.050s	sys 0.076s
W20260709 13:08:32.751612 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 129656us
I20260709 13:08:32.752903 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:32.754012 21263 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:32.707424 26245 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.724700 26258 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.777253 21143 raft_consensus.cc:1275] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:32.741967 25591 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:32.778479 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:32.782966 21149 raft_consensus.cc:2410] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:32.777985 21147 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.783491 21150 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:32.773048 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.741153 26256 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.760722 26192 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.766906 25672 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.772228 26075 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:32.799706 21150 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:32.707638 25970 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.730302 26104 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.786101 26258 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.796278 26245 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:32.815943 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63070.1us
I20260709 13:08:32.813375 26240 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.795938 25591 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.811653 25672 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:32.812409 26075 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.825685 26240 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.838657 26240 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:32.828749 26260 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:32.803371 26230 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.856164 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.856567 26230 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.857051 21222 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:32.821385 26245 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:32.859612 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:32.859927 26245 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.862437 26240 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.862974 26240 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.863489 26240 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.864868 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:32.865603 26075 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.866482 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:32.866671 21806 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:08:32.867055 21806 pending_rounds.cc:85] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 10
I20260709 13:08:32.867298 21806 pending_rounds.cc:107] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:32.867539 21806 raft_consensus.cc:2889] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.809594 26264 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:32.863865 25928 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:32.876368 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.822363 26192 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:32.880125 26192 consensus_queue.cc:1243] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:32.880981 25672 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:32.884859 26240 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:32.886216 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.886124 26104 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:32.889370 26167 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.890702 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:32.891250 21224 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.894044 25591 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:32.915239 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.921041 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:32.895643 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:32.959453 21222 raft_consensus.cc:2393] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:32.913285 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.900123 21224 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:32.898893 26244 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.900718 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1796) took 1156 ms. Trace:
I20260709 13:08:32.962953 21148 rpcz_store.cc:276] 0709 13:08:31.744370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.744731 (+   361us) service_pool.cc:224] Handling call
0709 13:08:31.745007 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.672358 (+927351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.900437 (+228079us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400066154. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:32.900646 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116519552}
I20260709 13:08:32.961817 21218 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:32.961687 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:32.984373 21218 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:32.989647 21221 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:32.989770 21225 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:32.996263 26246 log.cc:927] Time spent T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.629s	user 0.008s	sys 0.000s
I20260709 13:08:32.999610 26200 raft_consensus.cc:3055] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.000084 26200 raft_consensus.cc:740] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:33.000932 26200 consensus_queue.cc:260] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.002542 21299 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.004294 26104 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:33.008752 26240 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.010337 26115 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:32.961393 26219 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.012251 26219 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.014544 26219 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:32.987278 26167 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:33.015698 26167 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:33.016793 26167 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:32.957546 26078 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.019479 26078 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:33.020272 26252 log.cc:927] Time spent T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
I20260709 13:08:33.020747 26194 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.021283 26194 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.027959 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.030846 21812 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:33.032202 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.033622 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.036346 21814 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.039829 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:33.027331 26200 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:33.049175 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.041083 25874 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.036190 26038 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:33.048924 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 314304us
I20260709 13:08:33.048254 25591 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.038965 26264 consensus_queue.cc:1048] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:33.050542 26078 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.041596 25928 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:33.043602 26059 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:33.085966 26115 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.054560 25874 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:33.053575 26024 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:08:33.126972 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 321167us
I20260709 13:08:33.047083 26075 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:08:33.138687 21223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:33.140300 21223 raft_consensus.cc:606] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:33.140791 21223 raft_consensus.cc:614] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.142629 21263 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:33.111574 26199 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.142274 25874 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.150079 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.151736 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.152365 21150 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:33.153065 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.154372 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.156144 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:33.111593 26245 consensus_queue.cc:1048] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:33.165582 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:33.162325 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.162868 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:33.163098 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.166951 21814 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 7: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:33.166903 21221 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:33.166208 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:33.168359 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.171015 26075 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:33.176070 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.141939 25887 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.181464 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:33.184363 21814 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.185179 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:33.154188 25591 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.134909 26229 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:33.162348 26056 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.203040 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:33.163916 26104 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:33.208844 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:33.216148 21812 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:33.211243 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.141412 26115 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.176462 26075 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.218627 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:33.158900 25928 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:33.228904 21218 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.229470 21222 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:33.225929 21809 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:33.160497 26162 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:08:33.229940 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:33.230765 21221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:33.232286 21221 raft_consensus.cc:606] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.232703 21221 raft_consensus.cc:614] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.161556 26199 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.243032 21144 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.243538 21144 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:33.245702 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.222935 26171 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.247797 21218 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:33.249028 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35748 (request call id 1799) took 1392 ms. Trace:
I20260709 13:08:33.249495 21146 rpcz_store.cc:276] 0709 13:08:31.850123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.920374 (+ 70251us) service_pool.cc:224] Handling call
0709 13:08:33.242714 (+1322340us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000852d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:33.242817 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007827328}
I20260709 13:08:33.244354 21144 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.253041 21144 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.255398 26115 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.258802 26146 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:33.260222 26273 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:08:33.241670 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:33.263432 21291 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.263842 21291 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:33.214571 25591 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.264627 21291 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.266525 25591 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.201654 25887 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.267633 26101 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.274736 26171 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.276054 21221 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:33.277118 26171 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:33.277470 26279 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 13:08:33.278244 26199 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.280251 21291 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.268227 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1389) took 1720 ms. Trace:
W20260709 13:08:33.284116 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.283833 21805 rpcz_store.cc:276] 0709 13:08:31.548024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.658514 (+110490us) service_pool.cc:224] Handling call
0709 13:08:31.658766 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.081958 (+423192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.268024 (+1186066us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540035aa54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:33.268178 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927957888}
I20260709 13:08:33.286434 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:33.288677 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:33.268724 21251 heartbeater.cc:646] Failed to heartbeat to 127.19.145.62:44287 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.145.62:44287 timed out after 15.000s (SENT)
W20260709 13:08:33.271039 26210 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.449s	user 0.005s	sys 0.012s
I20260709 13:08:33.271394 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:33.272112 26271 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:33.300381 21814 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:33.272541 21144 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:33.231319 26075 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.273496 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:33.289512 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.231830 26104 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:33.231488 26194 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.329133 21263 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.291994 21220 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:33.297924 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.299319 21291 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:33.331887 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2897) took 1905 ms. Trace:
I20260709 13:08:33.332171 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:33.304342 21144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1801) took 1420 ms. Trace:
I20260709 13:08:33.336458 25591 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:33.337158 26074 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:08:33.332904 25999 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:08:33.288121 26258 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.357376 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2902) took 1304 ms. Trace:
I20260709 13:08:33.363893 21292 rpcz_store.cc:276] 0709 13:08:32.052902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.053642 (+   740us) service_pool.cc:224] Handling call
0709 13:08:32.066620 (+ 12978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.271956 (+205336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.357045 (+1085089us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540022ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:33.357303 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470613888}
I20260709 13:08:33.344666 25591 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:33.332221 21291 rpcz_store.cc:276] 0709 13:08:31.426697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.426842 (+   145us) service_pool.cc:224] Handling call
0709 13:08:31.427103 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.263344 (+1836241us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54002fd3a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:08:33.280102 (+ 16758us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58005045d0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcd60aa 00007f2b6dd58447 00007f2b6dd70fe7 00007f2b6dd727de 00007f2b6dd7cb49 00007f2b6dd7d416 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4
0709 13:08:33.331621 (+ 51519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.331825 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222100992}
W20260709 13:08:33.344269 26270 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:33.379455 21144 rpcz_store.cc:276] 0709 13:08:31.884352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.923666 (+ 39314us) service_pool.cc:224] Handling call
0709 13:08:31.923918 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.242948 (+1319030us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003f50a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:08:33.303880 (+ 60932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.304272 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383213952}
I20260709 13:08:33.337622 26285 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:33.379784 26194 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.388680 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56730.9us
I20260709 13:08:33.391734 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.392652 21144 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:33.393942 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.394673 21220 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:33.399515 21151 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:33.403644 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:33.403945 26276 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:33.404417 21144 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:33.409339 21300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 984) took 2132 ms. Trace:
I20260709 13:08:33.380640 26286 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.350828 25672 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:33.411984 21300 rpcz_store.cc:276] 0709 13:08:31.276734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.278129 (+  1395us) service_pool.cc:224] Handling call
0709 13:08:31.278505 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.859510 (+581005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.409123 (+1549613us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540018c4d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:33.409278 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275745664}
I20260709 13:08:33.416579 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.418128 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:33.399068 25887 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.408062 26078 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:33.426366 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.409991 26115 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.430624 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:33.429378 26287 log.cc:927] Time spent T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:33.433204 25928 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.431427 26286 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.433758 25928 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.433907 26286 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:33.434295 25928 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.434392 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.434425 26286 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.435591 21146 raft_consensus.cc:1240] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.429888 26269 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:33.444078 26284 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:33.448073 26286 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:33.450119 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.452407 21149 raft_consensus.cc:1240] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:33.453565 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.454388 21147 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:08:33.455514 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.450933 25892 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.455840 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.396919 26194 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.469121 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:33.458765 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.457350 21146 raft_consensus.cc:2410] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:33.469871 21143 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
I20260709 13:08:33.470295 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:33.470969 21146 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 7: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:33.470906 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.421909 26285 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:33.469846 21149 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:33.428175 26078 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.481696 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.484840 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:33.456548 26239 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:33.488204 21145 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:33.479740 26078 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.415887 26104 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.504997 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.507423 21146 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:33.508443 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.456807 26115 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.517151 26115 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.506304 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:33.517846 26183 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.518428 26183 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:33.519094 26243 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.160s	user 0.009s	sys 0.006s
I20260709 13:08:33.519646 21293 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:33.520375 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1316) took 1506 ms. Trace:
I20260709 13:08:33.520749 21808 rpcz_store.cc:276] 0709 13:08:32.014338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.014481 (+   143us) service_pool.cc:224] Handling call
0709 13:08:32.014913 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.044679 (+ 29766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.044733 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.050534 (+  5801us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.259864 (+209330us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:32.259899 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.259960 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.518489 (+1258529us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:33.520086 (+  1597us) raft_consensus.cc:1685] finished
0709 13:08:33.520108 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.520317 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23917,"raft.queue_time_us":29310,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10836,"spinlock_wait_cycles":88741248,"thread_start_us":173151,"threads_started":1,"wal-append.queue_time_us":271578}
I20260709 13:08:33.522171 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2455) took 1858 ms. Trace:
I20260709 13:08:33.522560 21293 rpcz_store.cc:276] 0709 13:08:31.663867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.664443 (+   576us) service_pool.cc:224] Handling call
0709 13:08:33.521999 (+1857556us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000c5b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:33.522119 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4123485440}
I20260709 13:08:33.503583 26239 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.525125 26239 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.525710 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1323) took 1244 ms. Trace:
I20260709 13:08:33.526100 21811 rpcz_store.cc:276] 0709 13:08:32.281094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.281261 (+   167us) service_pool.cc:224] Handling call
0709 13:08:32.281626 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.445469 (+163843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.525491 (+1080022us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400391f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:33.525655 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375017344}
W20260709 13:08:33.528997 26288 log.cc:927] Time spent T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:33.530937 26194 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.529006 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:33.531801 21292 raft_consensus.cc:2393] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:33.538679 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.541419 25922 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.541816 25922 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:33.543316 21145 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:33.550819 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:33.555451 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 122930us
I20260709 13:08:33.532357 26075 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.560783 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:33.572386 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.570871 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:33.573170 21145 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:33.498615 26285 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.542768 25922 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:33.573750 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.578824 21147 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:08:33.554910 26200 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:08:33.560129 26044 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:33.586984 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.578667 26101 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:33.576268 26194 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:33.588716 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.588610 25922 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.577411 26258 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.589448 25672 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.586076 26269 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.582219 26059 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.590351 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 292502us
I20260709 13:08:33.600871 26269 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.601001 26059 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.601567 21190 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.602686 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:33.603420 25975 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.598444 26194 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.603873 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.604146 25975 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.604599 25975 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.604971 25975 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.605043 25961 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.605310 26194 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.596396 26101 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.606422 26101 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.606853 26267 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.607911 26229 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.608240 26229 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:33.609195 26229 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.610900 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:33.568343 26056 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:33.592306 26286 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.572341 26075 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:33.593755 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 162247us
I20260709 13:08:33.588627 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:33.589083 26044 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.590844 26171 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.612067 25961 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:33.617887 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.617697 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.574102 25874 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.603050 26269 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.603078 26059 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.641793 26235 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.641466 21226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2880) took 1210 ms. Trace:
I20260709 13:08:33.641870 21189 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:33.648408 21226 rpcz_store.cc:276] 0709 13:08:32.430726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.430904 (+   178us) service_pool.cc:224] Handling call
0709 13:08:32.431351 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.431774 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.431837 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.436357 (+  4520us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.511654 (+1075297us) spinlock_profiling.cc:243] Waited 942 us on lock 0x7b18003e0b00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:08:33.615508 (+103854us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:33.615551 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.615618 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.641137 (+ 25519us) raft_consensus.cc:1685] finished
0709 13:08:33.641159 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.641401 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3265,"raft.queue_time_us":12847,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":20274,"spinlock_wait_cycles":2167680,"thread_start_us":103682,"threads_started":1,"wal-append.queue_time_us":1165474}
W20260709 13:08:33.650420 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.654578 21151 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 15: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:33.620105 26075 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:33.639909 26302 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:33.657346 26296 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:33.645287 25961 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:33.659415 26162 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:33.671813 26162 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:33.672719 26162 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.674311 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:33.640825 25928 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:33.660210 26292 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:33.677150 25928 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.677834 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1102) took 3565 ms. Trace:
I20260709 13:08:33.660634 26235 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.680027 26235 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.680383 26235 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:33.680137 26078 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.681165 26235 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.682255 26078 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.682452 26235 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.683593 25961 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.685343 21293 raft_consensus.cc:2368] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:33.659149 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.639953 25970 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.707099 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:33.708000 21292 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:33.709460 21299 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.710667 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:33.717854 21295 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:33.666610 26044 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.666976 26075 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.686945 21809 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.661003 26282 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:33.690222 21805 raft_consensus.cc:1275] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.692118 21221 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:33.698378 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.678200 21813 rpcz_store.cc:276] 0709 13:08:30.111936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.112054 (+   118us) service_pool.cc:224] Handling call
0709 13:08:30.142230 (+ 30176us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:31.370793 (+1228563us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:32.901468 (+1530675us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18002af700. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:08:33.201462 (+299994us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.478228 (+276766us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:33.489475 (+ 11247us) log.cc:844] Serialized 52 byte log entry
0709 13:08:33.489638 (+   163us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:33.554640 (+ 65002us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.554866 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.554946 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.677601 (+122655us) raft_consensus.cc:1685] finished
0709 13:08:33.677623 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.677762 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213179,"prepare.queue_time_us":226267,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":1244809,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":14216,"spinlock_wait_cycles":3025664,"thread_start_us":585849,"threads_started":3,"wal-append.queue_time_us":283408}
W20260709 13:08:33.686679 26268 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.552s	user 0.002s	sys 0.011s
W20260709 13:08:33.729080 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 70000.3us
I20260709 13:08:33.733359 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.730087 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.737954 26285 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.731585 25930 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:33.738827 25930 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.740837 25930 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:33.752384 21776 leader_election.cc:400] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:33.753419 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.754612 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.756924 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.757750 21809 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:33.762164 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.751047 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:33.762882 21226 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:33.766678 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:33.769610 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:33.771509 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:33.735500 26230 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.735787 26219 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.750698 25813 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.750546 26282 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:33.758419 26044 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.764849 26199 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.766070 26056 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:33.798676 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:33.799441 21150 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.802176 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.802817 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:33.863171 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.030712 21143 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:34.357906 21221 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:34.036849 21150 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
W20260709 13:08:34.240933 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.364250 21149 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:34.084463 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 282449us
I20260709 13:08:34.245201 21226 raft_consensus.cc:2393] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:34.007548 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 232962us
I20260709 13:08:34.026734 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.369735 21218 raft_consensus.cc:2393] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:34.369570 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.371083 21143 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:34.372046 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.372252 21151 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:34.246363 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 445360us
I20260709 13:08:34.373786 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:33.935209 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 348318us
I20260709 13:08:34.375890 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.381788 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:34.383862 21218 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:34.242285 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.075489 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.402675 21778 leader_election.cc:400] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:34.403098 21778 leader_election.cc:403] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.411950 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.413817 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:33.771082 25547 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.253257 25564 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.772342 25887 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:33.802856 25892 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.777755 25975 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.029357 25874 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:34.246842 25922 consensus_meta.cc:287] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.020s
I20260709 13:08:34.508435 25975 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.240173 26044 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:34.510864 26044 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.244767 25970 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.515390 26319 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.516323 26319 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.517776 26331 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.035382 26075 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.518774 26331 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.519979 21296 raft_consensus.cc:1240] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.521515 26075 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:33.751480 26029 consensus_queue.cc:1048] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:34.240360 26056 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.796393 26102 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:08:34.526577 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:33.773144 26101 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.735129 26113 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:08:34.528275 26263 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:34.529234 26263 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.530398 26101 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:33.937282 26115 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:33.789996 26167 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.532250 26167 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.532913 26167 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.533556 26258 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:34.534425 26258 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.032925 26183 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:34.251403 26194 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:33.836805 26219 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:08:34.033617 26229 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.530761 26113 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.239485 26230 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:34.244536 26244 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.539700 26160 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.540323 26244 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.540443 26160 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.538829 26113 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:33.770574 26245 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.543509 26133 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:34.544253 26245 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.544318 26133 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:33.794890 26282 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:34.549093 26282 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:34.090951 26313 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:34.552042 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.551815 26233 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:34.452644 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 44225.1us
I20260709 13:08:34.553618 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:34.554621 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.556284 21220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1782) took 1154 ms. Trace:
I20260709 13:08:34.556816 21220 rpcz_store.cc:276] 0709 13:08:33.401931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.402092 (+   161us) service_pool.cc:224] Handling call
0709 13:08:33.402429 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.598031 (+195602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.598056 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.598479 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.759884 (+161405us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:33.760086 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.760156 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.047714 (+287558us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b480021c258. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b72ca3aa1 00007f2b72c9ab37 00007f2b72c9a9ca 00007f2b72d9226f 00007f2b72d91f37 00007f2b72da655c 00007f2b72da6508 00007f2b72da6488 00007f2b72da6443 00007f2b72da56ec 00007f2b71ccfa96
0709 13:08:34.555496 (+507782us) raft_consensus.cc:1685] finished
0709 13:08:34.555544 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.555950 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195223,"raft.queue_time_us":195880,"raft.run_cpu_time_us":2218,"raft.run_wall_time_us":448626,"spinlock_wait_cycles":3211136,"thread_start_us":157177,"threads_started":1,"wal-append.queue_time_us":204258}
I20260709 13:08:34.471493 26310 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:34.471428 25564 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.539713 26230 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.560503 26230 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.561273 25564 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.491895 26264 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.494311 26192 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:34.563479 26258 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.497776 26289 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.503362 26327 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.563938 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.516213 25970 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.564486 26289 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.564990 21295 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:34.490463 26328 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.772902 26110 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:08:34.563952 26192 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.566751 26328 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.567950 26263 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:34.564523 26327 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.568758 26289 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.569075 26192 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.569386 26328 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.559751 26310 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.554872 26233 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.570106 26233 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:34.570443 26327 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.571662 26310 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.495208 26330 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.572614 26330 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.566581 25970 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.569773 26318 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:33.790154 26277 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.563854 26264 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.544770 26245 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:34.569487 26282 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.579648 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 811) took 1335 ms. Trace:
I20260709 13:08:34.555006 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:34.543043 26244 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.521576 26331 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.580647 26113 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.586473 21222 rpcz_store.cc:276] 0709 13:08:33.241107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.241422 (+   315us) service_pool.cc:224] Handling call
0709 13:08:34.575599 (+1334177us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400127fd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:34.575925 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695626624}
I20260709 13:08:34.583218 26133 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.543071 26160 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.584491 26330 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.619728 26044 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.646015 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.647415 26098 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.648483 26098 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.651765 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.652778 21226 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:34.656401 26219 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:34.656847 26219 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:34.659387 25564 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.659905 25564 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:34.660332 26319 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.660563 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2293) took 1176 ms. Trace:
I20260709 13:08:34.661392 26277 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:34.661027 25564 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.662178 26277 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.652797 26245 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.664497 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.662650 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:34.666167 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.666905 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.669015 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.670441 21809 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:34.661506 26056 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.651960 21811 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:34.660939 21149 rpcz_store.cc:276] 0709 13:08:33.484111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.484279 (+   168us) service_pool.cc:224] Handling call
0709 13:08:34.363664 (+879385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.364822 (+  1158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.660326 (+295504us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540031bad0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:34.660491 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021440256}
I20260709 13:08:34.683418 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.688694 26331 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.693658 26098 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.693405 26331 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.698725 26044 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.699273 26264 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:34.700062 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 57400us
I20260709 13:08:34.701614 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:34.702627 26326 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.702881 26160 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.705991 26160 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.706377 26160 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:34.706759 26160 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.709091 21295 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.716089 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:34.716881 21299 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.720263 21292 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.721405 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.722690 26277 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:34.723394 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.728789 21295 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:34.729228 21295 pending_rounds.cc:85] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:34.729483 21295 pending_rounds.cc:107] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:34.729772 21295 raft_consensus.cc:2889] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.729900 21807 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:34.730556 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:34.702589 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 56914.2us
I20260709 13:08:34.733517 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.722471 26233 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.739629 26324 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.740144 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:34.740619 26324 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.753155 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.763823 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.764544 26233 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.764459 26345 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.765360 26345 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.771677 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.773015 21809 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:34.775441 26339 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.775627 26345 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:34.776166 26339 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.778650 26339 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.780400 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.790938 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:34.775772 26230 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.793932 21295 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 16: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:34.800303 26098 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.801218 26098 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.788893 26345 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.814254 25892 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:34.814666 25892 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:34.815344 26230 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.816362 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.814280 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.818691 21294 raft_consensus.cc:2410] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:08:34.819725 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 66745.2us
I20260709 13:08:34.819936 25892 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.820822 21776 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
I20260709 13:08:34.821142 21776 leader_election.cc:403] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.822196 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.822571 26309 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:34.822965 25892 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.824481 26345 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
I20260709 13:08:34.827502 26331 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.828728 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1808) took 2048 ms. Trace:
I20260709 13:08:34.830251 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:34.829129 21142 rpcz_store.cc:276] 0709 13:08:32.780240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.780415 (+   175us) service_pool.cc:224] Handling call
0709 13:08:32.780690 (+   275us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:08:32.786973 (+  6283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.787033 (+    60us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:08:32.802964 (+ 15931us) log.cc:844] Serialized 104 byte log entry
0709 13:08:32.975639 (+172675us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.975696 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.975784 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.670907 (+695123us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:34.826679 (+1155772us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b240013ae58. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ab139c4 00007f2b6ab11acb 00007f2b6acccdc9 00007f2b6accca55 00007f2b6accbfb0 00007f2b6d942488 00007f2b6d942be8 00007f2b6d91a398 00007f2b6d91576a 00007f2b6d914bb6
0709 13:08:34.828350 (+  1671us) raft_consensus.cc:1685] finished
0709 13:08:34.828369 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.828563 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4427,"raft.queue_time_us":15657,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4302,"spinlock_wait_cycles":17277952,"thread_start_us":157273,"threads_started":1,"wal-append.queue_time_us":242770}
I20260709 13:08:34.831952 26115 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:34.832376 26115 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.832736 26115 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.833267 26331 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.833837 26331 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.798997 26324 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:34.835929 26331 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.840744 26098 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.858942 21151 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.780138 26219 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.862663 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:34.860220 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.806563 26167 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.877216 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:34.877960 21143 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.878376 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.879558 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.879760 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:34.879845 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.880703 26167 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:34.880734 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:34.888295 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.891829 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.892076 26309 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.892666 21808 raft_consensus.cc:2410] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:34.893558 26331 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.894291 26331 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.895990 26074 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:34.896273 26331 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:34.896643 26074 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:34.897500 26160 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:34.898518 21150 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.899209 26074 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:34.892706 26309 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:34.905288 26314 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.664s	user 0.008s	sys 0.000s
I20260709 13:08:34.906313 26309 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:34.910465 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 88466.4us
I20260709 13:08:34.911882 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.913399 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:34.887219 26348 consensus_queue.cc:1175] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:08:34.893558 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.922902 21299 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:34.924466 21143 raft_consensus.cc:2468] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:34.921553 21142 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:34.926628 21809 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:34.931488 21298 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:34.914245 26324 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:34.940061 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.940274 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:34.931416 21145 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:34.944134 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.944806 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:34.945160 26218 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.945751 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:34.945986 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.946616 26218 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.947281 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.947854 26323 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.948163 21218 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:34.948980 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.949067 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.949862 21218 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:34.950714 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:34.952682 21151 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:34.951198 21218 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.982002 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:34.938199 26345 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:35.003417 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.991225 21808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d142716765ff4750912c13d99d61a1df"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:34.991533 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.993130 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:34.993758 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:35.004710 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.997145 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:34.951871 26324 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.005826 21219 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:35.022421 21218 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:35.008196 26324 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.028153 21114 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:34.984304 26233 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:35.032212 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.018869 25892 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.034901 21809 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:35.046974 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.051244 21218 raft_consensus.cc:2393] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 10: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:35.034163 26339 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.031368 26218 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.058670 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.049474 25938 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.039791 26160 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.059235 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.062479 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.021430 26244 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:35.065670 21218 raft_consensus.cc:2368] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
W20260709 13:08:35.067457 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 86108us
I20260709 13:08:35.056123 26339 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:35.072579 26098 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.073017 26347 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:08:35.073168 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.074271 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:35.077108 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.079195 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 1024) took 1378 ms. Trace:
I20260709 13:08:35.079456 25938 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.079612 21296 rpcz_store.cc:276] 0709 13:08:33.701138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.701287 (+   149us) service_pool.cc:224] Handling call
0709 13:08:33.701551 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.520499 (+818948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.078921 (+558422us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54001a77d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:35.079123 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881013504}
I20260709 13:08:35.083761 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.084985 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.084385 21045 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 13, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:35.085569 21220 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:35.092474 26326 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:35.093315 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.094053 21219 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:35.095193 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.097911 26323 consensus_queue.cc:1059] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.098510 26309 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:35.099130 26323 raft_consensus.cc:3055] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:35.099701 26323 raft_consensus.cc:740] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:35.103951 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:35.104662 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45447.1us
I20260709 13:08:35.104889 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.105618 21218 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:35.062328 26330 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:35.106806 21218 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:35.106942 26330 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:35.055673 26233 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.109807 21809 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:35.099210 26309 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.081858 25938 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.118464 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:35.107337 26330 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:35.112213 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.074833 26339 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.118834 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.100823 26323 consensus_queue.cc:260] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.131577 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.138509 26233 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.145335 26309 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.073294 26098 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.071874 26218 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:35.157573 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 49221.1us
I20260709 13:08:35.105638 26104 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.160583 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.165980 21225 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
W20260709 13:08:35.165978 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 91501.7us
I20260709 13:08:35.086452 21045 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 11, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 11 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.168644 21263 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.142853 26324 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.182138 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.187511 21809 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:35.164131 25938 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:35.163820 26244 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.169461 26104 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.194454 21811 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:08:35.190371 26310 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.197757 25922 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:35.198190 25922 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:35.198644 25922 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.200234 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:35.198660 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.190845 26244 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.191532 26335 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:35.191402 25938 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.224843 26345 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.228322 26277 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:35.247572 25938 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.229429 26098 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.229893 25892 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.238258 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.247474 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:35.197154 26104 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.266481 21809 raft_consensus.cc:1240] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.274399 21812 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:35.280435 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.256347 26244 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.286690 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.290344 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:35.266148 26338 raft_consensus.cc:2804] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:35.290659 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71118.2us
I20260709 13:08:35.295854 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.298007 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.256798 26264 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.297019 21142 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:35.288303 26323 raft_consensus.cc:3060] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.247572 26335 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.286468 26310 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:35.307948 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.286128 26011 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:35.317564 21147 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:35.266481 25922 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.294571 26277 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.322181 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.305521 26192 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:35.326840 21808 raft_consensus.cc:606] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.328071 21808 raft_consensus.cc:614] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.288224 26330 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.328348 26264 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.364946 26264 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.329452 26267 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.329348 26277 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.366490 26267 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.369971 26277 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:35.356017 26366 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:35.331509 25564 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.341958 26310 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.348058 26218 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.329834 21150 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:35.360277 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.344873 21810 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:35.347563 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 160586us
I20260709 13:08:35.382182 21148 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:35.306372 26338 raft_consensus.cc:697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:08:35.382735 26341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.028s	sys 0.057s
I20260709 13:08:35.326578 26056 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:35.392423 26341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.028s	sys 0.058s
I20260709 13:08:35.390637 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.347841 26324 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:35.396586 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.327951 26192 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.397316 21291 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:35.328917 26163 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.337275 25922 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:35.314347 26098 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:35.400967 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.329346 25961 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:35.369203 26267 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.405377 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.400271 25938 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:35.411876 26363 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:35.403709 26277 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:35.414826 21148 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:35.436448 21114 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.416013 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:35.409103 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:35.403110 26192 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.439316 21810 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:35.402906 26056 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:35.425879 21045 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 10, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:35.429536 26245 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.436640 26330 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.403302 26163 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:35.453084 25938 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.454169 21149 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 8. Current term is 10. Ops: []
I20260709 13:08:35.457770 21045 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 11, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:35.460635 26233 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:35.460551 21045 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:35.461323 26233 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:35.463521 26162 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:35.463294 21045 catalog_manager.cc:5697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 3 to 11, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 11 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.449777 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.465315 21226 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:35.465111 26338 consensus_queue.cc:237] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.469990 26219 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.470072 26133 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:35.471423 25961 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.473716 25961 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.475111 21224 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:35.453181 26163 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.476696 26163 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:35.440332 26115 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 13:08:35.419128 26244 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.445519 25922 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.499980 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:35.462571 26233 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.504081 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.508754 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:35.509531 21148 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:35.513619 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67793.1us
I20260709 13:08:35.499152 25922 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.501140 25543 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.523603 21114 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.522761 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.504725 26335 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.492815 26115 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.548974 26115 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.549744 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:35.550458 21291 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 16: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:35.551287 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:35.550961 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.521375 25922 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.532264 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.536485 25543 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.537259 26244 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.537417 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:35.538307 21047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 256) took 14518 ms (client timeout 15000 ms). Trace:
I20260709 13:08:35.541549 21149 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:35.543342 26160 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.544149 21813 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:35.526882 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.577399 21222 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.545260 26098 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:35.546072 21115 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.4:43709 timed out after 1.830s (SENT) [suppressed 4 similar messages]
I20260709 13:08:35.579523 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.581058 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.581833 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:35.524724 26339 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.586755 25930 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.587316 26133 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:35.587755 26339 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.587460 25930 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.588387 26339 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:35.588761 26339 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:35.589706 26339 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.590167 25930 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.590941 26339 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.515637 26348 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.552318 21293 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:35.575446 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.526013 26277 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:08:35.591347 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71452.4us
I20260709 13:08:35.592202 26115 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.592360 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.593926 26160 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.596568 25999 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.596957 26029 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:35.569873 21047 rpcz_store.cc:269] 0709 13:08:21.019355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.021296 (+  1941us) service_pool.cc:224] Handling call
0709 13:08:35.538026 (+14516730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.907301 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.923050 (+ 15749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.923133 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:08:26.923148 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:26.925008 (+  1860us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.925087 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.925117 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:08:26.926724 (+  1607us) tablet.cc:701] Row locks acquired
0709 13:08:26.926779 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:08:26.926975 (+   196us) write_op.cc:270] Start()
0709 13:08:26.927127 (+   152us) write_op.cc:276] Timestamp: P: 1783602506926900 usec, L: 0
0709 13:08:26.927164 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:27.130063 (+202899us) log.cc:844] Serialized 8196 byte log entry
0709 13:08:28.001536 (+871473us) op_driver.cc:464] REPLICATION: finished
0709 13:08:28.144748 (+143212us) write_op.cc:301] APPLY: starting
0709 13:08:28.162627 (+ 17879us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:28.508211 (+345584us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:28.508341 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:29.618673 (+1110332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:29.619118 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:08:29.619187 (+    69us) write_op.cc:312] APPLY: finished
0709 13:08:29.619679 (+   492us) log.cc:844] Serialized 188 byte log entry
0709 13:08:29.834101 (+214422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.852346 (+ 18245us) write_op.cc:454] Released schema lock
0709 13:08:29.874236 (+ 21890us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:29.921106 (+ 46870us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.924196 (+  3090us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":973568,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":91661,"apply.run_cpu_time_us":74266,"apply.run_wall_time_us":1795250,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":368937,"prepare.run_cpu_time_us":16987,"prepare.run_wall_time_us":352761,"raft.queue_time_us":294181,"raft.run_cpu_time_us":20695,"raft.run_wall_time_us":46928,"replication_time_us":1074134,"thread_start_us":698516,"threads_started":5,"wal-append.queue_time_us":437226,"wal-append.run_cpu_time_us":16764,"wal-append.run_wall_time_us":2827134}]]}
W20260709 13:08:35.602737 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.619904 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.631783 21297 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:35.634822 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.623733 25543 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.566377 21148 raft_consensus.cc:2468] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:35.636301 26029 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.638598 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.641381 26029 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.641517 26377 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.641938 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62762.8us
I20260709 13:08:35.642166 26377 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.644985 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:35.632932 25999 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.653381 21222 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
W20260709 13:08:35.644709 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 340673us
I20260709 13:08:35.657140 26011 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.687443 26011 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.687898 26011 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.688061 26377 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:35.628695 26244 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:08:35.647459 26133 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.685662 26328 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:35.684561 26341 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.698931 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.691385 25999 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.702126 26171 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:35.718304 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 233793us
I20260709 13:08:35.634469 26104 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.631193 26056 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.732122 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:35.732878 21813 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.719754 26341 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.734943 21114 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.738926 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:35.740473 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 194503us
I20260709 13:08:35.720624 26171 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:35.743342 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.741526 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:35.633538 21045 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:35.731081 26328 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:35.740048 26341 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.743244 26098 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:35.777940 21189 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:35.782603 26267 consensus_queue.cc:1059] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:35.787717 26244 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:35.792970 21116 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.794708 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:35.802369 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.805807 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.803427 21807 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:35.803009 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.776523 26382 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.823884 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.825773 21220 pending_rounds.cc:85] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 9
I20260709 13:08:35.826195 21220 pending_rounds.cc:107] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:08:35.826478 21220 raft_consensus.cc:2889] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.828042 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.828351 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:35.845374 26267 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.822268 26328 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.847790 25938 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.848640 21045 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:35.851629 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.850975 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.852573 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.854976 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:35.855997 21813 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:35.817322 25543 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:35.858316 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 43999us
I20260709 13:08:35.859004 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:35.840504 26384 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:35.862980 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.858954 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.855427 21190 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.850476 21045 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.843847 26244 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.871501 21222 raft_consensus.cc:2410] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:35.878644 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.871584 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.866333 21297 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:35.852778 26277 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.876277 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:35.892256 21813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:35.896813 21813 raft_consensus.cc:606] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.897389 21813 raft_consensus.cc:614] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:35.897688 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 104778us
I20260709 13:08:35.890302 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.900265 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.852488 26162 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.901216 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.893610 21263 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.901731 21221 raft_consensus.cc:2368] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
W20260709 13:08:35.884488 26385 log.cc:927] Time spent T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:35.881909 26389 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:08:35.881572 26337 raft_consensus.cc:3055] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:35.904716 26389 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:35.907428 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.861635 26115 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:35.867736 25961 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.919973 25961 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.920435 25961 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.882107 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:35.891028 26029 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.861395 25564 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.923836 26029 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:35.883790 26380 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:08:35.872090 26171 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:35.882679 26378 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:35.926339 26171 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:35.881752 26383 log.cc:927] Time spent T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:08:35.927345 25564 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.913960 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:35.904990 26337 raft_consensus.cc:740] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:35.915010 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.895453 25813 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.891228 26160 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.919354 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:35.944921 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44765.3us
I20260709 13:08:35.945407 21226 raft_consensus.cc:2368] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 15. Current term is 16.
I20260709 13:08:35.943655 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:35.953549 21291 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:35.958360 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 64822.3us
I20260709 13:08:35.868103 26382 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.965215 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.911227 26245 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.965965 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.974388 26245 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.980429 26245 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.981173 26382 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.943396 26115 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.983345 26074 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:35.983553 26115 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.983976 26074 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:35.985296 25564 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:35.985071 26074 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.983388 26379 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.921494 25922 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.989404 26267 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:35.990413 26163 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.001s
I20260709 13:08:35.990708 25922 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:35.983888 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.992211 21263 leader_election.cc:400] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:35.992203 26338 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.905246 26389 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:35.993348 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:35.994087 26389 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:35.913161 26348 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.883066 25999 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:35.995388 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:35.997107 26382 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.997416 25999 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:35.998636 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:35.997486 26382 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:35.999377 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:35.999837 26382 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.001780 21191 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:36.002534 26029 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.943316 26381 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:36.003393 26381 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.004276 26029 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.017791 21291 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:35.922503 25543 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.005380 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.019726 21223 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:36.033592 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.040480 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.040946 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.041255 21807 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:35.913439 26162 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.040716 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.041571 21811 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 8.
I20260709 13:08:36.042007 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.088101 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.089092 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.090075 21142 raft_consensus.cc:2368] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 15. Current term is 16.
I20260709 13:08:36.090797 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.027355 25564 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.097721 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.098045 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.098641 21812 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:35.974870 26192 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.095247 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.105441 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.095621 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.106009 21146 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.094983 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:36.108480 21811 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.103581 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.103760 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.036754 26133 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.110543 21808 raft_consensus.cc:2393] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:36.104306 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:36.101210 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 193925us
I20260709 13:08:35.971140 25813 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.049852 26389 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.116209 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.129125 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.130400 21150 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:36.154660 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.154973 21147 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
W20260709 13:08:36.172259 26268 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:36.173622 21811 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:36.174930 26162 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.180258 25813 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:36.196235 25938 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.189397 21146 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:36.100286 26339 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.203684 26339 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.206175 26339 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:36.004781 26337 consensus_queue.cc:260] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.220139 26104 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:36.229830 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.233633 21806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:36.234359 21806 raft_consensus.cc:606] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:36.234753 21806 raft_consensus.cc:614] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:36.236140 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:36.241969 26192 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:36.040716 26341 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.244899 26341 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.246084 21045 catalog_manager.cc:5697] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 11, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 11 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:36.249228 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:36.248306 21045 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 11, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:36.249930 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.254452 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.255210 21810 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:36.264123 21151 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:36.272910 26381 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:36.276984 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 119518us
I20260709 13:08:36.295961 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.296942 21294 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:36.298062 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.298826 21291 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:36.301201 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 390617us
I20260709 13:08:36.301891 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:36.303382 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 448001us
I20260709 13:08:36.303726 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:36.304513 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.306057 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 443145us
W20260709 13:08:36.306648 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.307416 21190 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:36.280849 25813 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.309013 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.309816 21811 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:36.322500 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.296361 26098 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:36.352939 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:36.325335 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:36.383376 21814 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.327095 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.352842 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:36.366102 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.369123 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.250613 21045 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 10, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:08:36.356350 21115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.075s
I20260709 13:08:36.371213 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:36.398836 21115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.075s
I20260709 13:08:36.399063 21807 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:36.399222 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 573733us
I20260709 13:08:36.375661 21224 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.326825 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:36.317683 26162 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.318365 26338 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.391806 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.418136 21809 raft_consensus.cc:2368] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:36.392827 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.306241 25543 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.401830 21189 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:36.390390 21808 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:36.372632 26011 consensus_meta.cc:287] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.001s
I20260709 13:08:36.324374 26399 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.410020 21220 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 16: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
W20260709 13:08:36.412145 21223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1788) took 1468 ms (client timeout 1876 ms). Trace:
I20260709 13:08:36.413488 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.440232 21145 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:08:36.440598 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:36.437984 21223 rpcz_store.cc:269] 0709 13:08:34.943753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.944574 (+   821us) service_pool.cc:224] Handling call
0709 13:08:36.411908 (+1467334us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54000ed3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:36.412059 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131019136}
I20260709 13:08:36.444969 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.419055 21146 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
W20260709 13:08:36.452665 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 367460us
I20260709 13:08:36.457664 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.317173 26245 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.464076 21150 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 16: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:36.431368 26398 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.433527 26162 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:36.421583 26282 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.422857 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.428124 25543 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:36.430804 26386 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.403s	user 0.000s	sys 0.002s
W20260709 13:08:36.488735 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 425043us
I20260709 13:08:36.313570 26277 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:08:36.491732 26406 raft_consensus.cc:2804] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.492400 26406 raft_consensus.cc:697] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:36.493619 26406 consensus_queue.cc:237] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.475663 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.495565 21145 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.500249 26410 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.500957 26410 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.503919 25999 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.505431 26162 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:36.514041 26171 consensus_meta.cc:287] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.001s
I20260709 13:08:36.428808 26098 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.456964 26167 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.471760 26399 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.443732 26011 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.329766 25813 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.476681 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.491204 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.486635 26414 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.517593 21219 raft_consensus.cc:2410] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:08:36.487040 25543 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:36.524770 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 56515.3us
I20260709 13:08:36.525493 21144 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 16: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:36.524048 21149 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:08:36.531448 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 148022us
I20260709 13:08:36.543247 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:36.515194 26382 consensus_meta.cc:287] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.000s
I20260709 13:08:36.578994 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.580236 21224 raft_consensus.cc:2410] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:36.577060 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.523685 26011 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.535718 26337 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:36.585759 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 94665.5us
I20260709 13:08:36.469252 26104 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:08:36.589874 21220 raft_consensus.cc:2368] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10.
I20260709 13:08:36.533775 26282 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.542789 26330 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.577697 26399 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.610977 21145 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:36.613590 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:36.586479 26410 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.600240 26282 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.617223 26389 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:36.571719 26414 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.639803 26420 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.641156 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 278088us
I20260709 13:08:36.324702 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:36.617720 25813 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:36.658077 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 253590us
I20260709 13:08:36.583822 26382 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.672598 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.660871 21810 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.667464 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:36.674050 21292 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.673959 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.671020 21116 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:36.678915 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 235649us
I20260709 13:08:36.679760 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:36.661211 26074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.022s	sys 0.043s
I20260709 13:08:36.693879 21299 raft_consensus.cc:2410] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:36.672052 26381 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.693367 21809 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:36.688760 26074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.022s	sys 0.043s
W20260709 13:08:36.706952 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.675146 26348 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.698482 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 84990.8us
I20260709 13:08:36.696121 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:36.668696 26420 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.671489 26389 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.732713 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:36.706863 26399 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.690389 26404 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.707067 26339 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.735737 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.707744 26381 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:36.716753 26098 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.739930 26245 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:36.758951 26427 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:08:36.759158 26418 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:36.762076 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.740464 26390 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.740511 26400 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.743809 26381 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.717176 26348 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.773516 26433 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.774348 26433 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.777879 26433 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.773259 26309 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.744359 26339 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:36.766927 26409 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:08:36.786509 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:36.787168 21143 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.787695 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:36.788242 21222 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.783787 21150 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:36.789130 21144 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:36.783416 21145 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:36.789376 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.792402 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:36.792654 26421 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:36.792892 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.793709 21147 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:08:36.802349 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.780112 26400 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.805644 26348 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:36.806696 26414 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:36.808882 26419 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:08:36.809144 26429 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:36.810043 25961 consensus_meta.cc:287] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.889s	user 0.010s	sys 0.000s
I20260709 13:08:36.810268 26382 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.810376 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.780593 26338 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:08:36.816146 26430 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:36.816684 26430 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:36.818732 26430 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:36.819846 21150 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:36.792671 21045 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:36.820214 21142 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:36.820870 26424 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:36.821434 21223 raft_consensus.cc:2410] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:36.823101 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.824178 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:36.824335 21810 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:36.825206 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:36.826270 21264 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.826434 26388 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.827164 26160 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.829219 26330 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.819152 21292 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:36.834901 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.843837 21223 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:36.847396 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.852741 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.826448 26074 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.859820 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.853330 21191 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:36.863816 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:36.864578 21812 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.860180 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.853330 21149 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:36.869763 21298 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.861663 21116 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:36.873919 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:36.874517 21219 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:36.875428 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:36.875963 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.876561 21146 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:36.880865 21807 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:36.882340 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.883162 21812 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:36.883963 21143 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:36.840631 25813 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:36.840564 26330 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:36.866636 21808 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:36.883432 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:36.890789 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:36.848353 26388 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.785678 26309 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.904954 26267 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.906162 25543 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.906417 26309 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.895733 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:36.875977 21219 raft_consensus.cc:2376] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13. Re-sending same reply.
I20260709 13:08:36.810514 25961 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.885866 26389 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:36.888407 26011 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:36.882323 26433 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.901856 26330 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:36.936455 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 54788.5us
I20260709 13:08:36.940460 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:36.936460 21190 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:36.931890 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 78623us
I20260709 13:08:36.954126 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:36.957551 21776 leader_election.cc:400] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 15. Current term is 16.
I20260709 13:08:36.957993 21219 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:36.958237 21776 leader_election.cc:403] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.959564 21776 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:36.962509 21814 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 13:08:36.962960 21814 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:36.967859 21222 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:36.968916 21114 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:36.969358 21217 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:36.887044 26338 consensus_queue.cc:1059] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:08:36.928646 26244 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:36.919780 26377 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:36.920462 26323 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:36.957659 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:36.973580 21190 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:36.979249 21223 raft_consensus.cc:1240] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:36.919837 25813 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:36.935900 26382 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:36.990808 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:36.996738 26024 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.988775 26160 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.919585 26390 consensus_queue.cc:1059] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:36.971402 26011 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:37.004148 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:36.928076 26056 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:37.006965 21225 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:36.975610 25930 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.968279 26435 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 15. Current term is 16.
I20260709 13:08:36.949330 26379 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:08:36.993474 26029 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.019560 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:37.020128 21298 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.948901 26414 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:36.821097 21045 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 9, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 9 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:36.956660 26433 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.021916 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:37.000936 25922 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.023504 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:37.006539 26387 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.000725 26244 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:37.002457 26160 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.012805 26338 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:37.043339 21293 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:08:37.040664 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.041970 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:37.049953 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 90447.2us
I20260709 13:08:37.050889 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.051661 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:37.024674 26406 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.043708 21293 pending_rounds.cc:85] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 6
I20260709 13:08:37.057201 21293 pending_rounds.cc:107] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:37.057499 21293 raft_consensus.cc:2889] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.999678 26323 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.053403 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:37.005082 26377 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.066553 21298 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:37.011369 26382 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.048512 26160 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.040871 26387 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.004698 26024 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.079454 26024 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:37.080179 26437 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:37.077349 26387 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.082711 25813 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.083840 25813 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.086905 26160 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.088950 26387 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.090457 26160 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.091926 21299 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:37.092993 26382 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.070518 25922 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.093894 25922 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.082484 26011 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.123848 21297 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:37.132022 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 81212.8us
I20260709 13:08:37.070003 26339 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.131340 26436 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.137449 26377 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.126119 26323 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.138312 26381 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.139348 25922 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.142037 26330 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:37.145061 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 84340us
I20260709 13:08:37.150616 26436 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:37.155845 26337 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.003s
I20260709 13:08:37.150321 26244 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.151243 21297 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:37.146212 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.195894 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 824) took 1379 ms. Trace:
W20260709 13:08:37.197747 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 51626.1us
I20260709 13:08:37.198545 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:37.199434 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 149677us
I20260709 13:08:37.197392 21217 rpcz_store.cc:276] 0709 13:08:35.816441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.816577 (+   136us) service_pool.cc:224] Handling call
0709 13:08:37.194541 (+1377964us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400116a54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:37.195835 (+  1294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406740736}
I20260709 13:08:37.196090 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:37.217404 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:37.175506 26387 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.149748 26282 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.195768 25961 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.219591 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:37.168944 26338 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.237949 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.240123 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:37.241513 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.221875 26323 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.223323 25564 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:37.222352 26377 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.219065 26451 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.258198 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:37.258911 21293 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:37.259821 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:37.247408 25813 raft_consensus.cc:2764] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:08:37.223177 21045 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:37.262632 21045 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:37.264276 21045 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 10, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 10 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.267586 26452 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:37.268246 26452 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:37.268735 26452 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.269902 26381 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.270596 26433 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.270783 21293 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.272058 26282 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.273394 26330 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.273660 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:37.256071 26400 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.244334 26323 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.275290 26323 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.276382 26310 raft_consensus.cc:3055] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:37.276787 26310 raft_consensus.cc:740] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.277661 26310 consensus_queue.cc:260] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.278848 26310 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.250427 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.283775 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:37.252058 26348 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.237526 26454 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:37.243453 26457 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.292248 26348 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.301397 26348 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.304414 26464 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:37.305027 26464 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.287117 26245 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:37.307901 26245 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:37.309120 26029 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:37.308876 26245 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.310252 26245 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.310098 26029 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.298106 26400 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:08:37.311578 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 263902us
I20260709 13:08:37.311630 26406 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:37.311945 26400 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.312430 26400 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:37.312831 26406 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.313472 26420 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.313308 26400 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.314644 26074 raft_consensus.cc:3055] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.314813 26400 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.315052 26074 raft_consensus.cc:740] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.315907 26074 consensus_queue.cc:260] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:37.316926 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.317029 26074 raft_consensus.cc:3060] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.317328 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:37.318429 26426 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.323575 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.321864 21223 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:37.328233 21143 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:37.331359 21150 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:37.331360 21144 raft_consensus.cc:1240] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:37.322458 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.332424 21225 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:37.325779 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:37.333707 21226 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.335939 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.336000 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:37.292409 26233 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.338079 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.339627 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.315908 26267 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:37.339622 26410 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:37.342521 26410 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.296111 25564 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:37.318913 26426 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.348574 21146 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:37.358342 21226 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:37.361780 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 120334us
W20260709 13:08:37.363494 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 341634us
I20260709 13:08:37.364348 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.367460 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:37.369182 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.369231 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:37.370771 26415 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.372153 21776 leader_election.cc:400] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11.
I20260709 13:08:37.354013 26233 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.373553 21776 leader_election.cc:400] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 15. Current term is 16.
I20260709 13:08:37.375535 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:37.375936 25813 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.380920 26464 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.380023 26233 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.383036 26323 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.385128 26323 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.387953 26233 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.390323 26428 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.390830 26428 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:37.391194 26162 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.391700 26428 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.371169 26415 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.395365 26415 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.386662 26348 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.396445 25930 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.397079 25930 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:37.397294 26348 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.398466 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:37.401309 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.410152 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.349612 26098 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:08:37.422433 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 47009.4us
I20260709 13:08:37.423164 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:37.422300 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.424201 21810 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 15: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:37.411136 21814 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.410095 26338 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.422982 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.430945 21776 leader_election.cc:400] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10.
I20260709 13:08:37.431325 21776 leader_election.cc:403] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.438934 26457 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 9. Current term is 10.
I20260709 13:08:37.441108 26348 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.435976 26465 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.443701 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:37.444339 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.445253 21264 leader_election.cc:400] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:37.445609 21264 leader_election.cc:403] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.452657 26420 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.453469 26420 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:37.411098 26267 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.459774 26328 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.464742 26267 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:37.465354 26267 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.468416 26426 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:37.469004 25564 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.475673 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.478531 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.482336 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.485998 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:37.487607 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:37.488351 21218 raft_consensus.cc:2393] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:37.490785 21814 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:37.489563 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.508024 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.509546 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.509653 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.511489 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.512336 26458 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:37.512923 26458 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.513489 26454 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.513862 26458 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.514631 21263 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:37.515506 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.515986 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.516288 21219 raft_consensus.cc:2393] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:37.516666 21148 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:37.510439 21217 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:37.520690 21223 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:37.520749 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.521262 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.522404 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.515511 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.525547 21150 raft_consensus.cc:3060] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.527616 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.528137 21142 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:37.530611 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.532624 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.534392 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:37.537379 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.537925 21807 raft_consensus.cc:2376] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11. Re-sending same reply.
I20260709 13:08:37.537793 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.539103 21805 raft_consensus.cc:2410] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:37.537107 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.540264 21142 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:37.539647 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:37.543751 21807 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:37.549594 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:37.549036 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.540342 21808 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:37.554183 21809 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:37.554679 21148 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:37.557857 21219 raft_consensus.cc:2368] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:37.558300 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.558612 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.559043 21812 raft_consensus.cc:2368] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:37.517985 26465 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.561240 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.567500 21814 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:37.560194 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.558346 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.568830 21809 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:37.560298 21810 raft_consensus.cc:1275] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:08:37.569322 21810 pending_rounds.cc:85] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 10
I20260709 13:08:37.569626 21810 pending_rounds.cc:107] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:08:37.569895 21810 raft_consensus.cc:2889] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.564297 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:37.565135 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.575069 21808 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:37.524629 26454 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.530088 25813 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.530372 26348 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.589370 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.540925 26435 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:37.550174 25922 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:37.593016 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.591012 21812 raft_consensus.cc:2368] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:37.460747 25930 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:37.563599 26452 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.601784 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:37.612883 21149 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:37.556999 26381 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.635810 26381 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.636232 26381 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.603232 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.639596 21807 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.588888 26029 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.595026 26162 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:37.606145 26348 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.648397 26348 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.649049 21805 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:37.649155 21297 raft_consensus.cc:1275] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:37.649601 21297 pending_rounds.cc:85] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:37.649817 21297 pending_rounds.cc:107] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:37.650014 21297 raft_consensus.cc:2889] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.654534 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:37.604303 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.606364 26454 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.661898 21263 leader_election.cc:400] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:37.662161 21263 leader_election.cc:403] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.593765 26435 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.605757 25922 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.663898 21144 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:37.580861 26465 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.623378 26451 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:37.679553 26451 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.600081 26277 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:37.623993 26452 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.685887 25922 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.687067 26451 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.566248 26264 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:37.665026 21807 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:37.595806 25813 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.677556 26465 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:37.653730 26415 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.619488 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.711166 21814 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 9.
I20260709 13:08:37.720144 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.724483 21807 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 16: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:37.725217 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.733561 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:37.734477 21807 raft_consensus.cc:2393] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:37.671924 26330 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:37.768944 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.689165 26387 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.775297 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.785275 21151 raft_consensus.cc:2368] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
W20260709 13:08:37.788519 26442 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:08:37.808956 25813 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.810119 26454 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:37.663353 26337 consensus_queue.cc:1048] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:08:37.771977 26310 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:37.784682 26405 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:37.770655 26389 consensus_queue.cc:1059] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:08:37.828997 26330 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.881188 26310 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:37.921437 21293 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:37.901490 26435 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:37.927881 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:37.928772 21805 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:37.931689 21805 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:37.945791 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.995784 26475 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:38.003872 21150 raft_consensus.cc:2468] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:38.005252 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:38.006035 21812 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:37.983844 26450 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.020558 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:38.003131 26310 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.057262 26381 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.060590 26233 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.062749 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:38.064006 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.065574 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:38.051937 26098 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:38.070986 21223 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.069525 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.062192 26244 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.015121 26450 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.070226 21263 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:38.040593 26415 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.014807 26330 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.076503 26098 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.078599 26098 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.081290 26244 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.085209 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.086273 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:38.089797 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:38.115177 21808 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:38.117256 21292 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:38.118469 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:38.075062 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:38.124902 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49909.8us
I20260709 13:08:38.067654 26011 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.130241 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.129604 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:38.136718 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47036.2us
I20260709 13:08:38.137820 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.139081 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.144889 21223 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:38.146518 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.149618 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:38.202909 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 53394.7us
I20260709 13:08:38.203851 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.115641 26456 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:38.128337 26443 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:38.354008 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:38.246776 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:38.222900 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:38.364270 21808 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.131868 26400 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.133569 26133 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.133363 26465 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.135974 26391 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:38.180225 26479 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:38.154919 26478 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:08:38.368034 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.156338 26233 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.365569 21809 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.202301 26415 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.161139 26410 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.164922 26162 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.372967 25564 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.412708 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2515) took 1017 ms. Trace:
I20260709 13:08:38.413254 21292 rpcz_store.cc:276] 0709 13:08:37.395145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.400189 (+  5044us) service_pool.cc:224] Handling call
0709 13:08:37.670320 (+270131us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b5800110798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:08:37.670549 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.117838 (+447289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.412462 (+294624us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540001e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:38.412651 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038890752}
I20260709 13:08:38.412936 26162 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.417428 21224 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:38.418128 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:38.200733 26381 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.419369 26400 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.419884 26400 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.421898 26400 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.420740 26162 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.423053 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.424351 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.365048 26458 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:38.426252 21291 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.426469 26458 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.428159 26098 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.428683 26458 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.428645 26098 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.429651 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.430732 26098 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.152618 26450 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.168591 26387 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:38.147611 26011 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.355211 26452 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.215544 25813 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.355410 25922 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:38.403478 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:38.405716 26436 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.154102 26104 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.238s
I20260709 13:08:38.384361 26456 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:38.379112 26465 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.152650 26323 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.418915 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.426343 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:38.435948 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.444523 21776 leader_election.cc:400] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
I20260709 13:08:38.445245 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:38.447053 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.436079 26233 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:38.455732 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 381246us
W20260709 13:08:38.482650 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46789.1us
I20260709 13:08:38.483362 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.457347 21297 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:38.458853 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.461072 21149 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:38.468096 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.463805 21809 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:38.473302 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:38.431236 26098 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:38.478739 21150 raft_consensus.cc:2393] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:38.479168 21776 leader_election.cc:403] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.442739 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:38.455735 26444 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:38.490978 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.492475 21143 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
W20260709 13:08:38.493853 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 49523.2us
I20260709 13:08:38.494343 21264 leader_election.cc:400] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:38.494650 21264 leader_election.cc:403] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.494561 21776 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.477816 25813 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
W20260709 13:08:38.507980 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 65344.2us
I20260709 13:08:38.477612 26465 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.527443 21809 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:38.528275 21807 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:38.530472 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.493350 26455 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:38.537770 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 51220.3us
I20260709 13:08:38.542040 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.552031 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1164) took 1013 ms. Trace:
I20260709 13:08:38.553150 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.554067 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:38.554764 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.560712 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:38.559247 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 71801.3us
I20260709 13:08:38.562772 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:38.552644 21806 rpcz_store.cc:276] 0709 13:08:37.538355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.538886 (+   531us) service_pool.cc:224] Handling call
0709 13:08:37.562579 (+ 23693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.563047 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.563088 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.588565 (+ 25477us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.928860 (+340295us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:38.118769 (+189909us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.119051 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.119147 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.551782 (+432635us) raft_consensus.cc:1685] finished
0709 13:08:38.551809 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.551958 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68344,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":2893,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":24853,"thread_start_us":418317,"threads_started":2,"wal-append.queue_time_us":432548}
I20260709 13:08:38.471302 25922 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.564857 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.537047 26400 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.565244 21149 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:38.565774 21223 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
W20260709 13:08:38.555966 26267 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.090s	user 0.014s	sys 0.000s
I20260709 13:08:38.568106 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:38.536755 26435 raft_consensus.cc:2804] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.564989 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:38.550266 26074 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:38.505439 26436 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13.
I20260709 13:08:38.575893 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.573316 26104 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:38.581398 21148 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:38.490934 26233 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.504994 26444 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.556164 26490 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:38.566696 26450 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:38.554566 26133 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:08:38.504930 26098 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.600747 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:38.603528 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 441882us
I20260709 13:08:38.604692 21295 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:38.608587 21146 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:38.580413 25961 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.617997 26104 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.618891 25922 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.563521 26491 consensus_queue.cc:1059] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:08:38.623795 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.624221 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.629242 21808 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:38.584501 26410 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:38.609196 26074 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:38.613811 26387 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:38.647409 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 46789.8us
I20260709 13:08:38.651526 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.652772 21293 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:38.623770 26490 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:38.603756 26267 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:38.686847 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.672544 21264 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:38.690254 21264 leader_election.cc:403] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:38.696482 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 67516.2us
I20260709 13:08:38.661579 26387 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.586068 26456 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:38.733911 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 65776.5us
I20260709 13:08:38.735132 21217 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.675892 26484 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.653205 26074 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.737725 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.674376 26420 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:38.745374 26420 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.747987 26420 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.748625 26420 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
W20260709 13:08:38.741463 26494 log.cc:927] Time spent T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:08:38.742136 26104 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.734969 21115 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:38.713943 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 142806us
W20260709 13:08:38.743463 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 205018us
I20260709 13:08:38.751332 26505 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:38.751660 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:38.751915 26505 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:38.752792 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:38.754511 26491 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:38.754882 26491 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.755219 26491 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.755280 21226 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:38.756699 26029 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:38.757382 26400 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.758853 26029 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:38.764623 26497 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:08:38.764699 26029 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.765534 26029 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.760002 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:38.760589 26400 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:38.763819 26501 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:08:38.752792 26505 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.685609 26490 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:38.773526 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 249833us
I20260709 13:08:38.768062 26011 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.628203 25813 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.780004 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:38.734517 26387 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.696203 26056 consensus_queue.cc:1048] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:08:38.785610 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:38.789389 21146 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:38.781785 26133 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.772739 26244 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:38.782177 26496 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:08:38.648511 25961 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:38.864200 26495 log.cc:927] Time spent T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.297s	user 0.008s	sys 0.002s
W20260709 13:08:38.876319 26507 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:38.883989 25961 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.823630 26133 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.893543 26098 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.894718 26133 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.896739 26074 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.899757 26074 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:38.903898 26504 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:08:38.904040 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 84714us
I20260709 13:08:38.905516 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:38.907546 21808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:38.908258 21808 raft_consensus.cc:606] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:38.908645 21808 raft_consensus.cc:614] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.889653 26435 raft_consensus.cc:697] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:38.909595 26436 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.909992 26435 consensus_queue.cc:237] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:38.911480 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 384064us
W20260709 13:08:38.911705 26500 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:08:38.911873 25564 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.912642 26499 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:08:38.912410 25564 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.913774 21115 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:38.921557 26510 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.941536 25922 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:38.942139 25922 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:38.945859 26310 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.927014 21144 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:38.949486 21144 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:38.918467 26267 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:38.921571 25564 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.924676 26510 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:38.962921 25922 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.924100 26444 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:38.967686 26450 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.999720 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 327352us
I20260709 13:08:39.001066 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.001420 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:39.000937 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.005451 21297 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:39.007325 21264 leader_election.cc:400] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11.
I20260709 13:08:39.017668 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.018450 21144 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 7.
W20260709 13:08:39.018272 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 320892us
I20260709 13:08:39.023047 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:38.960395 26133 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:39.019196 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:39.021574 21264 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:39.034543 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.038221 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.039678 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.048404 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.051559 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:38.987391 26233 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.984095 26074 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:38.998334 26444 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:39.019377 25564 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.058655 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.047940 26388 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.075127 26510 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.033155 26310 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.076409 21221 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:39.033586 26162 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.084215 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.084602 26162 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.086931 26162 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:38.983642 26490 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.090224 26490 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.087517 26323 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:39.090723 26404 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.091095 26323 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.092228 25930 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:39.092875 25930 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:39.093693 26323 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.093782 25930 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.096148 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:39.072105 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.096758 21143 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.099478 26498 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:39.099988 25930 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:39.100493 26511 log.cc:927] Time spent T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:08:39.101837 26267 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.091840 26404 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.104724 26404 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:39.105266 26404 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.109045 21147 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:39.113234 26509 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:39.108754 26454 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:39.117282 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.118844 26509 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:39.119239 26503 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:39.119865 26503 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:39.120659 26503 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.121790 26503 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.049341 26133 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.123836 21145 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.124929 26133 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:39.125941 26513 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:08:39.053970 26337 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.047914 26458 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:38.997800 26387 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.019876 26450 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.138598 21143 raft_consensus.cc:2468] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:39.138450 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:39.080375 26465 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:08:39.139133 21145 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:39.141731 26244 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:39.133158 26388 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.081522 26420 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:39.156445 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.147938 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.158203 21223 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:39.148989 26310 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.152027 21299 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:39.153004 26387 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.152845 26244 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.153110 26388 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.135892 26509 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.153951 21293 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:39.154825 26450 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.060454 26491 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.156965 21189 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:39.160805 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.135196 26323 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.159121 26420 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:39.130959 25564 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.163507 26310 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:39.164883 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 257708us
I20260709 13:08:39.080976 26074 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.083052 26444 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.174844 21808 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:39.150378 26465 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.177490 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.184548 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.217648 21809 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:39.217890 21807 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:39.187049 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.145215 26458 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.195371 21218 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.200206 26074 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.149750 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.195161 21778 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.196645 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.227607 21217 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:39.170145 26339 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.188169 26420 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.178149 26517 raft_consensus.cc:2804] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:39.245218 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 95574.1us
I20260709 13:08:39.216590 25922 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.216501 26452 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.220721 26377 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.182439 26029 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.187642 26323 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.262626 21114 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:39.274084 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 189946us
W20260709 13:08:39.276319 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 229149us
I20260709 13:08:39.262017 26452 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.256542 26522 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:39.277639 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:39.286288 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.262828 26517 raft_consensus.cc:697] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:39.290069 21814 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:39.291652 21221 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:39.272249 26400 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:39.325202 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.260728 25922 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.330242 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.288395 26522 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:39.339888 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 118236us
I20260709 13:08:39.339139 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.278939 25813 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.295563 26387 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.349225 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.265951 26377 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.289952 26512 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.358451 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.332334 26456 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.359352 21150 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:39.342571 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 243515us
I20260709 13:08:39.274005 26526 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:39.362362 21144 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.346761 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.346427 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:39.351630 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 156529us
I20260709 13:08:39.366375 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.352253 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.366783 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.368028 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:39.354466 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:39.369086 21142 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.360165 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.380333 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.372313 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.345292 26522 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.384152 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.384505 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.344105 26404 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.388145 21294 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:39.391979 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.387476 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.390974 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.395047 21296 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:39.379837 25813 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.423769 26528 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:39.424248 26528 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.424578 26528 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.372112 26512 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.378384 26526 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.418701 21142 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:39.398285 26517 consensus_queue.cc:237] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.421991 26527 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.422703 26381 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:39.425025 25813 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.457482 26420 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.459859 26323 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.461243 26420 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.461485 26377 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.462862 26415 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:39.463297 26415 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:39.464066 26415 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.393128 26509 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.427677 26458 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.382862 26433 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:39.429746 26029 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.431421 26492 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:39.432163 26549 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.432135 26514 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:08:39.467326 26505 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.432595 26545 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.494786 26545 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.496961 26545 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.500682 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:39.387332 26456 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.429409 26452 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.428738 26244 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.427398 26520 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.505831 26520 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.507959 26520 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:39.428301 26532 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:08:39.429589 26518 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:08:39.444060 26531 log.cc:927] Time spent T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:39.363284 26264 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:39.510367 26387 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:39.510919 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1165) took 1972 ms. Trace:
I20260709 13:08:39.438753 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.511796 26264 consensus_queue.cc:1059] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:39.512564 26454 raft_consensus.cc:3055] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:39.512953 26454 raft_consensus.cc:740] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:39.513698 26454 consensus_queue.cc:260] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.514806 26454 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.517835 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.446012 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.418356 21296 raft_consensus.cc:1240] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:39.450556 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.451597 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58884ca99bd494292202a75faf1833c"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:39.519590 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:39.412516 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 45832.4us
I20260709 13:08:39.464457 26512 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.428397 26310 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.427965 21300 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:39.469496 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 68984.3us
I20260709 13:08:39.473640 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:39.383639 26162 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:39.470642 26056 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:39.481640 26465 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.448899 25564 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:39.488206 26524 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:08:39.446277 26444 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.488345 26491 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.468654 26282 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:39.472983 26527 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.490038 26404 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.506140 26450 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.519886 21217 raft_consensus.cc:606] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:39.559916 26450 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.560719 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.452816 26526 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.562016 26450 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.520632 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:39.564960 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44395.5us
I20260709 13:08:39.525710 21294 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:39.566979 21776 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:39.567834 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 50074.4us
I20260709 13:08:39.526330 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:39.531123 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.536790 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.503762 26528 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.525931 26011 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.535471 26056 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:39.544955 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 99025.6us
I20260709 13:08:39.545929 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.546696 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.548704 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.549175 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.576939 21220 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:39.549641 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.548447 26512 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.550833 26282 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.551632 26404 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.526834 26406 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.541972 26465 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.553649 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.562788 25922 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.511348 21811 rpcz_store.cc:276] 0709 13:08:37.538614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.538737 (+   123us) service_pool.cc:224] Handling call
0709 13:08:37.539005 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.727462 (+188457us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:38.069529 (+342067us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.518178 (+448649us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.855521 (+337343us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800309a60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:38.883128 (+ 27607us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800309a60. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b6dd72060 00007f2b6dd84716 00007f2b6dd95287 00007f2b6dd95208
0709 13:08:38.884928 (+  1800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:38.884983 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:38.885034 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.510704 (+625670us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54004781d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:39.510746 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.510846 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":363196,"prepare.queue_time_us":289480,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":387002,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":11312,"spinlock_wait_cycles":492847104,"thread_start_us":739689,"threads_started":2,"wal-append.queue_time_us":581969}
I20260709 13:08:39.567111 21293 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:39.589109 21293 pending_rounds.cc:85] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 5
I20260709 13:08:39.589634 21293 pending_rounds.cc:107] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:39.571041 21223 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:39.564778 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:39.590027 21293 raft_consensus.cc:2889] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.569746 21299 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:39.570729 26526 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.594053 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:39.594134 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.572471 26160 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:39.573282 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.575730 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.575819 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:39.579090 26544 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.514269 26522 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:39.603330 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:39.604146 21148 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:39.592670 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.595546 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.597970 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:39.589130 21263 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:39.600379 21807 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:39.600396 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.605945 21811 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:39.600726 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.601109 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:39.579648 25564 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:39.584860 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:39.606844 21809 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:39.605342 21142 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:39.607860 21143 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:39.609411 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.611619 21144 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:39.603102 26546 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:08:39.615008 26404 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.577142 26011 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.594777 26465 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.616910 26338 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:39.617348 26338 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.617624 26011 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:39.617898 25564 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.620059 25564 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.620332 26056 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:39.620615 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.620956 26244 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:39.621379 26244 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.621704 26244 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.621874 26527 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.623486 21151 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 14: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:39.623651 21814 raft_consensus.cc:1240] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:39.617560 26465 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.637060 26522 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:39.640506 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:39.641920 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44049.8us
I20260709 13:08:39.645009 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.652312 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.652861 26554 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.654119 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.655593 21223 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:39.656620 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:39.657415 21294 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:39.658386 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:39.658528 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.659099 21294 raft_consensus.cc:2410] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:39.659555 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:39.593449 26498 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:39.593958 26406 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:39.617763 26338 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.664011 21225 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.699466 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.665081 21221 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:39.665699 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:39.596953 26160 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.660739 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.666586 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:39.667820 26526 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:39.661540 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.670286 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:39.664909 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.623008 26490 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.158s
W20260709 13:08:39.699563 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 59614.3us
I20260709 13:08:40.000794 21296 raft_consensus.cc:2410] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:39.869148 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:40.002067 21291 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:39.833338 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.830054 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:40.003971 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 337481us
W20260709 13:08:39.997552 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 327334us
I20260709 13:08:39.711304 21150 raft_consensus.cc:1240] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:39.964279 21814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d142716765ff4750912c13d99d61a1df"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:39.929097 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:40.005880 21814 raft_consensus.cc:606] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.703949 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.799396 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:39.699466 21149 raft_consensus.cc:1240] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:40.049515 21221 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:40.017266 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:40.048978 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:40.051927 21222 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:40.005944 21810 raft_consensus.cc:2393] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 16: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:39.710107 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.859548 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:40.055281 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:39.825163 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:40.058372 21142 raft_consensus.cc:3060] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.058897 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:40.059485 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:40.059949 21222 raft_consensus.cc:2393] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 14: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:39.801620 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:40.061321 21814 raft_consensus.cc:614] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.062178 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:39.909147 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.988618 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 289325us
I20260709 13:08:39.862933 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:40.064728 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1881) took 1025 ms. Trace:
I20260709 13:08:39.915220 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:39.800158 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:39.838776 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.796404 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:40.175304 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:40.065038 21149 rpcz_store.cc:276] 0709 13:08:39.039614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.039771 (+   157us) service_pool.cc:224] Handling call
0709 13:08:39.040093 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.672063 (+631970us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b54000783a0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:08:40.064533 (+392470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.064685 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9850240}
I20260709 13:08:40.188071 21144 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:08:40.189170 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 130772us
W20260709 13:08:40.189481 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 127390us
I20260709 13:08:40.190418 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:40.200556 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 285382us
I20260709 13:08:40.203752 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:40.204530 21807 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.207399 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.208329 21811 raft_consensus.cc:2410] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:08:39.823387 26548 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:40.240095 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 401396us
W20260709 13:08:39.902730 26563 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:40.246405 21143 raft_consensus.cc:1275] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:40.239390 21778 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:40.213151 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 172615us
I20260709 13:08:40.213284 21812 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:39.904552 26557 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:40.213820 21805 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:40.249526 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:40.250301 21805 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.212435 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.252369 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.253530 21811 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:39.702792 26282 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:40.116451 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.862375 26536 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:40.230453 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.015794 26160 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.069393 26526 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:39.901898 26512 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.070885 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:40.245358 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:40.256470 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 66161.4us
I20260709 13:08:40.259974 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.256172 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:39.988514 26098 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:39.839763 26554 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:40.280145 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:39.906165 26415 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.005977 26233 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.707132 26528 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:40.351581 26454 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.368063 26454 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.370333 26454 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:40.371665 26554 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:40.372181 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 308239us
I20260709 13:08:40.373212 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:40.373926 26554 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:40.374329 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:40.374482 26554 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:40.374576 21805 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:40.375669 26522 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:40.376142 26522 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.376920 26522 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:40.382642 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 134411us
I20260709 13:08:40.387669 26502 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:40.374989 26508 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:08:40.391647 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 111621us
I20260709 13:08:40.392752 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:40.394551 26282 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.395762 26282 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.396384 26282 consensus_queue.cc:1059] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:40.397713 26104 raft_consensus.cc:3055] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:40.398090 26104 raft_consensus.cc:740] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
W20260709 13:08:40.401374 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.407361 21291 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:40.404999 26522 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.408411 26029 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:08:39.888540 26406 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:40.410495 26522 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:40.411156 21293 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.413862 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:40.414477 21296 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.232041 26544 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:40.255975 26546 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.054837 26553 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:40.431881 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 57625.4us
I20260709 13:08:40.212405 26456 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.220s
W20260709 13:08:40.450649 21148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.146s	sys 0.285s
W20260709 13:08:40.517596 21148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.146s	sys 0.285s
I20260709 13:08:40.297433 21814 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:40.047696 26537 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:40.511229 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 251365us
I20260709 13:08:40.520385 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:40.515008 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 444147us
I20260709 13:08:40.294063 26433 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.839881 26549 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.527175 21147 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.374926 26554 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.522233 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.539451 21217 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:40.058090 26552 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:40.450096 26564 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:08:40.352059 26526 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:40.556308 21807 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:40.554953 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:40.567004 21297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.039s	sys 0.094s
W20260709 13:08:40.567631 21297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.040s	sys 0.094s
W20260709 13:08:40.569478 21225 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:08:40.456470 26502 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.256588 26309 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.570014 21225 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:40.572693 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:40.468101 26546 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.533048 26454 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:40.584508 21808 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.013s
W20260709 13:08:40.606056 21808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.000s	sys 0.013s
I20260709 13:08:40.463292 26492 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.280961 26536 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:40.069765 26450 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.465s
W20260709 13:08:40.573303 21813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.038s	sys 0.089s
W20260709 13:08:40.620714 21813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.038s	sys 0.089s
I20260709 13:08:40.398908 26104 consensus_queue.cc:260] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:39.857630 26498 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.599130 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1845) took 1046 ms. Trace:
W20260709 13:08:40.605048 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.586019 26512 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.558261 26554 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:40.557994 26528 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.647753 21810 raft_consensus.cc:1240] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:40.649616 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:40.629807 21142 consensus_meta.cc:287] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 13:08:40.529661 26537 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.651297 26537 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.651944 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1475) took 1050 ms. Trace:
I20260709 13:08:40.450608 26098 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.652311 21808 rpcz_store.cc:276] 0709 13:08:39.602025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.602164 (+   139us) service_pool.cc:224] Handling call
0709 13:08:39.602387 (+   223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.638766 (+ 36379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.638794 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.639217 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.849681 (+210464us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:40.610886 (+761205us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.611132 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.611219 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.651737 (+ 40518us) raft_consensus.cc:1685] finished
0709 13:08:40.651757 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.651893 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36011,"raft.queue_time_us":48448,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":18912,"thread_start_us":767107,"threads_started":2,"wal-append.queue_time_us":335136}
I20260709 13:08:40.653970 26098 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:40.572955 26552 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.595710 26309 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:40.584161 26515 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.533397 26508 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:08:40.596942 26245 raft_consensus.cc:2764] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:40.643335 26450 consensus_queue.cc:1243] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:40.644217 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.627580 25922 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.642848 26536 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:40.656114 21142 raft_consensus.cc:2468] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:40.659360 21217 rpcz_store.cc:276] 0709 13:08:39.558985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.560482 (+  1497us) service_pool.cc:224] Handling call
0709 13:08:40.598960 (+1038478us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b540038c554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:40.599075 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249337600}
I20260709 13:08:40.596112 26502 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.464151 26544 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.626821 26056 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.609933 26546 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.674196 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:40.677637 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.712281 21812 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:40.679124 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.685786 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:40.544317 26549 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.691190 21296 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
W20260709 13:08:40.692902 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 299037us
I20260709 13:08:40.534370 26553 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:40.691608 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 452267us
I20260709 13:08:40.785627 26527 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.696996 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.787580 21814 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:40.669868 26309 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.627322 26492 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:40.719417 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.698911 26502 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.621321 26401 consensus_queue.cc:1059] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:08:40.787791 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:40.801497 21807 raft_consensus.cc:606] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.801946 21807 raft_consensus.cc:614] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.790153 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:40.785522 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 107957us
I20260709 13:08:40.795644 21292 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.803002 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.811847 26401 raft_consensus.cc:3055] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:40.812292 26401 raft_consensus.cc:740] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:40.812369 26553 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:40.813162 26401 consensus_queue.cc:260] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.700696 25922 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.817256 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.817926 26492 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:40.818060 25564 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:40.819552 21223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.016s	sys 0.046s
W20260709 13:08:40.819888 21223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.046s
I20260709 13:08:40.787714 26536 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.824954 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:40.824900 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:40.832582 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 146899us
I20260709 13:08:40.834967 21217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:40.839704 21217 raft_consensus.cc:606] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:40.840157 21217 raft_consensus.cc:614] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:40.835820 21776 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.2:43757 timed out after 1.621s (SENT) [suppressed 6 similar messages]
I20260709 13:08:40.833299 21812 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:40.834851 21294 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.844749 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:40.843057 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51636.5us
I20260709 13:08:40.845485 21294 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:40.848327 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:40.858814 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:40.836745 26056 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:40.835719 26515 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.835673 25564 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.873688 21812 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:08:40.928644 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.822371 26452 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:40.955125 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:40.846011 26552 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:40.960493 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:40.961356 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.838258 26553 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:08:40.834800 26527 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:08:40.963199 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:40.968170 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:40.845340 26454 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:08:40.928234 26577 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:40.936949 26557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.045s
I20260709 13:08:40.948653 26233 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:40.869936 26450 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 13:08:40.986342 26098 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.998234 26098 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.998596 26098 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.001977 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1484) took 1168 ms. Trace:
I20260709 13:08:41.002398 21813 rpcz_store.cc:276] 0709 13:08:39.833308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.835464 (+  2156us) service_pool.cc:224] Handling call
0709 13:08:39.848435 (+ 12971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.848824 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.848866 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.856273 (+  7407us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.621170 (+764897us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:40.621223 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.621311 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.001750 (+380439us) raft_consensus.cc:1685] finished
0709 13:08:41.001771 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.001921 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":642,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5431,"thread_start_us":757125,"threads_started":1,"wal-append.queue_time_us":981141}
I20260709 13:08:40.970134 26133 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.985440 26515 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:40.991410 26557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.014s	sys 0.045s
I20260709 13:08:41.018023 21294 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.019375 26309 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.984859 26538 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:41.023329 21294 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.988844 26490 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.986557 26433 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:40.990031 26454 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:40.963901 25564 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:40.990378 26577 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.003773 26233 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.033682 26490 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.061995 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 476751us
W20260709 13:08:41.057452 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.052s
W20260709 13:08:41.070084 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.024s	sys 0.053s
I20260709 13:08:41.033831 26433 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.070845 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 548672us
W20260709 13:08:41.068893 26566 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:08:41.032142 26538 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.082540 21116 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:41.038385 26544 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.026950 26056 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.057951 26549 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.051996 26569 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:41.104373 26244 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.482s	user 0.011s	sys 0.001s
W20260709 13:08:41.089612 26415 consensus_meta.cc:287] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.002s
I20260709 13:08:41.104702 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:41.105204 26565 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:08:41.105397 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.106142 26309 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:41.079321 26160 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
W20260709 13:08:41.090678 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.130213 26244 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.159649 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.146387 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1899) took 1518 ms. Trace:
I20260709 13:08:41.129010 26410 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:41.183107 21809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.015s	sys 0.044s
W20260709 13:08:41.183614 21809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.015s	sys 0.044s
W20260709 13:08:41.184768 21299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.007s	sys 0.023s
W20260709 13:08:41.185163 21299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.008s	sys 0.023s
I20260709 13:08:41.186553 21226 raft_consensus.cc:2393] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:41.131332 26415 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.189713 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:41.142021 21263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.024s	sys 0.054s
I20260709 13:08:41.131453 26133 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.192202 21263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.024s	sys 0.054s
W20260709 13:08:41.194171 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 590912us
I20260709 13:08:41.195588 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:41.184484 26554 consensus_meta.cc:287] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.003s
I20260709 13:08:41.141119 26490 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:41.190433 26029 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.024s	sys 0.024s
I20260709 13:08:41.206475 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.145445 26160 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.182327 21148 rpcz_store.cc:276] 0709 13:08:39.628441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.629263 (+   822us) service_pool.cc:224] Handling call
0709 13:08:39.638032 (+  8769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.662048 (+ 24016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.662089 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.725218 (+ 63129us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.534710 (+809492us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.534759 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.534832 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.146160 (+611328us) raft_consensus.cc:1685] finished
0709 13:08:41.146182 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.146322 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30794,"raft.queue_time_us":118,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":22421,"thread_start_us":697606,"threads_started":1,"wal-append.queue_time_us":894197}
I20260709 13:08:41.215385 21225 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:41.231570 21808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.018s	sys 0.026s
W20260709 13:08:41.231943 21808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.019s	sys 0.026s
I20260709 13:08:41.191138 25564 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:41.236529 21291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.024s
W20260709 13:08:41.238366 21291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.025s
W20260709 13:08:41.239961 21293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.024s	sys 0.051s
W20260709 13:08:41.241379 21293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.024s	sys 0.051s
W20260709 13:08:41.209210 26029 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.024s	sys 0.024s
W20260709 13:08:41.242436 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 383696us
I20260709 13:08:41.251641 21145 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:41.208760 26454 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:41.186290 26410 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.257376 21294 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:41.257927 21294 pending_rounds.cc:85] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 10
I20260709 13:08:41.258224 21294 pending_rounds.cc:107] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:41.258530 21294 raft_consensus.cc:2889] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.232581 26545 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.260481 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2977) took 2208 ms. Trace:
I20260709 13:08:41.227386 26490 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:41.260046 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 424219us
I20260709 13:08:41.201164 26133 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.229213 26515 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:08:41.203198 26554 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.299558 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 51579us
W20260709 13:08:41.314309 21806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.013s	sys 0.019s
W20260709 13:08:41.322477 21806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.019s
I20260709 13:08:41.136250 26569 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.301872 21776 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:41.266238 21297 rpcz_store.cc:276] 0709 13:08:39.045182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.045429 (+   247us) service_pool.cc:224] Handling call
0709 13:08:39.063344 (+ 17915us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.154719 (+ 91375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.154746 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.155342 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:08:39.799056 (+643714us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800491ec0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:08:40.568122 (+769066us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:40.568178 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.620444 (+ 52266us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b5400327b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:40.620513 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.253166 (+632653us) raft_consensus.cc:1685] finished
0709 13:08:41.253187 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.253393 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2406,"raft.queue_time_us":936,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5557,"spinlock_wait_cycles":212235008,"thread_start_us":768838,"threads_started":1,"wal-append.queue_time_us":1777448}
W20260709 13:08:41.381765 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 80114.7us
I20260709 13:08:41.338714 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.279157 26450 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.259686 26576 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.385329 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.387296 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:41.393061 21810 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.394820 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.290059 26571 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.403452 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.387547 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 167675us
I20260709 13:08:41.267573 26577 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.391188 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.341472 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.335012 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.334473 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:41.292606 26526 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 13:08:41.398741 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.331393 26328 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.390303 21813 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:41.426273 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.426388 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.426777 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.295181 26582 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:41.380904 26454 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.379298 26579 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.378798 26245 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.290830 26098 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.402549 26572 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:08:41.387068 25564 raft_consensus.cc:2804] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:41.389760 26433 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.394170 26415 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:41.382737 26282 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.447022 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.301492 26544 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:08:41.456867 21813 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:41.468083 21810 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:41.318637 26490 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.432363 26527 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.435621 26577 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.466795 26570 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:08:41.405944 26576 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.468060 26538 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:41.472813 26444 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:08:41.432145 26526 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.427219 26571 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.446453 26454 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.485138 26244 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:41.551932 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 232781us
I20260709 13:08:41.438196 26328 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.536037 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:41.548290 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 120758us
I20260709 13:08:41.545811 21115 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:41.464041 26245 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.555207 26526 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:41.554507 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.442459 26582 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:41.526693 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 194333us
I20260709 13:08:41.565099 26576 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.565367 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1182) took 1363 ms. Trace:
I20260709 13:08:41.559514 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.545142 26450 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.588361 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2996) took 1171 ms. Trace:
I20260709 13:08:41.517452 26282 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.585628 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2550) took 1092 ms. Trace:
I20260709 13:08:41.597114 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:41.597186 21291 rpcz_store.cc:276] 0709 13:08:40.493074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.493271 (+   197us) service_pool.cc:224] Handling call
0709 13:08:40.562750 (+ 69479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.563195 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.563232 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.620813 (+ 57581us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.241354 (+620541us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:41.241396 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.243536 (+  2140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.585429 (+341893us) raft_consensus.cc:1685] finished
0709 13:08:41.585449 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.585574 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8022,"raft.queue_time_us":8404,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":14761,"thread_start_us":557790,"threads_started":1,"wal-append.queue_time_us":845156}
I20260709 13:08:41.585729 26245 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.586393 26410 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:41.586519 26599 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:41.556584 26549 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.583551 26160 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:41.585569 26537 consensus_meta.cc:287] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.934s	user 0.004s	sys 0.009s
I20260709 13:08:41.577564 21809 rpcz_store.cc:276] 0709 13:08:40.202060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.202184 (+   124us) service_pool.cc:224] Handling call
0709 13:08:40.202516 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.257765 (+ 55249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.257796 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.258366 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.184045 (+925679us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:41.252803 (+ 68758us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.253085 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.253187 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.565153 (+311966us) raft_consensus.cc:1685] finished
0709 13:08:41.565175 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.565310 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54775,"prepare.queue_time_us":63219,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4147,"raft.queue_time_us":79290,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":66491,"thread_start_us":730823,"threads_started":1,"wal-append.queue_time_us":1170822}
W20260709 13:08:41.587080 26592 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:41.455770 26579 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.550033 26444 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:41.588748 21293 rpcz_store.cc:276] 0709 13:08:40.417329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.419718 (+  2389us) service_pool.cc:224] Handling call
0709 13:08:40.420020 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.420407 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.420437 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.420954 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.243687 (+822733us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:41.243734 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.243826 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.588163 (+344337us) raft_consensus.cc:1685] finished
0709 13:08:41.588183 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.588305 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1378,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":23711,"thread_start_us":822421,"threads_started":1,"wal-append.queue_time_us":1130847}
I20260709 13:08:41.529111 26577 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.573475 21813 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:41.607915 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 2986) took 1599 ms. Trace:
I20260709 13:08:41.623143 21223 rpcz_store.cc:276] 0709 13:08:40.008384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.008518 (+   134us) service_pool.cc:224] Handling call
0709 13:08:40.008816 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.009055 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.009100 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.009494 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.820442 (+810948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:40.820496 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.820582 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.607626 (+787044us) raft_consensus.cc:1685] finished
0709 13:08:41.607654 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.607847 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":574494,"threads_started":1,"wal-append.queue_time_us":924812}
W20260709 13:08:41.615408 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 62368.8us
I20260709 13:08:41.568922 26589 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.620537 21190 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:41.631907 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.607023 26601 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.621449 25564 raft_consensus.cc:697] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:41.614746 26410 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:41.612112 26098 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.643369 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:41.643944 21807 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.635094 26160 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:41.616037 26245 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:41.641238 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.622689 26537 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.635090 26554 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.647105 21810 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:41.684926 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.685540 21810 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:41.658310 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.604007 26450 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.655009 21807 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:41.689677 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:41.626120 26544 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.640552 26546 consensus_meta.cc:287] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.838s	user 0.013s	sys 0.000s
I20260709 13:08:41.630622 26588 raft_consensus.cc:2764] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:41.643226 26604 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:41.661602 26586 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:41.626237 26498 consensus_queue.cc:1059] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:08:41.678491 26282 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.607097 26415 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.680081 26579 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.683352 26029 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:41.644454 26609 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.657836 26537 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.675426 26571 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.661046 26490 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.625919 26444 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.683013 26597 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.647423 26620 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.647631 26245 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:41.647748 26410 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.647749 26622 consensus_queue.cc:1048] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:08:41.686007 26601 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.756166 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 185017us
I20260709 13:08:41.771667 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:41.908409 21264 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:41.847543 21808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1384) took 1175 ms. Trace:
I20260709 13:08:41.729297 21150 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:41.783226 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.910229 21223 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:41.729508 21144 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:08:41.843700 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 306748us
I20260709 13:08:41.790580 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:41.773492 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:41.913334 21151 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
W20260709 13:08:41.844009 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 255860us
W20260709 13:08:41.716316 26452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.009s	sys 0.019s
I20260709 13:08:41.929540 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:41.728400 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:41.888229 26600 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:41.958484 26600 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.960085 26104 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.962248 26600 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.963135 26608 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.909199 21808 rpcz_store.cc:276] 0709 13:08:40.672629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.672761 (+   132us) service_pool.cc:224] Handling call
0709 13:08:40.673056 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.673446 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:40.673481 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.674005 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.232303 (+558298us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.232345 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.232423 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.847129 (+614706us) raft_consensus.cc:1685] finished
0709 13:08:41.847158 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.847466 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":315,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":557939,"threads_started":1,"wal-append.queue_time_us":858705}
I20260709 13:08:41.908738 21149 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:41.928871 26339 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.890810 26613 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:41.970957 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.949837 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:41.843415 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 216174us
I20260709 13:08:41.973908 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:41.959522 26282 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.979420 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:41.712743 26546 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.974637 21114 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:41.988659 26603 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:41.989249 26603 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:41.989960 26536 consensus_meta.cc:287] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.154s	user 0.012s	sys 0.000s
I20260709 13:08:41.990466 26536 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:41.991434 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:41.992415 21291 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:41.991641 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 62213.5us
I20260709 13:08:41.994371 26603 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:41.702457 26582 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.994935 25922 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.995126 26603 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.995870 26603 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:41.996352 26627 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.996953 26603 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.999276 26245 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.001148 26410 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.932435 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:41.981014 21809 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
W20260709 13:08:41.780613 26502 consensus_meta.cc:287] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.000s
I20260709 13:08:41.982429 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:41.985503 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 70374.7us
I20260709 13:08:41.985671 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:41.857172 26454 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:41.990927 26536 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:41.774255 26338 consensus_meta.cc:287] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 1.720s	user 0.012s	sys 0.002s
W20260709 13:08:41.929422 26452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.010s	sys 0.020s
I20260709 13:08:41.889401 26629 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.019366 21299 raft_consensus.cc:2410] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:42.021231 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:41.907656 26567 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:41.777912 26528 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.706547 26544 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.889133 26631 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:41.929320 26098 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:41.975222 26630 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.023384 26577 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:41.975569 26029 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.028534 21812 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:41.788847 26621 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.030424 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.062443 21291 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.001837 26056 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:42.032250 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:41.983826 26498 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.063352 21294 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:42.034289 26233 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.042533 26629 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:41.988142 26613 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.043094 21144 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:08:42.043541 26549 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.044129 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.078742 21298 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:42.044710 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.044942 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.047461 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.049114 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.080080 21149 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:42.049701 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.050119 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.007579 26620 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.053349 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:41.778810 26450 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.055279 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.005465 26339 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.059724 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.002275 26616 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:42.060457 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 80219us
I20260709 13:08:42.052307 26527 consensus_queue.cc:1059] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:08:42.040407 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.048084 26528 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.947759 26597 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.054667 26632 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:42.075822 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 81826.8us
I20260709 13:08:42.025486 26502 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.055702 26609 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.082422 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.082507 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.110512 21151 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:42.083586 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.082935 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.083717 21223 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:42.063086 26098 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:42.086759 26553 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.811537 25564 consensus_queue.cc:237] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.092834 21143 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:42.094707 21190 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.067606 26498 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.097186 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.101686 21291 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:42.036506 26338 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.075011 26633 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.089313 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.118281 21217 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:42.124346 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.124748 26452 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.206012 21300 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
W20260709 13:08:42.180474 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.193642 21147 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:42.098052 26571 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.119122 26527 consensus_queue.cc:1243] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:42.193819 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.180532 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:42.062777 26630 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.111949 26620 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.116801 26632 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.218516 26620 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.057572 26631 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.223521 26630 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.225066 26613 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.226604 26536 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:42.207967 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 113341us
I20260709 13:08:42.103464 26616 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:42.231976 26616 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.232643 26601 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.233052 26512 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.233553 26512 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.233922 26614 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.234403 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1488) took 1365 ms. Trace:
I20260709 13:08:42.235198 26639 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.234777 21805 rpcz_store.cc:276] 0709 13:08:40.868684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.869612 (+   928us) service_pool.cc:224] Handling call
0709 13:08:40.869955 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.050482 (+180527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.050514 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.050556 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:41.050585 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.234199 (+1183614us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54007481d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:42.234243 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.234352 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414676864}
I20260709 13:08:42.235747 26639 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.237938 26639 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.232004 26544 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.199332 25922 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.180397 26498 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.069392 26621 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.197233 21776 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.103106 26245 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 13:08:42.216620 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 136285us
I20260709 13:08:42.192921 26622 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.207170 26633 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.204841 26339 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.213255 26282 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:42.202729 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:42.207561 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 102349us
W20260709 13:08:42.245680 21146 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.003s
I20260709 13:08:42.234431 26614 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:42.250083 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52963.6us
I20260709 13:08:42.330446 26328 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.312278 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.337450 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.202687 26508 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:42.215240 26625 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.338728 26625 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.259006 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.119432 26609 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.261333 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.320729 26502 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.263392 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.340035 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:42.338251 21146 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.016s	sys 0.008s
I20260709 13:08:42.316243 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.321417 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.325752 21295 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:42.334962 21300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57018 (request call id 1082) took 2477 ms (client timeout 1734 ms). Trace:
I20260709 13:08:42.341986 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.342301 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.342833 21805 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 8: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:42.326390 21145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2361) took 2733 ms. Trace:
I20260709 13:08:42.341562 21299 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
W20260709 13:08:42.342105 21300 rpcz_store.cc:269] 0709 13:08:39.857469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.857582 (+   113us) service_pool.cc:224] Handling call
0709 13:08:42.334712 (+2477130us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b540015fed4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:42.334849 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4925166976}
I20260709 13:08:42.295351 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.339129 26625 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.338326 26614 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.216889 26056 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.304342 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.354393 21298 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.243455 26444 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.355837 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.344063 21145 rpcz_store.cc:276] 0709 13:08:39.592993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.593130 (+   137us) service_pool.cc:224] Handling call
0709 13:08:39.593480 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.252300 (+1658820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.326150 (+1073850us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400214b54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:42.326314 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3812773632}
I20260709 13:08:42.357378 21807 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:42.263835 26512 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.246965 26546 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.253755 21143 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:42.355837 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.361047 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.361593 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.361956 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.363035 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.364801 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:42.288897 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.260946 26619 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.333974 26617 raft_consensus.cc:3055] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:42.343897 26645 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.286782 26338 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.247512 25922 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.319733 26597 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.387526 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.399082 21810 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:42.385478 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:42.383605 21191 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.272465 26575 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.271618 26282 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:42.262032 26536 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.391345 21298 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:42.323635 26621 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:42.410590 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 321365us
I20260709 13:08:42.411350 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.388863 26619 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.285372 26629 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.416289 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.401299 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.385983 26104 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.403285 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.264393 26622 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.386242 26056 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.400885 26645 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.288166 26098 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.383797 26614 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:42.311313 26578 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.441426 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.420611 21807 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:42.418569 26631 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:42.418099 26642 log.cc:927] Time spent T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:08:42.390271 26617 raft_consensus.cc:740] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:42.433408 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.434427 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.435053 21299 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:42.406803 26575 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.448268 21295 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:42.440158 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.450783 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.451629 21298 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:42.453734 26133 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.441748 26638 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:42.455775 26638 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.456146 26638 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.455113 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.457206 21807 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:42.458382 21191 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.443751 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.415169 26653 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.444737 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.445340 21300 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 10: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:42.414961 26536 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.421195 26619 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.464794 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.419013 26553 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.460142 21810 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:42.460322 21294 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:42.441546 26591 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:42.462467 26617 consensus_queue.cc:260] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.425105 26604 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:42.426506 26104 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.446681 26282 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.492576 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.492743 26653 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:42.493286 26401 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.493649 26633 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.496670 26029 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.497694 26498 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.499614 25922 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.484716 21114 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.446805 26614 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.465307 26245 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:42.501801 26609 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.503779 21191 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.505067 26490 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.506285 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.507248 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.506645 26632 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.510182 26056 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.466625 26162 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.466739 26328 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.501802 26613 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:42.520875 21219 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:42.521014 26613 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:42.521922 26613 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.522797 26639 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:42.516034 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 49064.7us
I20260709 13:08:42.484802 26553 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.517877 21810 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:42.505594 26653 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.501883 26591 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.535753 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:42.508754 26617 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.447054 26578 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.526549 26328 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.520109 26162 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.518445 26508 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.530526 26622 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.517833 26528 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.531735 26104 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:42.532095 21116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.002s	sys 0.028s
I20260709 13:08:42.532487 26029 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:42.552533 26029 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.553023 26029 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.528844 26604 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:42.554272 26604 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.554693 26604 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.554741 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.536537 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.555747 21294 raft_consensus.cc:2393] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:42.523159 26639 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:42.557013 26639 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.557502 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.558033 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.550328 26508 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.559937 26508 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.560010 26536 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.560727 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.561704 21814 raft_consensus.cc:3055] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:42.562038 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.541823 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.564153 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.564849 21294 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:42.565449 21147 raft_consensus.cc:1240] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:42.542013 26614 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.576088 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.567530 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.543310 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.543643 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.544339 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.514191 26625 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.578701 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.550289 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.579193 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.551205 21778 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:42.549917 21116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.002s	sys 0.028s
I20260709 13:08:42.527022 26613 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.552038 26528 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.593839 21291 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:42.570875 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:42.572954 21776 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.574450 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.595108 21146 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:42.534814 26653 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.528957 26553 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.577384 21147 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:42.585824 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.586768 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.587924 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.588825 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.562070 21814 raft_consensus.cc:740] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:42.550172 26162 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.589823 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.592934 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:42.595573 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.596227 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.597200 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.599295 26625 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.539070 26245 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.578641 26522 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.602615 21808 raft_consensus.cc:1240] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:42.580328 26498 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.602739 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:42.577728 26415 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.607884 21814 consensus_queue.cc:260] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.603969 26622 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:42.614192 21776 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.609833 21217 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:42.616061 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:42.616081 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.541144 26645 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.612090 21116 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.620702 21814 raft_consensus.cc:3060] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.600924 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.622707 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.610271 26233 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.607896 26596 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.631665 21225 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.632822 21115 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.642174 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:42.646128 26657 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:08:42.648466 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:42.612076 26245 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.651731 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.619671 26631 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:42.654104 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.657392 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.659951 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.649933 26508 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.664901 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.665663 21296 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:42.666831 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.669478 26508 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.653141 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.660862 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.662091 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:42.662510 21116 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.662638 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.623695 26536 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.640770 26632 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.685578 21116 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:42.651379 26339 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.639495 26233 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.690865 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.692292 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.643456 26622 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:42.662766 26245 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.700263 21814 raft_consensus.cc:1275] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:42.702450 21814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1493) took 1364 ms. Trace:
I20260709 13:08:42.675734 26589 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.661585 26621 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.700814 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.706286 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.708766 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.708884 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.663408 26631 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.678884 26601 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.688153 26632 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.703059 21814 rpcz_store.cc:276] 0709 13:08:41.337801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.339206 (+  1405us) service_pool.cc:224] Handling call
0709 13:08:41.390942 (+ 51736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.561603 (+1170661us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003d2fa0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dcf1dc0 00007f2b6dd7c1c0 00007f2b6dd7d231 00007f2b6dd79d8f 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c
0709 13:08:42.702105 (+140502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.702377 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497418112}
I20260709 13:08:42.715039 21294 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.689913 26508 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.693574 26618 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:42.712181 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.693908 26233 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.693123 26410 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.724260 21143 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:42.755228 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.725803 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:42.756445 21810 raft_consensus.cc:2368] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:42.661433 26623 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:08:42.707363 26571 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.726222 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.704264 26537 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:42.719975 26552 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:42.710827 26630 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.714638 26589 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.713750 26649 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.723138 26631 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.714452 26591 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.725035 26452 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.727859 26632 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:42.776952 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 50795us
I20260709 13:08:42.794780 21146 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 16: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:42.691002 26536 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.658277 26596 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:42.784554 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.787943 26338 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.726605 26603 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.790812 21294 raft_consensus.cc:2468] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
W20260709 13:08:42.802605 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82236.9us
I20260709 13:08:42.740711 26245 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.778488 26527 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.743242 26618 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.795030 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:42.721751 26601 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.741709 26625 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:42.776351 26666 consensus_queue.cc:1048] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:42.775843 26282 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.791786 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.741322 26609 consensus_queue.cc:1059] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:08:42.782764 26498 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:42.806113 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:42.804167 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 96917.1us
I20260709 13:08:42.792614 26589 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.827454 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.828513 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:42.828871 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 103586us
I20260709 13:08:42.828361 21263 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:42.790290 26528 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.804837 21778 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.831460 21150 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:42.835750 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:42.836851 21294 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:42.840835 21294 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:42.841795 21294 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.842648 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.802873 26338 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.837076 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.805203 26328 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.848536 26338 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.843029 21294 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:42.851708 26664 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:08:42.827711 26638 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.854719 26638 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.829460 26601 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.840198 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.860141 21116 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:42.861290 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.851781 26528 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.831561 26633 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.831719 26666 consensus_queue.cc:1243] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 5e66e7254b764832b244bb5b07b4a208 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:42.866605 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.867933 26597 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.868345 26597 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.868671 26597 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.869050 21116 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.869765 26537 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.870715 26537 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.838244 26104 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:42.871646 26104 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.872519 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:42.873555 26537 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.873664 26104 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:42.875469 26245 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.875624 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:42.830691 26618 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.828356 26603 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.882102 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:42.882678 21814 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.883685 26603 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.884461 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:42.884594 26631 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.865521 26452 raft_consensus.cc:2804] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.885720 26452 raft_consensus.cc:697] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:42.886593 26452 consensus_queue.cc:237] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.888700 26536 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:42.889717 26536 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:42.890489 26454 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.890897 26454 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:42.832585 26578 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:42.841064 26498 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.894479 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.894785 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.895123 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.895637 21143 raft_consensus.cc:2410] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:42.896293 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:42.897957 21814 raft_consensus.cc:2468] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:42.828965 26527 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.839970 26625 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:42.912921 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:42.925807 21295 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:42.892035 26609 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.834936 26282 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.891976 26649 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.799564 26622 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.881274 26633 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:42.939087 26633 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.933481 26649 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:42.947949 26649 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.891693 26454 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.880524 26338 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:42.932282 26609 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.941776 26162 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.056703 26544 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.947045 26632 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.934096 26619 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:42.932919 26628 consensus_queue.cc:1059] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.151s
I20260709 13:08:43.101053 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.072850 26609 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:43.103825 21226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 858) took 3426 ms (client timeout 1734 ms). Trace:
W20260709 13:08:43.104123 21226 rpcz_store.cc:269] 0709 13:08:39.670888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.703686 (+ 32798us) service_pool.cc:224] Handling call
0709 13:08:43.096946 (+3393260us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540035b454. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:43.097123 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712642944}
W20260709 13:08:43.084968 26674 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:08:43.108834 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:43.093283 26490 consensus_meta.cc:287] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.005s
I20260709 13:08:43.110144 21217 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.119675 21147 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.174571 26282 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:43.108062 26604 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
I20260709 13:08:43.184201 26621 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:43.184656 26621 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:43.186324 26553 consensus_meta.cc:287] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
W20260709 13:08:43.189419 26653 consensus_meta.cc:287] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.000s
I20260709 13:08:43.189841 26653 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.185007 26621 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.192238 26498 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.112582 26569 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.193840 26596 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:43.197229 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.116309 26490 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:43.209800 26029 consensus_meta.cc:287] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.001s
I20260709 13:08:43.210237 26029 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.212746 26527 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.215420 26338 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.110638 26452 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:43.186811 26553 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.224583 26619 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.226248 26162 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.227360 26601 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.229092 26575 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.229554 26601 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.230882 26553 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.103525 26544 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:43.220098 26617 consensus_meta.cc:287] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
I20260709 13:08:43.224646 26233 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:43.237471 26522 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.000s
W20260709 13:08:43.245393 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 136597us
I20260709 13:08:43.246654 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.247671 21142 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:43.216096 26633 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.246666 26522 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:43.204084 26604 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.250278 26233 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:43.252981 26668 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:08:43.257341 26029 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.258904 26620 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.265723 26632 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.273468 21222 raft_consensus.cc:1240] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.274529 26632 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:43.248685 26622 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.278117 26604 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.278043 26597 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.281319 26653 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.287685 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.286756 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.261608 26649 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.288890 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.293659 21221 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:43.257817 26621 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.290977 26614 raft_consensus.cc:3055] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:43.275483 26632 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.308020 21806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1184) took 3100 ms. Trace:
I20260709 13:08:43.295516 26589 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.306581 26622 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:43.314023 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.306195 26614 raft_consensus.cc:740] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.314646 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.320392 21808 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.315634 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1389) took 1931 ms. Trace:
I20260709 13:08:43.317492 26675 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:43.318122 26678 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:08:43.318884 26609 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.320372 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.325767 21814 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:43.326777 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:43.308668 26649 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.308552 21806 rpcz_store.cc:276] 0709 13:08:40.205960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.206119 (+   159us) service_pool.cc:224] Handling call
0709 13:08:40.206506 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.655542 (+449036us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:41.331654 (+676112us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.561371 (+229717us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.610309 (+ 48938us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.610466 (+   157us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:41.781196 (+170730us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b180039af00. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac07c0a 00007f2b74347219 00007f2b6ac8fa40 00007f2b6ac8a4e4 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:08:41.787691 (+  6495us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.787983 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.305622 (+1517639us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54005217d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.305700 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.305761 (+    61us) raft_consensus.cc:1685] finished
0709 13:08:43.305780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.305953 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15398,"prepare.queue_time_us":391290,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":140329,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":20865,"spinlock_wait_cycles":1041951232,"thread_start_us":826169,"threads_started":3,"wal-append.queue_time_us":256570,"wal-append.run_cpu_time_us":3468,"wal-append.run_wall_time_us":1234910}
I20260709 13:08:43.320876 21813 rpcz_store.cc:276] 0709 13:08:41.384693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.485298 (+100605us) service_pool.cc:224] Handling call
0709 13:08:41.485586 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.622878 (+137292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.315413 (+1692535us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b5400391f54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.315579 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201300864}
I20260709 13:08:43.332320 21808 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:43.329123 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.333225 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.333926 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.334185 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.334470 21814 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.332723 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.328972 26615 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.335546 26415 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:43.336321 26621 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.336719 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:43.322198 26677 log.cc:927] Time spent T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:43.337421 26597 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.335778 26615 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:43.337242 21813 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.338243 26614 consensus_queue.cc:260] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.338873 26589 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.338963 26631 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.320771 26622 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.340942 26622 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.334759 21806 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:43.342898 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.344461 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.338311 26615 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.345662 26614 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.328076 26618 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.348873 26618 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.349076 21813 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:43.349908 26622 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:43.350965 26622 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.352950 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.352982 26622 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.353176 26615 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:43.353545 21809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52780 (request call id 1496) took 1713 ms (client timeout 1606 ms). Trace:
I20260709 13:08:43.357964 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.353559 21222 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.359495 26609 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.355096 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.355345 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.362411 21813 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.363580 21806 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:43.344738 21814 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:43.344079 26631 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:43.357756 21809 rpcz_store.cc:269] 0709 13:08:41.640164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.640541 (+   377us) service_pool.cc:224] Handling call
0709 13:08:43.353345 (+1712804us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400477554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:43.353456 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754878208}
I20260709 13:08:43.354524 21115 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:43.354351 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.361581 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.364673 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.367588 21808 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.367776 21814 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:43.366480 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.369517 21806 raft_consensus.cc:2393] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:43.367884 21115 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:43.370280 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.370443 21115 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:43.360724 26633 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.375723 21813 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:43.377852 21222 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:43.380041 21808 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:43.377007 21115 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:43.381240 26597 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:43.381803 26597 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:43.382400 21814 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 13:08:43.382725 26597 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.383689 21776 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.368716 26631 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.384457 26549 raft_consensus.cc:2804] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:43.384995 26549 raft_consensus.cc:697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:43.386044 26631 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.385814 26549 consensus_queue.cc:237] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.368891 26627 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:43.388859 26640 log.cc:927] Time spent T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 1.162s	user 0.012s	sys 0.000s
I20260709 13:08:43.390589 21148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39282 (request call id 976) took 1663 ms. Trace:
I20260709 13:08:43.378026 26595 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.391621 26595 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:43.392494 26595 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.390939 21148 rpcz_store.cc:276] 0709 13:08:41.727666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.957855 (+230189us) service_pool.cc:224] Handling call
0709 13:08:41.958478 (+   623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:41.991773 (+ 33295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.991800 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:41.992350 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 13:08:42.088825 (+ 96475us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:42.089577 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.089648 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.388307 (+1298659us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:43.390289 (+  1982us) raft_consensus.cc:1685] finished
0709 13:08:43.390312 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.390532 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32771,"raft.queue_time_us":33930,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":38222592,"thread_start_us":96122,"threads_started":1,"wal-append.queue_time_us":233636}
I20260709 13:08:43.379359 26618 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.396358 21143 raft_consensus.cc:1240] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:08:43.395561 26618 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:43.396621 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:43.404467 26662 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.786s	user 0.000s	sys 0.002s
W20260709 13:08:43.405001 26663 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.683s	user 0.003s	sys 0.000s
I20260709 13:08:43.408942 21814 pending_rounds.cc:85] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Aborting all ops after (but not including) 11
I20260709 13:08:43.409307 21814 pending_rounds.cc:107] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:08:43.409605 21814 raft_consensus.cc:2889] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.394937 21189 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:43.411427 21145 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.413630 21805 raft_consensus.cc:1240] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:43.413813 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.414916 21805 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:43.416004 26633 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.417135 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.417889 26641 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.418859 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.408157 21115 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:43.419193 26641 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:43.421475 26508 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.421557 26618 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.422055 26508 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:43.423381 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.424757 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.416052 21805 raft_consensus.cc:1240] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.429437 21806 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:43.427657 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.432847 21806 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:43.434499 21806 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.430651 21805 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:43.436710 21806 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.428921 26538 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.438086 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.438264 26538 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.438687 26538 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.438854 21220 raft_consensus.cc:2393] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 17: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:43.440191 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.441636 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.442984 26633 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.443131 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.444257 26612 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:43.445245 26632 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.447433 26604 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:43.448525 26604 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:43.448582 21811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52758 (request call id 1201) took 1253 ms. Trace:
I20260709 13:08:43.448938 26604 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:43.449141 21811 rpcz_store.cc:276] 0709 13:08:42.195220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.196407 (+  1187us) service_pool.cc:224] Handling call
0709 13:08:42.196735 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.221767 (+ 25032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.221805 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.221847 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:42.221882 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.448297 (+1226415us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54006bbf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.448360 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.448512 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57033600}
I20260709 13:08:43.451864 21220 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:43.454169 21145 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:43.431567 26528 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.455794 26612 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:43.456194 26612 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:43.456936 26612 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.458014 26612 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.458056 26538 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.460062 26604 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.461225 26604 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.468379 26538 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.471858 26615 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.472577 26639 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.473471 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 2552) took 1210 ms. Trace:
I20260709 13:08:43.424324 26508 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.473913 21291 rpcz_store.cc:276] 0709 13:08:42.263024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.263150 (+   126us) service_pool.cc:224] Handling call
0709 13:08:43.473258 (+1210108us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540001e354. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:43.473385 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582731136}
I20260709 13:08:43.477614 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.478356 21293 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:43.482188 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.482455 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.483148 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.483685 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.484351 21222 raft_consensus.cc:3060] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.486218 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.507318 21225 raft_consensus.cc:2393] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:43.501284 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.509146 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.509971 21222 raft_consensus.cc:2468] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:43.513550 21263 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.514773 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.510916 26614 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.511492 26456 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.511958 26615 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:43.517428 26616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.021s	sys 0.025s
I20260709 13:08:43.516264 26536 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.523068 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.518741 26645 raft_consensus.cc:2804] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.518563 26626 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:43.521431 26616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.021s	sys 0.025s
I20260709 13:08:43.520635 26456 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:43.529882 21218 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:43.529455 26456 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.521687 26615 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.556238 21809 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.559326 26616 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:43.559919 26616 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.562079 26616 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.563165 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.564845 26615 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.528705 26645 raft_consensus.cc:697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.570072 26645 consensus_queue.cc:237] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.573360 26544 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.577438 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.578225 21225 raft_consensus.cc:2410] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:43.583034 21813 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.587930 26614 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:43.589596 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.593832 21298 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:43.595559 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.596606 21293 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:43.598270 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.597807 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.599205 21146 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:43.600593 21148 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:43.604190 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.604451 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.605098 21300 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:43.605939 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.607543 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.605966 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.607009 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.608443 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:43.609714 21190 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.611835 26627 consensus_queue.cc:1059] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:43.612179 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.613324 21291 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.614374 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.614557 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.615653 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.619833 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.601365 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.625131 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.588673 26456 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.621012 21190 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.628162 21150 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.629789 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.630424 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:43.632207 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.632473 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.628331 26604 raft_consensus.cc:2804] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.634027 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.634714 21296 raft_consensus.cc:2368] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:43.635210 25564 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.636654 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:43.612994 26618 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:43.620532 26616 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.634546 26538 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:43.643944 26612 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.644677 26538 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:43.628453 26545 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.645664 26538 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.646586 26029 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:43.646996 26029 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:43.647396 26029 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.637378 26549 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:43.651239 26454 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.651515 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.654729 21150 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:43.612825 26627 raft_consensus.cc:3055] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:43.656046 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1490) took 2786 ms. Trace:
I20260709 13:08:43.657713 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.656481 21812 rpcz_store.cc:276] 0709 13:08:40.869377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.952307 (+ 82930us) service_pool.cc:224] Handling call
0709 13:08:40.952689 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.058040 (+1105351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.655827 (+1597787us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005136d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.655975 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473829632}
I20260709 13:08:43.653878 26636 raft_consensus.cc:3055] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:43.662040 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.599180 26614 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.661219 21223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 3011) took 1120 ms. Trace:
I20260709 13:08:43.672231 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.652504 26549 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:43.637348 26604 raft_consensus.cc:697] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:43.680651 26604 consensus_queue.cc:237] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.686391 21292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2560) took 1362 ms. Trace:
I20260709 13:08:43.686939 21292 rpcz_store.cc:276] 0709 13:08:42.324273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.324858 (+   585us) service_pool.cc:224] Handling call
0709 13:08:42.325155 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.506954 (+181799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.507000 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.507037 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:42.507064 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.686058 (+1178994us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540037ffd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.686137 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.686295 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417576192}
I20260709 13:08:43.690255 26612 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.690830 26612 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.693104 26612 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.695051 26571 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:43.695667 26571 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.698352 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.699965 26571 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:43.701051 26029 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.656190 26627 raft_consensus.cc:740] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:43.704644 26658 log.cc:927] Time spent T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.134s	user 0.005s	sys 0.000s
I20260709 13:08:43.704813 26627 consensus_queue.cc:260] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.705972 26627 raft_consensus.cc:3060] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.706702 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1397) took 1341 ms. Trace:
I20260709 13:08:43.707072 21807 rpcz_store.cc:276] 0709 13:08:42.364926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.457845 (+ 92919us) service_pool.cc:224] Handling call
0709 13:08:43.354001 (+896156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.360240 (+  6239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.360269 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.360707 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.381314 (+ 20607us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:43.381973 (+   659us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.382370 (+   397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.382444 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.383379 (+   935us) raft_consensus.cc:1685] finished
0709 13:08:43.383397 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.706531 (+323134us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400477550. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:43.706645 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5862,"prepare.queue_time_us":151,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6730,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":2186,"spinlock_wait_cycles":1996998912,"thread_start_us":15634,"threads_started":1,"wal-append.queue_time_us":16201}
I20260709 13:08:43.667658 26636 raft_consensus.cc:740] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:43.710916 26636 consensus_queue.cc:260] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.711879 26636 raft_consensus.cc:3060] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.714429 21142 raft_consensus.cc:1240] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.716617 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 3004) took 1660 ms. Trace:
I20260709 13:08:43.716972 21219 rpcz_store.cc:276] 0709 13:08:42.055961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.056207 (+   246us) service_pool.cc:224] Handling call
0709 13:08:42.056581 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.521417 (+464836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.716402 (+1194985us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540039add4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.716565 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067209472}
I20260709 13:08:43.720281 26600 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:43.721522 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.721611 26600 consensus_queue.cc:1059] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:43.722596 26600 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:43.722918 26600 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.727422 21225 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:43.727804 21225 pending_rounds.cc:85] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 9
I20260709 13:08:43.728066 21225 pending_rounds.cc:107] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:43.728340 21225 raft_consensus.cc:2889] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.730484 26625 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.675371 26456 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.670037 21223 rpcz_store.cc:276] 0709 13:08:42.540986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.543055 (+  2069us) service_pool.cc:224] Handling call
0709 13:08:43.579666 (+1036611us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b58000d3898. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:08:43.579861 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.580079 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:43.580414 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.660914 (+ 80500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.660964 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:43.661009 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.661073 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.661170 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3723,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":93,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":10988544,"thread_start_us":80135,"threads_started":1,"wal-append.queue_time_us":80440}
I20260709 13:08:43.679447 26549 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:43.732550 26549 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.736536 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.739763 21225 raft_consensus.cc:2368] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13.
I20260709 13:08:43.739987 21222 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.741386 21219 raft_consensus.cc:1240] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.742690 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:43.744482 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.745491 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.745510 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.746930 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.748071 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.747548 21221 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:43.756130 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.756875 21142 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:43.762463 21219 raft_consensus.cc:1240] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:43.769829 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:43.781451 21264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.781633 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.783003 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.784806 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.785413 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.785542 21808 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:43.786633 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.798751 21114 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.752485 26626 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.752558 26456 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.803563 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1859) took 1733 ms. Trace:
I20260709 13:08:43.754168 26029 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.811146 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.812209 21292 raft_consensus.cc:1240] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:43.812124 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.815781 21218 rpcz_store.cc:276] 0709 13:08:42.070354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.085498 (+ 15144us) service_pool.cc:224] Handling call
0709 13:08:42.089353 (+  3855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.535738 (+1446385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.803314 (+267576us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002382d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.803507 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3311667968}
I20260709 13:08:43.826182 21298 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 15: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:43.813079 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:43.813653 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.813776 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:43.818542 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.828723 21221 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:43.819443 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:43.823523 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:43.826884 21294 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:43.830722 21219 raft_consensus.cc:2368] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12.
I20260709 13:08:43.673452 26614 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.833222 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:43.834237 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.835141 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.843745 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:43.844018 21148 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.844545 21807 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:43.840687 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.846508 21264 leader_election.cc:400] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:43.846916 21264 leader_election.cc:403] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.848426 21810 raft_consensus.cc:2393] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:43.774372 26309 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:43.853539 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54913.7us
I20260709 13:08:43.855158 21114 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.855532 21226 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.845674 21115 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:43.840212 26410 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:43.868399 21297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2553) took 1605 ms. Trace:
I20260709 13:08:43.868862 21297 rpcz_store.cc:276] 0709 13:08:42.263345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.265100 (+  1755us) service_pool.cc:224] Handling call
0709 13:08:42.272090 (+  6990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.450962 (+178872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.450993 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.451034 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:42.451061 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.868119 (+1417058us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540022d3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.868177 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.868333 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410912128}
I20260709 13:08:43.762946 26454 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:08:43.754498 26515 consensus_queue.cc:1059] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:08:43.851871 26162 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.863986 21115 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:43.851137 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:43.856598 26626 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13.
I20260709 13:08:43.858827 26615 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:43.871865 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.782711 26578 consensus_queue.cc:1059] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:08:43.805812 26339 consensus_queue.cc:1059] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:08:43.866248 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.884994 21115 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:43.867767 26598 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.840250 26595 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:43.848274 26628 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:08:43.894683 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.882994 26162 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.898805 26645 raft_consensus.cc:3055] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:43.899333 26536 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.900126 26578 raft_consensus.cc:3055] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:43.903317 26598 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:43.910354 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 3016) took 1367 ms. Trace:
I20260709 13:08:43.942813 21217 rpcz_store.cc:276] 0709 13:08:42.542436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.625455 (+ 83019us) service_pool.cc:224] Handling call
0709 13:08:42.625852 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.114302 (+488450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.910112 (+795810us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540038cf54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:43.910283 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112398720}
I20260709 13:08:43.874275 26415 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:43.920632 26515 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.920909 26632 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.921056 26609 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:43.932946 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 48041.7us
I20260709 13:08:43.833781 26600 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.860038 26309 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:43.936048 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.938226 21148 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:43.939358 26508 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.948581 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.950991 21142 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.949506 21151 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:43.954741 26162 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:43.945639 26598 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.951568 26508 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.956840 26508 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:43.960422 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.968202 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.934108 26645 raft_consensus.cc:740] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.969452 26645 consensus_queue.cc:260] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:43.969947 21217 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:43.970661 26645 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.971522 26625 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:43.973560 26614 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:43.974057 26549 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.940344 26633 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.977269 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.981302 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:43.983075 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:43.984411 21226 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.939994 26578 raft_consensus.cc:740] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.947053 26609 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:43.989849 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:44.005630 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:43.984860 26641 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.984970 26536 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.948040 26515 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.081944 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.055742 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:43.980293 26633 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.988911 26600 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.003497 26626 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.097652 26410 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:43.987639 26056 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:44.095330 26160 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:44.107125 26056 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.107822 26160 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.108619 26160 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.109221 26056 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.110051 26160 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.106609 26410 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.011714 26571 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.115978 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:44.116814 21145 raft_consensus.cc:2393] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 15: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.114868 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.000197 26454 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:08:44.118854 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:44.120590 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:44.120954 21145 raft_consensus.cc:3060] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.120040 21150 raft_consensus.cc:2393] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.048974 26625 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:44.130052 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.130318 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.144706 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.145449 21147 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:44.135221 21148 raft_consensus.cc:1275] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:44.135462 21145 raft_consensus.cc:2468] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
W20260709 13:08:44.152086 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.152418 21150 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:44.116237 26571 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:44.116833 26410 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.160249 26410 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.163177 26598 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.112628 26578 consensus_queue.cc:260] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:44.159456 26696 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:44.168630 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.169798 21150 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 16: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.175083 21145 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:44.175601 21145 pending_rounds.cc:85] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 10
I20260709 13:08:44.175855 21145 pending_rounds.cc:107] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:44.176120 21145 raft_consensus.cc:2889] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:44.183522 26695 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:08:44.149417 26625 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.109238 26508 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:44.196115 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.196802 26508 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.198251 21807 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:44.199808 21811 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:44.102164 26609 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.201360 26615 raft_consensus.cc:3055] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:44.201824 26615 raft_consensus.cc:740] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.204289 21151 raft_consensus.cc:2393] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.207650 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:44.208441 21811 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:44.212855 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.210718 21145 raft_consensus.cc:1275] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:44.217192 21813 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:44.191118 26625 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:44.248279 21778 leader_election.cc:400] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:44.251235 21778 leader_election.cc:403] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.202736 26615 consensus_queue.cc:260] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.263528 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.265301 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.269192 21814 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:44.274137 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:44.280869 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:44.229483 26508 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:08:44.283208 21224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.017s
I20260709 13:08:44.283237 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:44.284605 21807 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:44.301481 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:44.302222 21808 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.302062 21812 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 8.
I20260709 13:08:44.304952 21294 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:44.297866 26582 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.306654 26582 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.285014 21811 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:44.228644 26597 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:44.308668 26582 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:44.260435 26571 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.277854 26549 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:44.279476 26162 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:44.292328 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 426830us
I20260709 13:08:44.290181 21814 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:44.288159 21189 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:44.287014 26615 raft_consensus.cc:3060] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.298465 21809 raft_consensus.cc:1240] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:44.300547 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:44.311371 21224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.001s	sys 0.018s
I20260709 13:08:44.313638 21294 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:44.314725 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.326663 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.326814 21298 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:44.315989 21300 raft_consensus.cc:1275] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:44.316169 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.316342 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.281433 26598 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.289294 26616 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:44.328127 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.339013 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.331668 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.333981 21114 leader_election.cc:400] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13.
I20260709 13:08:44.356083 21114 leader_election.cc:403] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:08:44.355736 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 356335us
I20260709 13:08:44.356451 21808 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:44.355607 21294 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:44.330196 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.358409 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.359151 21151 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:44.323616 26454 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:44.346909 26549 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.360368 21145 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 14: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.360576 26454 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.361191 26628 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13.
I20260709 13:08:44.362856 26454 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:44.367245 26626 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.367648 26626 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:44.368363 26626 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.369483 26626 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.370544 21294 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
W20260709 13:08:44.375065 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 44128.9us
I20260709 13:08:44.376194 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.376267 21142 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:44.333606 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:44.343930 26456 consensus_meta.cc:287] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.006s
I20260709 13:08:44.311036 26515 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.384442 21811 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:44.330034 26571 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.378679 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:44.379976 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:44.381436 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 47920.2us
W20260709 13:08:44.381693 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 51337.8us
I20260709 13:08:44.393842 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.342084 26575 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.329170 25922 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.328984 26309 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:44.386888 21298 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.329337 26604 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.393850 21114 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.394309 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.389024 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.343909 26636 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:44.332741 26612 consensus_queue.cc:1059] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:08:44.406724 21298 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:44.410190 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:44.346549 26455 consensus_queue.cc:1059] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:44.385185 26546 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.385190 26456 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.398797 26703 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.401626 21297 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:44.359877 21149 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:08:44.408675 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.416442 25564 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.389408 26515 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:44.411334 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.416865 25564 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:44.293119 26639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.019s
I20260709 13:08:44.417373 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.419620 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.420174 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.422883 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:44.420372 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.408054 26625 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:44.423364 25564 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.425925 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.421985 21294 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:44.411034 26433 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.430960 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.423804 26544 consensus_queue.cc:1048] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:08:44.433025 26627 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.428303 26546 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.436138 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.415704 25922 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:44.424701 26639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.011s	sys 0.020s
I20260709 13:08:44.444360 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.423990 26626 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.448704 21114 leader_election.cc:400] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12.
I20260709 13:08:44.451747 21114 leader_election.cc:403] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.452912 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.422328 26714 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.416414 26549 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:44.451635 26636 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:44.459794 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.460667 21291 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:44.462121 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:44.462929 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:44.463781 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:44.467682 21224 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.468086 21223 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:44.449819 26627 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.447588 26546 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:44.454805 26612 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:44.475271 26706 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:44.481338 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.475968 26309 raft_consensus.cc:3055] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.495476 26309 raft_consensus.cc:740] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:44.496402 26309 consensus_queue.cc:260] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.497650 26309 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.466149 26515 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:44.501766 26515 consensus_queue.cc:1243] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer 3585d99c303e453c8c3762b294caba4e log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:44.502866 21292 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:44.457307 26604 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:08:44.503769 21300 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:44.456712 26704 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12.
I20260709 13:08:44.477133 26546 raft_consensus.cc:3060] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.457769 26616 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:44.459985 26582 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:08:44.480168 26708 log.cc:927] Time spent T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:44.489051 26544 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:44.516661 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 72350.4us
I20260709 13:08:44.441744 26625 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.477648 26612 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:44.505453 21300 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:44.505559 25564 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.507272 21297 raft_consensus.cc:2468] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:08:44.478216 25922 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:44.526358 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 65010.5us
W20260709 13:08:44.512830 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 95527us
I20260709 13:08:44.527086 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:44.489504 26627 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.530606 26720 consensus_queue.cc:1048] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:44.531551 26549 consensus_queue.cc:1048] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:44.531584 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.537580 26549 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.540452 25922 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.540779 21115 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:44.524217 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 94937.8us
I20260709 13:08:44.544112 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.548187 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.522166 26639 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.571640 25922 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.515043 26433 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:08:44.574481 25922 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.541489 26612 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.578876 25922 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.579504 25922 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.582024 25922 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:44.584004 26717 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:44.584455 26717 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.584806 26717 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.585062 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.585718 21294 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:44.586517 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.588544 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:44.589570 21143 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:44.517418 26725 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.551901 26415 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:44.555704 26625 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:44.587004 21294 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:44.598263 21778 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:44.599820 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.600447 21144 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:44.602638 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:44.592227 21224 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:44.588469 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.595407 26639 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.624724 21809 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:44.630389 26309 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:44.604898 26544 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.617035 26339 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.594561 26604 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:44.642131 26578 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.648284 21298 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.649796 26455 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.624935 26710 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:44.625504 26415 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.654752 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:44.654981 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:44.637552 26544 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.631134 26309 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:44.598944 26725 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.639230 26339 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.653064 26455 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.669821 26612 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.670616 26546 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.663636 26544 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.671751 26455 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.766438 26546 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:44.717291 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.723757 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 178619us
I20260709 13:08:44.726544 21217 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:44.726867 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 182729us
I20260709 13:08:44.731240 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:44.739377 21298 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.665987 26339 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.764891 26415 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.673028 26612 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:44.662398 26710 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.765358 26508 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:44.793296 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:44.794468 26710 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:44.712574 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:44.796491 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 84502.1us
I20260709 13:08:44.798254 21294 raft_consensus.cc:1240] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:44.798715 21293 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:44.794387 26582 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.679677 26717 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:44.787611 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.800213 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.800292 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.761948 26309 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.801250 26703 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:44.809875 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 53041.7us
I20260709 13:08:44.813802 21294 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:44.819728 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.816099 21189 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:44.819759 26730 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.848342 21151 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 14: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
W20260709 13:08:44.849941 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 50986.9us
I20260709 13:08:44.852828 25922 consensus_queue.cc:1059] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:44.853572 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.814977 26717 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.864658 21813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52758 (request call id 1220) took 1083 ms. Trace:
I20260709 13:08:44.865119 21813 rpcz_store.cc:276] 0709 13:08:43.781330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.781425 (+    95us) service_pool.cc:224] Handling call
0709 13:08:44.864275 (+1082850us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400359dd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:44.864456 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947439488}
W20260709 13:08:44.844960 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 114103us
I20260709 13:08:44.871724 26747 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:44.872239 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:44.873728 25564 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:44.815222 26056 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:08:44.876156 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60374.1us
I20260709 13:08:44.858008 21190 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:44.858839 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 47985us
I20260709 13:08:44.882441 26710 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.877490 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.906669 26609 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.880214 26582 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.908187 21813 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:44.909214 21264 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:44.910290 26626 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.922241 26582 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:44.925851 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:44.893077 26717 raft_consensus.cc:2764] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:44.930827 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:44.932289 26056 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:44.932984 26056 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:44.935931 26339 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.937575 26704 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.938120 26704 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:44.938642 26339 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:44.939842 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 291073us
I20260709 13:08:44.942826 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:44.942873 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:44.944100 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48357.7us
I20260709 13:08:44.944125 21217 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.945628 25564 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:44.946055 25564 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.946059 21149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2397) took 1142 ms. Trace:
I20260709 13:08:44.946385 25564 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.946693 21149 rpcz_store.cc:276] 0709 13:08:43.803687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.803827 (+   140us) service_pool.cc:224] Handling call
0709 13:08:44.945694 (+1141867us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540017d754. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:44.945875 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712118016}
I20260709 13:08:44.934407 26056 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.953186 26743 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:44.954094 26743 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:44.955873 26616 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:44.956367 26616 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:44.957741 26616 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.958777 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:44.959568 21291 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:44.950829 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 93013.7us
I20260709 13:08:44.967278 26160 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.969197 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:44.970933 21151 raft_consensus.cc:2393] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 16: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:44.971306 26704 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:44.972805 26595 consensus_queue.cc:1175] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c5246dc52bb49f38aef22aba1467452" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 14 index: 8 } }
I20260709 13:08:44.973963 26743 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:44.972995 26704 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.980697 21191 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:44.982657 26162 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:44.983224 26162 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:44.984349 26162 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:44.982885 26717 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:08:44.986183 26732 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.311s	user 0.003s	sys 0.000s
I20260709 13:08:44.971930 21146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1933) took 1198 ms. Trace:
W20260709 13:08:44.988220 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 110990us
I20260709 13:08:45.005965 25564 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.013319 21291 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:45.016366 26538 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.988538 21146 rpcz_store.cc:276] 0709 13:08:43.774693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.774945 (+   252us) service_pool.cc:224] Handling call
0709 13:08:43.775343 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.775741 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:43.923840 (+148099us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b1800398bc0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8a455 00007f2b717723c7 00007f2b6dd849a7 00007f2b6dd940bf 00007f2b6dd94038
0709 13:08:44.412020 (+488180us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.821031 (+409011us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.955785 (+134754us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.956006 (+   221us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:44.956047 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.956150 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.962988 (+  6838us) raft_consensus.cc:1685] finished
0709 13:08:44.971556 (+  8568us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.971707 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13329,"prepare.queue_time_us":672720,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":72120,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":28081,"spinlock_wait_cycles":18653056,"thread_start_us":831390,"threads_started":3,"wal-append.queue_time_us":225607}
I20260709 13:08:45.019860 21189 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:44.971923 26616 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.024663 26544 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.027289 25564 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.027959 21191 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:45.029196 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:45.029474 26538 raft_consensus.cc:2804] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.030040 26725 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.030122 26538 raft_consensus.cc:697] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.031334 26723 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:45.031777 26571 raft_consensus.cc:3055] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:45.031867 26723 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:45.032284 26571 raft_consensus.cc:740] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:45.032451 26723 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.033064 21295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 3046) took 1210 ms. Trace:
I20260709 13:08:45.033476 21295 rpcz_store.cc:276] 0709 13:08:43.822882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.827661 (+  4779us) service_pool.cc:224] Handling call
0709 13:08:43.827943 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.862490 (+ 34547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.862522 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.862952 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.096959 (+234007us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b180038aac0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:08:44.411730 (+314771us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:44.411771 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.032514 (+620743us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b540018bfd4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:45.032584 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.032642 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:45.032655 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.032867 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7814,"raft.queue_time_us":86,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11330,"spinlock_wait_cycles":87379456,"thread_start_us":314565,"threads_started":1,"wal-append.queue_time_us":636768}
W20260709 13:08:45.035282 21293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 3038) took 1224 ms (client timeout 1623 ms). Trace:
W20260709 13:08:45.035683 21293 rpcz_store.cc:269] 0709 13:08:43.811140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.813503 (+  2363us) service_pool.cc:224] Handling call
0709 13:08:45.035009 (+1221506us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540018c4d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:45.035190 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717173632}
I20260709 13:08:45.035976 25922 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.036697 25922 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:45.037572 21115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.039887 21299 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:45.040295 21294 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:45.042207 26710 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:45.042754 26710 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.046020 26595 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.048008 26730 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.036706 26598 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.049738 26598 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.046566 26595 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.053838 26595 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.046754 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:45.058647 21300 raft_consensus.cc:2468] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:45.060833 21217 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:45.038990 25922 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:45.067685 26639 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.068291 26598 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.072028 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.065167 21116 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:45.078691 21293 raft_consensus.cc:2410] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:45.060303 26339 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:45.097461 21298 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:45.060753 26595 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:45.033492 26571 consensus_queue.cc:260] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.119865 26571 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.111979 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:45.123764 26724 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.114423 26636 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:45.117949 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 71356.6us
I20260709 13:08:45.124564 26724 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.130215 26617 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.130725 26617 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.131759 26617 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.136111 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:45.136850 21293 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.055222 26538 consensus_queue.cc:237] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.143391 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.142161 26636 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:45.150707 26636 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.154695 26627 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.158300 26544 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.161700 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.141191 26724 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.185451 21217 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:45.200941 21778 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:45.218022 21297 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:08:45.218674 21297 pending_rounds.cc:85] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 11
I20260709 13:08:45.218969 21297 pending_rounds.cc:107] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:45.219324 21297 raft_consensus.cc:2889] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.164258 26162 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:08:45.226475 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:45.234561 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:45.235494 26578 consensus_meta.cc:287] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.581s	user 0.015s	sys 0.000s
I20260709 13:08:45.235859 26410 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.236411 26410 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.236898 26410 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.240360 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:45.241626 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 139115us
I20260709 13:08:45.244719 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.246620 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.247509 21219 raft_consensus.cc:1240] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:45.249107 21263 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.249334 26612 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:45.249668 21218 raft_consensus.cc:1275] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:45.250090 26612 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.250929 21221 raft_consensus.cc:2410] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:45.251479 26546 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.251835 26578 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.252017 26546 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:45.253155 26546 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.256227 26162 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:45.256965 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.259022 26575 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:45.222573 26747 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:45.262209 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:45.264690 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.265704 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 85502.9us
I20260709 13:08:45.273545 21220 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:45.290521 26515 consensus_queue.cc:1059] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:45.290968 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.291718 26626 consensus_queue.cc:1048] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:45.293267 26626 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.293286 26713 raft_consensus.cc:3055] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.294528 26713 raft_consensus.cc:740] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:08:45.295766 26749 log.cc:927] Time spent T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:08:45.295495 26713 consensus_queue.cc:260] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.296773 26713 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.302839 26747 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:45.303532 25922 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:45.304164 25922 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.305027 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:45.305725 21151 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.306270 21143 raft_consensus.cc:1240] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:45.307405 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:45.308126 21143 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:45.308708 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:45.310230 26720 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:45.310840 26720 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.311805 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:45.313124 26720 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.313879 25922 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:45.314847 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.315009 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.269493 26544 raft_consensus.cc:2804] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:45.324143 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.322690 21293 raft_consensus.cc:2468] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:45.332513 21298 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:45.332921 21146 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:45.333364 21778 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:45.256937 26162 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.333330 21146 pending_rounds.cc:85] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 10
I20260709 13:08:45.341408 21146 pending_rounds.cc:107] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:45.341711 21146 raft_consensus.cc:2889] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.274673 26595 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:08:45.349220 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.336073 26544 raft_consensus.cc:697] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:45.395056 26612 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.396446 26544 consensus_queue.cc:237] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:45.400938 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 98960.8us
I20260709 13:08:45.356745 26725 raft_consensus.cc:2804] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:45.354368 26720 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:45.402148 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 76269.9us
I20260709 13:08:45.405036 21189 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:45.400566 26710 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.401752 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:45.419344 21151 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:45.425734 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:45.403007 26725 raft_consensus.cc:697] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:45.432776 26162 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.433408 26763 consensus_queue.cc:1059] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:08:45.434880 21189 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:45.422458 26598 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:45.435456 26616 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.435709 26598 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.436218 26616 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.436982 26616 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:45.402568 26765 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:45.438163 26598 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.437839 26765 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.440148 26765 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.441628 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.441946 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.442840 21808 raft_consensus.cc:2410] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:45.443698 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.444413 21223 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:45.450942 21291 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:45.403878 26720 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.457458 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.467756 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:45.461936 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.445179 26639 consensus_queue.cc:1059] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:45.457026 26616 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.428597 26723 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.479385 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:45.479923 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.481786 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:45.484809 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:45.486150 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.487864 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.488514 21807 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:45.490078 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.490463 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:45.491194 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.492640 21810 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:45.480330 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:45.491104 21809 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.515746 21295 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:45.520154 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.521394 25564 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.521921 25564 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.523207 26455 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.523826 25564 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.524595 26743 raft_consensus.cc:3055] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:45.525002 26743 raft_consensus.cc:740] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.527419 26725 consensus_queue.cc:237] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.509768 26757 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:45.528601 26757 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.528965 26757 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.531670 21813 raft_consensus.cc:1275] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:45.541059 26723 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.542274 26710 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:45.543283 26162 raft_consensus.cc:3055] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:45.543764 26162 raft_consensus.cc:740] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.544612 26720 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.544937 26162 consensus_queue.cc:260] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.545722 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.546554 26162 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.508911 26410 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.292616 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:45.550999 21045 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 377) took 19593 ms (client timeout 15000 ms). Trace:
I20260709 13:08:45.558418 21812 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 16. Ops: []
I20260709 13:08:45.558856 21806 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:45.510890 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:45.508117 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:45.495908 25922 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.559443 21049 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:45.560258 26766 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:45.561163 26616 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:45.585577 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 77579.3us
I20260709 13:08:45.573325 26612 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:45.605090 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 170268us
I20260709 13:08:45.606307 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:45.595772 25922 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.617626 26309 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:45.606662 26415 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.625314 21291 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:45.621263 25922 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.587374 26575 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:45.649015 26625 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.649575 26625 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.650791 21811 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:45.651561 21295 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:45.672011 21297 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:45.632275 21049 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 6 to 12, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.683555 21808 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:45.686851 21049 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.676679 26410 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.694828 26625 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:45.703820 21806 raft_consensus.cc:1275] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:45.708505 26710 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.709095 26710 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.711647 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:45.712296 26710 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.712757 21148 raft_consensus.cc:2393] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 14: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:45.711723 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:45.737695 21049 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 10 to 12, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:08:45.739851 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.747426 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:45.756594 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.775705 26625 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:45.776489 26625 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:45.776996 26625 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:45.554214 21045 rpcz_store.cc:269] 0709 13:08:25.957810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.958092 (+   282us) service_pool.cc:224] Handling call
0709 13:08:45.550758 (+19592666us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:38.006592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:38.195866 (+189274us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:38.195944 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:08:38.195974 (+    30us) tablet.cc:662] Decoding operations
0709 13:08:38.198156 (+  2182us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:38.198322 (+   166us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:38.198367 (+    45us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:38.732820 (+534453us) tablet.cc:701] Row locks acquired
0709 13:08:38.775984 (+ 43164us) write_op.cc:260] PREPARE: finished
0709 13:08:38.817794 (+ 41810us) write_op.cc:270] Start()
0709 13:08:38.879980 (+ 62186us) write_op.cc:276] Timestamp: P: 1783602518789099 usec, L: 0
0709 13:08:38.890080 (+ 10100us) op_driver.cc:348] REPLICATION: starting
0709 13:08:39.052695 (+162615us) log.cc:844] Serialized 6651 byte log entry
0709 13:08:39.502967 (+450272us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6ac700ac 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b
0709 13:08:41.185020 (+1682053us) op_driver.cc:464] REPLICATION: finished
0709 13:08:41.647551 (+462531us) write_op.cc:301] APPLY: starting
0709 13:08:41.647658 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:41.662938 (+ 15280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:41.662977 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:41.680367 (+ 17390us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:41.680855 (+   488us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:08:41.680941 (+    86us) write_op.cc:312] APPLY: finished
0709 13:08:41.681586 (+   645us) log.cc:844] Serialized 156 byte log entry
0709 13:08:41.711396 (+ 29810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.739983 (+ 28587us) write_op.cc:454] Released schema lock
0709 13:08:41.810663 (+ 70680us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.977313 (+166650us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.987809 (+ 10496us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":463601,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":454800,"apply.run_cpu_time_us":23083,"apply.run_wall_time_us":239186,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":397555,"prepare.run_cpu_time_us":22212,"prepare.run_wall_time_us":1658821,"raft.queue_time_us":708195,"raft.run_cpu_time_us":49035,"raft.run_wall_time_us":384956,"replication_time_us":2250563,"spinlock_wait_cycles":27900800,"thread_start_us":1493230,"threads_started":4,"wal-append.queue_time_us":602704,"wal-append.run_cpu_time_us":85090,"wal-append.run_wall_time_us":2892549}]]}
I20260709 13:08:45.775729 21225 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:45.784953 21146 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:45.788033 21806 raft_consensus.cc:1240] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.788967 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:45.791000 21218 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.796380 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:45.797529 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:45.798522 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:45.798902 26776 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:45.800910 26773 log.cc:927] Time spent T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.381s	user 0.005s	sys 0.000s
I20260709 13:08:45.784684 26627 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:45.797614 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 50307.6us
I20260709 13:08:45.800789 21149 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:45.805696 21809 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 9.
I20260709 13:08:45.806908 21049 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 6 to 7, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.821869 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.825013 26056 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.851395 26056 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:45.851922 26056 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.854049 26056 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:45.815079 26757 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.858639 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.857637 26757 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:45.861099 26433 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:45.861784 26743 consensus_queue.cc:260] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.862926 26743 raft_consensus.cc:3060] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:45.863507 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.866629 21807 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:45.823832 26627 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:45.871428 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 45786.4us
I20260709 13:08:45.882543 26515 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.883244 26515 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.887877 26515 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:45.892395 26636 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.892937 26636 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.893218 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:45.893963 26730 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.894357 26730 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:45.897156 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:45.903857 21146 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:45.904369 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:45.912554 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.904729 26162 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.916503 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.917152 21291 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:45.919399 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.880097 26757 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:45.922307 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 63772.6us
I20260709 13:08:45.924361 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.929430 26617 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.929612 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:45.895205 26730 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.930401 21217 raft_consensus.cc:2393] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:45.930761 26730 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.932238 26410 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.932782 26410 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:45.934927 26410 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:45.935480 26777 consensus_queue.cc:1175] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3585d99c303e453c8c3762b294caba4e" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 14 index: 8 } }
W20260709 13:08:45.935920 26778 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:45.905052 26433 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:45.937418 26774 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:45.925457 26612 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:08:45.943768 26775 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:08:45.944064 26604 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:45.922664 26162 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.937129 26731 consensus_queue.cc:1048] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:45.924062 26636 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:45.959554 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 59649.4us
I20260709 13:08:45.967033 21218 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
W20260709 13:08:45.975750 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 51501.5us
I20260709 13:08:45.979507 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.975922 21778 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:45.983206 21295 raft_consensus.cc:1240] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:45.983644 26515 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:45.984548 21296 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.984323 26515 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:45.980363 26598 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:45.984751 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:45.987777 21297 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:08:45.981769 26612 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:45.996414 26757 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.996701 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:45.997202 26546 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:45.997617 26546 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.997967 26546 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.999363 26162 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.000730 21225 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:46.002207 26578 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.002581 26578 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:46.002929 26578 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.005184 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:45.999588 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.011191 26731 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.012509 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.013113 21217 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:46.013341 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:46.017460 21224 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
W20260709 13:08:46.025733 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46342.4us
I20260709 13:08:46.026844 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:46.034512 25564 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.034961 25564 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.035343 25564 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.032855 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.037556 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.064059 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.020277 26309 consensus_queue.cc:1059] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:08:46.028460 26595 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.069591 21291 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:46.071353 26761 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:46.065800 26415 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:08:46.072995 26595 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.074340 26309 raft_consensus.cc:3055] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.074729 26309 raft_consensus.cc:740] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:46.075729 26309 consensus_queue.cc:260] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.077222 26309 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.065755 21146 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:46.067211 21148 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:46.011612 26433 consensus_queue.cc:1048] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:46.080956 21221 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:46.097450 21263 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:46.032752 26725 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.100387 21298 raft_consensus.cc:1275] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:46.103493 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.024741 26639 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:46.114615 26782 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:08:46.098217 26636 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.116204 26723 consensus_queue.cc:1048] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:46.119602 26786 log.cc:927] Time spent T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:46.092016 26538 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:46.127451 26714 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.127974 26714 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.128382 26714 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.131596 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.106918 21049 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 7 to 10, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 10 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:46.091413 26595 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.147035 21296 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:46.122519 26625 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.148700 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.135411 26609 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.165339 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.149554 26639 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:46.175170 25564 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.178256 21809 raft_consensus.cc:1240] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:46.185608 26600 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:46.188992 26600 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.195863 26515 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:46.197664 26627 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:46.202140 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 135174us
I20260709 13:08:46.202029 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.209352 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.167171 26609 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:46.211211 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.185598 26544 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:46.217828 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.218935 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.219187 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:46.219570 21146 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:46.223402 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:46.223646 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:46.223938 26757 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.224406 26757 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.225145 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.226017 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:46.226411 26757 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.226758 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.227308 21150 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:46.227384 21808 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:46.208039 26627 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.240068 26410 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.227409 26725 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:46.244539 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.245590 21222 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:46.215240 26609 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.262961 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.263707 21812 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:46.275398 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.278497 26636 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.279033 26636 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.280126 26625 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:46.288378 26785 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
I20260709 13:08:46.298458 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.306934 21300 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:46.310177 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82893.8us
I20260709 13:08:46.228578 26546 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.236928 26415 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:08:46.322947 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.323593 21300 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:46.309674 26515 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.270081 26627 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.336091 26757 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:46.337392 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:46.349395 21811 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.339949 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.341351 26639 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.351904 21814 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:46.311467 26714 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.381234 21146 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:46.363109 21116 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.318702 26578 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.347761 26789 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.391286 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.404599 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.398046 26582 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:46.398648 26515 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.385505 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.401774 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.411183 21142 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.411677 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.396615 26623 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:46.415077 21810 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:46.387634 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:46.400630 26339 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.422196 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.402940 26789 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:46.427235 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.416843 26455 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.416746 26544 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.417239 26410 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.433601 26625 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.432368 26789 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.425486 26515 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.457754 26757 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.460848 26546 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.468245 26410 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.463429 26710 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:46.471417 26455 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:46.498091 26790 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:08:46.506268 26801 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:08:46.506147 26740 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:46.494848 26410 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:46.512015 26808 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:08:46.490778 26625 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.516184 26740 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.562479 21149 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:46.500145 26710 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:46.564340 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 125634us
I20260709 13:08:46.513949 26805 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.523921 26627 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.524768 26636 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.567619 26730 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:46.598089 21811 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:46.591517 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:46.563496 26639 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.661916 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:46.662130 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.662613 21811 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.663205 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:46.663538 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:46.665453 26792 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.666009 26792 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:46.666577 26814 log.cc:927] Time spent T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 13:08:46.667338 21115 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:46.668337 26792 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.668939 26792 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:46.669144 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48783us
I20260709 13:08:46.669507 26792 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.670805 26787 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.672914 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.666299 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:46.674383 21147 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:46.596235 26809 log.cc:927] Time spent T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:46.564533 26740 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.677217 21810 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:46.603423 26798 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.219s	user 0.000s	sys 0.003s
I20260709 13:08:46.683043 21813 raft_consensus.cc:1240] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:08:46.596957 26806 log.cc:927] Time spent T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:08:46.588373 26714 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.613775 26578 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:46.690685 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 99269.7us
I20260709 13:08:46.608537 26515 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.696318 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:46.608862 26600 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.702478 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.703274 21809 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 16: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:46.696935 21218 raft_consensus.cc:2368] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:46.698395 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.699800 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:46.688126 26807 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:08:46.706550 21217 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:46.706590 21223 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
W20260709 13:08:46.708050 26821 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:46.707983 26625 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:46.708467 26803 log.cc:927] Time spent T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.297s	user 0.000s	sys 0.004s
I20260709 13:08:46.649757 26609 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.710639 26636 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.723121 21224 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:46.733078 21224 pending_rounds.cc:85] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 9
I20260709 13:08:46.733330 21224 pending_rounds.cc:107] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:46.733704 21224 raft_consensus.cc:2889] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.719211 21811 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:46.725841 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.693039 26765 raft_consensus.cc:3055] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:46.692535 26713 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:46.739866 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 323319us
I20260709 13:08:46.740542 21142 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:46.677193 26787 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:46.745163 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 357560us
I20260709 13:08:46.742415 21299 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:46.746485 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:46.747068 21143 raft_consensus.cc:3060] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.721462 26710 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:46.594663 26455 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.753012 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.749789 21776 leader_election.cc:400] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
W20260709 13:08:46.754925 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 86593.6us
I20260709 13:08:46.754225 21776 leader_election.cc:403] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.690683 26639 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.758363 21223 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:46.758595 26632 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.758867 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:46.759498 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.741691 26765 raft_consensus.cc:740] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:46.720407 26789 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.762962 21297 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:46.747665 26515 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:46.755074 26820 log.cc:927] Time spent T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:46.758311 21776 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:46.768111 26575 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.772190 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.772518 26575 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.772969 21144 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:46.772256 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:46.777160 26805 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:46.781769 21145 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:46.781912 21219 raft_consensus.cc:2393] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:46.778626 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.760402 26625 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:46.781963 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.784142 21809 raft_consensus.cc:2368] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16.
I20260709 13:08:46.783926 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.785362 26824 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:46.787511 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:46.788092 21808 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:46.788697 26787 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:46.788806 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:46.760676 26792 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.795724 25564 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.791874 21264 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:46.794205 21147 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:46.797569 26827 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.801223 26827 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.802254 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:46.798556 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:46.768581 26515 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:46.812738 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:46.813472 21147 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:46.814935 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.815572 21293 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:46.782421 26819 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.817555 21264 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.814642 26515 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.820124 26639 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:46.815716 21776 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:46.834952 25564 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:46.835532 25564 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:46.821964 26792 raft_consensus.cc:2804] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:46.825953 21300 raft_consensus.cc:1275] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:46.907816 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 90319.9us
I20260709 13:08:46.826689 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:46.908761 21293 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.908972 21264 leader_election.cc:400] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16.
I20260709 13:08:46.797868 26710 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.908645 21143 raft_consensus.cc:2468] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:46.795431 26713 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.917559 25564 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:46.923236 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 94648.1us
I20260709 13:08:46.829437 26730 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:08:46.918022 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 148280us
I20260709 13:08:46.832180 26819 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.928321 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:46.936232 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:46.939915 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 140752us
I20260709 13:08:46.943536 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.924690 26600 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:46.924331 26792 raft_consensus.cc:697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:46.836972 26743 consensus_queue.cc:1059] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:08:46.938477 26819 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.941607 26822 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.943732 26805 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.928915 26713 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.948117 26600 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.933082 26740 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:46.962548 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:46.968518 26639 raft_consensus.cc:3055] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:46.949343 26625 consensus_queue.cc:1048] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:46.969547 26792 consensus_queue.cc:237] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.970861 26789 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.929172 26710 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.947377 26765 consensus_queue.cc:260] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.977931 26575 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:46.979077 21293 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:46.938042 26410 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.010162 21292 raft_consensus.cc:1275] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:08:47.014729 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 90316.6us
I20260709 13:08:46.998227 26600 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.011234 26747 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:47.017195 26747 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:46.997542 26825 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:47.012790 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:47.000190 26639 raft_consensus.cc:740] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:47.029708 21294 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:47.032196 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:47.039192 21805 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:47.019232 26747 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.013545 26546 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:47.046985 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:46.986845 26822 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.059906 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.060608 21217 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.051821 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:47.067014 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:47.014366 26612 consensus_queue.cc:1059] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:47.080809 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:47.044936 26546 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.081905 21220 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:47.088276 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.091013 21143 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.088816 21150 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:47.095528 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.096254 21150 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:47.071974 26827 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.101692 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:47.085270 26813 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:47.083679 26720 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:47.035354 26825 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.091658 25922 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:47.124377 21189 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:47.089952 26546 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.056344 26824 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:08:47.120504 26789 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:47.135975 26730 consensus_queue.cc:1059] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.137600 26849 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:47.139101 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:47.149013 25564 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:08:47.154565 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 87652.1us
I20260709 13:08:47.125547 26813 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:47.155789 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:47.146245 25922 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.131181 26720 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.162173 26837 raft_consensus.cc:3055] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:47.162837 26837 raft_consensus.cc:740] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:47.163725 25922 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.163879 26837 consensus_queue.cc:260] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.165508 26837 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.162230 21217 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:47.170950 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:47.172335 26056 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:47.158926 26789 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:47.174363 26789 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.176110 26740 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.177482 26720 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:47.168991 26819 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.160796 26813 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:47.179821 26836 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:08:47.179932 26819 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.180768 26713 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:47.181699 26794 log.cc:927] Time spent T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.921s	user 0.000s	sys 0.015s
I20260709 13:08:47.158008 26595 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:47.183538 26595 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.184021 26595 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.184304 26710 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.183553 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:47.185246 26410 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.186785 26822 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:47.146549 26849 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.187417 26849 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.195573 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.187620 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:47.188971 26844 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:47.196871 21294 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.189836 26813 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.199839 21150 raft_consensus.cc:2368] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:47.201048 26825 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.204362 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:47.204938 21291 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.206189 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:47.208267 21294 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:47.210870 21151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2421) took 1335 ms. Trace:
I20260709 13:08:47.125717 26639 consensus_queue.cc:260] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.211552 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:47.213798 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.212347 21294 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:47.220183 26849 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.222167 26849 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.225172 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 3074) took 1090 ms. Trace:
I20260709 13:08:47.211280 21151 rpcz_store.cc:276] 0709 13:08:45.875582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.875722 (+   140us) service_pool.cc:224] Handling call
0709 13:08:45.881946 (+  6224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:45.909476 (+ 27530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.909506 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.916230 (+  6724us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.149343 (+233113us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:46.149386 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.149454 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.097424 (+947970us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:47.205840 (+108416us) raft_consensus.cc:1685] finished
0709 13:08:47.205861 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.210809 (+  4948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26668,"raft.queue_time_us":30292,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2966,"spinlock_wait_cycles":10816768,"thread_start_us":197091,"threads_started":1,"wal-append.queue_time_us":314646}
I20260709 13:08:47.233309 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.236481 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.237116 21151 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:47.240028 21263 leader_election.cc:400] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:47.240999 21263 leader_election.cc:403] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.243052 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 17.
I20260709 13:08:47.239967 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:47.209409 26813 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:47.225574 21299 rpcz_store.cc:276] 0709 13:08:46.134866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.143203 (+  8337us) service_pool.cc:224] Handling call
0709 13:08:47.224994 (+1081791us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540001b654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:47.225104 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351903616}
I20260709 13:08:47.211863 26639 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.248711 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:47.250525 26710 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.194934 26515 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:47.253376 21192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.254133 21114 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:47.242102 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:47.276301 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:47.277163 21217 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:47.278836 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:47.279479 21807 raft_consensus.cc:3060] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.280391 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:47.294046 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:47.294402 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52352.6us
I20260709 13:08:47.295017 21217 raft_consensus.cc:2368] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:47.250835 26600 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.304466 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.305239 21224 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.301975 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:47.306934 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 182627us
I20260709 13:08:47.307816 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:47.273422 26720 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.311298 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:47.274116 26849 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:47.290462 26730 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.318948 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.319597 21222 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.321620 21776 leader_election.cc:400] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:47.322072 21776 leader_election.cc:403] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.323154 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:47.309693 26834 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:47.311429 26822 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.325999 21293 raft_consensus.cc:1240] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.339936 26824 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.326797 26725 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.308353 26546 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.320382 26720 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:47.336840 26834 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:47.332479 26822 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.364708 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 52153.7us
I20260709 13:08:47.321527 26849 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.324285 26730 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.368324 26575 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.373974 26845 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.213s	user 0.001s	sys 0.003s
I20260709 13:08:47.363143 26822 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.411520 26841 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:47.411985 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:47.412837 21293 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:47.385094 26600 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.434090 21222 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 17.
I20260709 13:08:47.435148 21149 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:47.468532 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:47.472123 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.472862 21222 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 16. Current term is 17.
I20260709 13:08:47.408223 26730 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.472143 21811 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:47.412014 26841 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.478869 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:47.403669 26757 consensus_queue.cc:1048] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:08:47.483486 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:47.483812 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:47.484093 21809 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.484280 26849 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.486287 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:47.415504 26575 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.505487 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:47.537597 26858 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:47.539557 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.540375 21222 raft_consensus.cc:2393] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:47.481472 26841 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:47.543875 26855 log.cc:927] Time spent T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:08:47.554996 26834 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.490836 26866 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:47.558876 26866 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.559613 26515 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.561084 26866 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.566435 26546 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.487004 26720 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.573603 21220 raft_consensus.cc:2410] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:47.583374 21809 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:47.621665 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:47.569833 21807 raft_consensus.cc:2468] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:47.625707 25564 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:47.627162 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:47.629828 21805 raft_consensus.cc:2368] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15.
I20260709 13:08:47.621178 26544 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.634776 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.635483 21222 raft_consensus.cc:3060] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.640206 21263 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 16. Current term is 17.
I20260709 13:08:47.640625 21263 leader_election.cc:403] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:08:47.642182 21189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.642817 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 150037us
I20260709 13:08:47.644623 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:47.629700 21226 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
W20260709 13:08:47.642748 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 159711us
I20260709 13:08:47.662106 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:47.665875 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:47.648218 26714 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 16. Current term is 17.
I20260709 13:08:47.675103 21806 raft_consensus.cc:2368] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16.
I20260709 13:08:47.675941 21190 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:47.683533 21190 leader_election.cc:400] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15.
I20260709 13:08:47.683947 21190 leader_election.cc:403] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:47.684744 21190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.684753 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.688640 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:47.689239 21151 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:47.690304 21222 raft_consensus.cc:2468] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:47.661605 26515 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.694165 21224 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:47.679497 26813 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:47.695230 21116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.145.3:44115 timed out after 1.760s (SENT) [suppressed 4 similar messages]
I20260709 13:08:47.648761 26544 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.706931 21219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1904) took 1084 ms. Trace:
I20260709 13:08:47.709586 21219 rpcz_store.cc:276] 0709 13:08:46.619457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.623117 (+  3660us) service_pool.cc:224] Handling call
0709 13:08:47.703582 (+1080465us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002391d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:47.703753 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266858752}
I20260709 13:08:47.692333 26804 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:47.697379 26764 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15.
I20260709 13:08:47.735354 26763 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.761418 26763 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:47.762063 26869 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:47.710680 26813 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.717725 26804 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.795784 26865 raft_consensus.cc:2804] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:47.796654 26854 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:47.797286 26871 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:47.797200 26854 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.798028 26871 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.802311 26871 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.805281 26763 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.808393 26865 raft_consensus.cc:697] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:47.834777 26575 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:47.842787 26865 consensus_queue.cc:237] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.848950 26704 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:47.849531 26704 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.851394 26546 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.857244 26546 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:47.857744 26704 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.856384 26822 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:47.863248 26822 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:47.853181 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:47.866933 21805 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.850757 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:47.867610 21808 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:47.861593 26813 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.852602 21813 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:47.864563 26804 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:47.865586 26544 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:47.866274 26710 consensus_meta.cc:287] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.007s
I20260709 13:08:47.868688 21221 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
W20260709 13:08:47.886907 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 150820us
I20260709 13:08:47.887909 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:47.891741 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 196520us
I20260709 13:08:47.868489 26546 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:47.885244 26595 consensus_meta.cc:287] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.004s
I20260709 13:08:47.885748 26710 raft_consensus.cc:2749] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
W20260709 13:08:47.922312 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 221200us
I20260709 13:08:47.925535 26595 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:48.006016 26842 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.035s	sys 0.049s
W20260709 13:08:48.013233 26842 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.035s	sys 0.049s
W20260709 13:08:48.026867 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 136509us
I20260709 13:08:48.028403 26841 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.038407 26544 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.038980 26544 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.040194 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:48.041020 26704 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:48.041404 26704 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.041769 26704 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.041872 26544 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.043825 26841 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.031097 21805 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 16.
I20260709 13:08:48.031819 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.044632 21808 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:48.044821 26544 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.032873 26805 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.045364 26544 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.045603 26805 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.047647 26544 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:48.047739 26805 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.033170 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1458) took 1643 ms. Trace:
I20260709 13:08:48.048517 21143 raft_consensus.cc:2368] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:48.049537 26595 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.049619 26704 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.050254 26575 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:48.050732 26575 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.051292 26575 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.054383 26704 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.058101 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.058887 21300 raft_consensus.cc:2368] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15.
I20260709 13:08:48.059640 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.060063 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.060292 21805 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:48.035223 21298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 3082) took 1284 ms. Trace:
I20260709 13:08:48.037158 21263 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.048422 21812 rpcz_store.cc:276] 0709 13:08:46.389910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.400747 (+ 10837us) service_pool.cc:224] Handling call
0709 13:08:46.414913 (+ 14166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.439442 (+ 24529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.439489 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.684245 (+244756us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b1800472de0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac5b2a6 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a
0709 13:08:47.631951 (+947706us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b2c0004cf78. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:47.683025 (+ 51074us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.791441 (+108416us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:47.791495 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.791582 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.032899 (+241317us) raft_consensus.cc:1685] finished
0709 13:08:48.032924 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.033084 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2357,"raft.queue_time_us":10501,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6235,"spinlock_wait_cycles":49512704,"thread_start_us":96423,"threads_started":1,"wal-append.queue_time_us":338158}
I20260709 13:08:48.033751 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.066192 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.063637 21298 rpcz_store.cc:276] 0709 13:08:46.750678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.751711 (+  1033us) service_pool.cc:224] Handling call
0709 13:08:46.752082 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.761008 (+  8926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.761037 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.237154 (+476117us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c0006e2e8. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6c673a11 00007f2b6c683372 00007f2b6ddb5a01 00007f2b6dd7a43a 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2
0709 13:08:47.237643 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.339693 (+102050us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:47.339746 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.034888 (+695142us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b540022d3d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:48.034950 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.034995 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:48.035013 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.035153 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":326,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4227,"spinlock_wait_cycles":22843008,"thread_start_us":101653,"threads_started":1,"wal-append.queue_time_us":180807}
I20260709 13:08:48.067485 21116 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.075585 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.079840 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.080646 21297 raft_consensus.cc:2393] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 16: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:48.058651 26609 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:48.073972 26515 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.083474 21116 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:48.085896 21116 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:48.073233 26824 raft_consensus.cc:2804] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.074187 26704 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.089054 21191 leader_election.cc:400] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 14. Current term is 15.
I20260709 13:08:48.090989 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.078341 26854 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.098770 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:48.098955 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.087018 26582 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.090034 26882 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.086578 26604 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.107136 26455 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:48.107596 26455 raft_consensus.cc:493] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.107964 26455 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.090608 26515 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:48.095723 26632 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.113787 26632 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.112636 26882 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.115893 26632 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.116653 26882 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.102138 26538 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.119117 26538 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.121260 26538 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.125515 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.126031 21807 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:08:48.097921 26824 raft_consensus.cc:697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:48.126957 21190 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.132438 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.133652 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.134600 26865 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.156522 26865 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.157406 26765 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:48.158648 26865 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.150815 21812 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:48.138845 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.139530 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:48.165356 26847 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 1.004s	user 0.000s	sys 0.012s
I20260709 13:08:48.166594 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:48.167523 26824 consensus_queue.cc:237] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.168253 26600 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.168846 26600 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:48.169744 26600 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:48.140991 26835 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 1.125s	user 0.002s	sys 0.013s
I20260709 13:08:48.141764 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:48.142784 26704 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.106129 26730 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.144030 26632 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.146284 26515 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.146669 26575 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.147956 21292 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:48.148602 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.148713 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.150843 21300 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:48.160478 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.143643 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.172370 21145 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.175756 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.113261 26717 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:48.109478 26582 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:48.197160 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 86429.2us
I20260709 13:08:48.201568 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.173542 26538 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:48.202294 21146 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:48.216811 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.220932 21808 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 17: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:48.219165 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:48.219165 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:48.214612 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 69733.5us
I20260709 13:08:48.222373 21807 raft_consensus.cc:2393] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 12: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:48.125066 26604 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:48.196561 26792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.001s	sys 0.023s
I20260709 13:08:48.229781 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.230628 21151 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:48.234997 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.196995 26717 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.215039 26623 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.246135 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.221902 26538 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.223228 21148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:48.248008 21148 raft_consensus.cc:606] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:48.236941 26792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.001s	sys 0.024s
I20260709 13:08:48.248575 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 922) took 1454 ms. Trace:
I20260709 13:08:48.252789 21145 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:48.229422 26857 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.254930 26866 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:48.254107 21218 rpcz_store.cc:276] 0709 13:08:46.791794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.791910 (+   116us) service_pool.cc:224] Handling call
0709 13:08:46.813918 (+ 22008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.826604 (+ 12686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.826634 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.827045 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.918572 (+ 91527us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:46.918612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.918678 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.140338 (+1221660us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:48.234411 (+ 94073us) raft_consensus.cc:1685] finished
0709 13:08:48.234442 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.245662 (+ 11220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12353,"raft.queue_time_us":13403,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":34964864,"thread_start_us":91153,"threads_started":1,"wal-append.queue_time_us":170451}
I20260709 13:08:48.264400 26575 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.265935 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:48.246541 26717 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.267956 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:48.266054 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.273738 21221 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.190739 26704 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.267558 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.248715 26538 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.195920 26632 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.283638 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.269976 26866 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.290796 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:48.291746 21221 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:48.248610 26623 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.299410 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:48.300060 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:48.302891 21149 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.303049 21221 raft_consensus.cc:2368] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:48.278258 26864 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.300530 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.305437 21263 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.307497 21189 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.292047 26866 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.272284 26857 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.432194 21114 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:48.441954 21149 raft_consensus.cc:2468] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
W20260709 13:08:48.495575 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 63444.8us
I20260709 13:08:48.496038 26857 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.496686 26162 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.497270 26162 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.499925 26598 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.501245 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:48.423884 26743 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:48.430027 26713 raft_consensus.cc:2804] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.423550 26848 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:48.527741 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.538312 26604 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.288549 26582 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:48.509481 26892 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:08:48.548797 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.508919 26893 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.546366 26851 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:48.568078 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 344133us
I20260709 13:08:48.546926 26743 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:48.548054 26162 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.586988 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:48.588075 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.590492 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.591320 21296 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:48.592401 21293 raft_consensus.cc:2393] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 15: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
W20260709 13:08:48.565362 26789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.388s	user 0.025s	sys 0.019s
I20260709 13:08:48.567022 26864 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.625550 25564 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.626096 25564 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.627888 25564 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:48.628325 26861 log.cc:927] Time spent T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.985s	user 0.007s	sys 0.016s
I20260709 13:08:48.628626 26595 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.629299 26595 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.630139 26717 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.631973 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 1165) took 1498 ms. Trace:
I20260709 13:08:48.632385 21294 rpcz_store.cc:276] 0709 13:08:47.133935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.216563 (+ 82628us) service_pool.cc:224] Handling call
0709 13:08:47.216844 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.218628 (+  1784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.218657 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.219048 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.317628 (+ 98580us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:47.317675 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.317763 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.627772 (+1310009us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:48.631647 (+  3875us) raft_consensus.cc:1685] finished
0709 13:08:48.631674 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.631912 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1246,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":8970112,"thread_start_us":98190,"threads_started":1,"wal-append.queue_time_us":263255}
I20260709 13:08:48.606532 26609 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.628338 25564 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.659572 25564 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.657531 21143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39282 (request call id 1040) took 1462 ms. Trace:
W20260709 13:08:48.622017 26890 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:08:48.609592 26889 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.667536 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:48.660729 21143 rpcz_store.cc:276] 0709 13:08:47.195161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.195319 (+   158us) service_pool.cc:224] Handling call
0709 13:08:48.657297 (+1461978us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54000ac654. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:48.657454 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959980800}
I20260709 13:08:48.566365 26893 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.605553 26455 raft_consensus.cc:515] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.690773 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.691557 21142 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:48.692229 25564 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:48.660563 26789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.483s	user 0.025s	sys 0.019s
I20260709 13:08:48.590013 26851 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.688864 21146 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:48.669446 26632 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.700974 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.704559 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.705313 21221 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:48.710278 26455 leader_election.cc:290] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.710202 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.711243 21224 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:48.712423 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:48.715780 26894 log.cc:927] Time spent T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:48.718096 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.718673 21147 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:48.724139 26889 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.726311 21150 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:48.730338 21189 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.731503 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.731648 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.732604 26854 raft_consensus.cc:2804] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.733124 26854 raft_consensus.cc:697] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:48.733995 26854 consensus_queue.cc:237] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.734555 26866 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.737643 26866 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.761404 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:48.762223 21150 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.779354 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.780504 21145 raft_consensus.cc:2410] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:48.779567 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.781775 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.647687 26864 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.684458 26891 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.687669 26704 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.790835 21297 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:48.670347 26609 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.805048 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.809309 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:48.810487 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.813625 21806 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:48.814610 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.742574 26623 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.815217 26825 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:08:48.776412 26595 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.778193 26789 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.828248 21218 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:48.788764 26731 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.739939 26805 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:08:48.807827 26598 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 16 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:48.825683 26575 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.742314 26743 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.829671 26612 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.843703 26714 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.811728 26891 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.874955 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.870551 26901 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.860864 26713 raft_consensus.cc:697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:48.845480 26789 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.884672 26717 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.878749 26612 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.867486 26575 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.848062 26731 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.892259 26623 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:48.905169 21146 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:48.910792 26893 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.885818 26714 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.902529 26515 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:48.916064 26598 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.921422 26864 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:48.925143 26851 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.927489 26515 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.928210 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:48.930097 26515 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.930771 26731 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:48.933697 26899 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:48.895498 26901 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:48.912185 26889 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:48.922956 21150 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:48.937521 26792 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:48.944157 26895 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:08:48.957175 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:48.959741 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:48.963020 21293 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:48.949015 26902 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.989830 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.992022 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:48.992822 21294 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.990530 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:48.958699 26546 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.951764 26904 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:48.958480 26710 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:48.962767 26714 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:48.982962 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 255947us
I20260709 13:08:48.982991 26789 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:49.009788 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 195598us
I20260709 13:08:49.014904 21263 leader_election.cc:400] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14.
I20260709 13:08:49.018868 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:48.988193 26625 raft_consensus.cc:493] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:48.960101 26792 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:48.948457 26713 consensus_queue.cc:237] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.042752 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.023741 21776 leader_election.cc:400] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:48.996826 26902 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.054626 21294 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:49.031677 21264 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:49.044521 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:49.252787 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:49.259918 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.260756 21294 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:49.262126 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.284538 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:08:49.352839 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 68419.7us
I20260709 13:08:49.352875 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.353456 21292 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:49.354486 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.367342 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:49.370332 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:49.371111 21805 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:49.374702 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:49.009234 26885 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.257s
W20260709 13:08:49.380697 21189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.017s	sys 0.009s
I20260709 13:08:49.381351 21221 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:49.389371 21189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.017s	sys 0.010s
W20260709 13:08:49.389708 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 602575us
I20260709 13:08:49.383518 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:49.026124 25922 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.394755 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:49.402089 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:49.399219 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.007824 26546 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.020211 26898 consensus_queue.cc:1059] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.360s
I20260709 13:08:49.408463 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.428339 21145 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:49.429098 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 397511us
W20260709 13:08:49.388170 21147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.024s
I20260709 13:08:49.408267 21225 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:49.438122 21221 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:49.016634 26710 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.253014 26612 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:49.371325 26854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.073s	sys 0.179s
W20260709 13:08:49.441846 21147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.024s
W20260709 13:08:49.446221 21296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.020s
I20260709 13:08:49.448546 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.452344 21218 raft_consensus.cc:2368] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:49.367689 26639 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.452797 21296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.020s
I20260709 13:08:49.368112 26859 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.012356 26904 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.457409 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.571357 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:49.569942 21148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.051s	sys 0.102s
W20260709 13:08:49.573534 21148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.051s	sys 0.102s
I20260709 13:08:49.571918 21189 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:49.253470 26789 consensus_queue.cc:1059] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.193s
W20260709 13:08:49.576126 26765 consensus_meta.cc:287] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.418s	user 0.012s	sys 0.002s
I20260709 13:08:49.577265 21217 raft_consensus.cc:2410] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:49.578474 21221 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:49.579540 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.527370 26600 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:49.044544 26625 raft_consensus.cc:515] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.367839 26866 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:49.590297 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.408229 26914 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.455971 26854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.073s	sys 0.180s
I20260709 13:08:49.407934 26604 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:49.582707 26598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.013s	sys 0.050s
I20260709 13:08:49.595818 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.582978 26575 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.581116 26777 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.631282 26864 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:49.631098 26600 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:49.644595 26598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.014s	sys 0.050s
W20260709 13:08:49.661439 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 257853us
W20260709 13:08:49.650635 26903 log.cc:927] Time spent T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.655s	user 0.001s	sys 0.000s
I20260709 13:08:49.571275 26639 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.645251 26901 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.700578 26546 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.647722 26604 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.702316 21218 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:49.670256 26902 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.642709 26914 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.712541 26914 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.665088 26864 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:49.714108 26604 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.713981 26864 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.715325 26515 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:49.715835 26515 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.639367 26866 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.673326 26600 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.658624 26851 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.722623 26851 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.723869 26866 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.724635 26851 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.678627 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:49.725214 26538 consensus_meta.cc:287] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 1.441s	user 0.012s	sys 0.001s
I20260709 13:08:49.725591 26538 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.726034 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.726747 21220 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 18: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:49.727052 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.728077 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.728996 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.680553 26904 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:49.680713 26625 leader_election.cc:290] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.683910 26639 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.654611 26777 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.686575 26710 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:49.691718 26917 log.cc:927] Time spent T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:49.692823 26792 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:49.638512 26919 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:08:49.706225 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 3102) took 1120 ms. Trace:
W20260709 13:08:49.708673 21299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.001s	sys 0.001s
I20260709 13:08:49.709605 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.644631 26612 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:49.719838 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.743554 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.780521 21296 rpcz_store.cc:276] 0709 13:08:48.586133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.595137 (+  9004us) service_pool.cc:224] Handling call
0709 13:08:48.604492 (+  9355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.604781 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:48.896840 (+292059us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.640719 (+743879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.640959 (+   240us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:49.641342 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.646548 (+  5206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.706144 (+ 59596us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":417880,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":184802,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6561,"thread_start_us":1000652,"threads_started":3,"wal-append.queue_time_us":769343}
W20260709 13:08:49.750598 21146 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.000s	sys 0.009s
I20260709 13:08:49.764976 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:49.793548 21146 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.000s	sys 0.009s
W20260709 13:08:49.769013 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 105602us
W20260709 13:08:49.781908 21299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.001s	sys 0.002s
I20260709 13:08:49.795321 21190 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:49.797444 21223 raft_consensus.cc:2368] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:49.798627 21190 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
W20260709 13:08:49.799708 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 755251us
I20260709 13:08:49.753592 26851 raft_consensus.cc:493] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:49.802929 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:49.800453 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:49.820123 21145 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.820271 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.819093 26909 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:49.831284 21142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40476 (request call id 2447) took 1693 ms (client timeout 1781 ms). Trace:
W20260709 13:08:49.822564 21777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.003s
I20260709 13:08:49.786012 26933 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:49.823977 26824 raft_consensus.cc:3055] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:49.779618 26936 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:49.803125 25922 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:49.825103 21223 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:49.824903 26851 raft_consensus.cc:515] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.819479 26841 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.825335 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.798030 26765 raft_consensus.cc:493] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
W20260709 13:08:49.835373 21777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.006s	sys 0.003s
W20260709 13:08:49.831730 21142 rpcz_store.cc:269] 0709 13:08:48.137560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.138568 (+  1008us) service_pool.cc:224] Handling call
0709 13:08:49.831112 (+1692544us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540026a2d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:49.831213 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222948224}
I20260709 13:08:49.842172 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:49.819299 26866 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:49.827744 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 386728us
I20260709 13:08:49.881619 26866 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.882146 26866 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:49.798772 26538 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.881068 26934 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:49.883385 26918 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:49.883733 26934 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.883940 26918 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.830361 26515 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.886160 21264 leader_election.cc:400] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16.
I20260709 13:08:49.837558 26933 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:49.837539 26824 raft_consensus.cc:740] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:49.892271 21263 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:49.895850 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 78156.8us
I20260709 13:08:49.896822 21147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2461) took 1155 ms. Trace:
I20260709 13:08:49.898154 21223 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:49.851060 26805 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:49.841285 26546 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:49.899151 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.907754 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.918059 21300 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:49.919267 21778 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:49.923854 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:49.925452 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:49.931011 21145 raft_consensus.cc:2468] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 18.
W20260709 13:08:49.935698 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 93600us
I20260709 13:08:49.931715 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:49.861968 26919 consensus_queue.cc:1059] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:08:49.907197 26933 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.894603 26936 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.940755 21189 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:49.893755 26792 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:49.948591 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:49.893802 26864 raft_consensus.cc:493] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:49.900269 26934 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.908162 26805 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.955359 21776 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:49.937614 26914 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:49.892180 26765 raft_consensus.cc:515] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:49.969871 21779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.031s	sys 0.095s
I20260709 13:08:49.955710 26841 raft_consensus.cc:2804] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:49.955422 26625 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.937238 26600 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:49.963941 26805 raft_consensus.cc:3060] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.993992 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc62cd1660e437688d81540b9af858b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.994676 21145 raft_consensus.cc:2468] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:49.995625 25922 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:49.996189 25922 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.998302 25922 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:49.928851 26546 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.999430 26918 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.000856 26546 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.001381 26546 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:50.002007 26546 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.002426 26546 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:49.975947 26934 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.004431 26934 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.004848 26934 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.967193 26941 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.007606 26941 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.007941 26941 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.008497 25564 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.011114 26789 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.011646 26789 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:50.012655 26789 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:50.014011 26945 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:49.958797 26864 raft_consensus.cc:515] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.015960 21189 leader_election.cc:304] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:50.016543 26864 leader_election.cc:290] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:49.970748 26940 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:50.017273 26851 leader_election.cc:290] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.018077 26841 raft_consensus.cc:697] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:49.957974 26792 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.021564 26792 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.021685 26881 raft_consensus.cc:2764] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:50.022028 26777 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:50.023797 21220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 933) took 1316 ms (client timeout 1699 ms). Trace:
I20260709 13:08:49.998800 25922 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.013888 26789 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.025085 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.018935 26841 consensus_queue.cc:237] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.027405 26609 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:49.968681 26824 consensus_queue.cc:260] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.030678 26824 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.024499 25922 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:50.032207 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.032545 25922 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.032631 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 2663) took 1028 ms. Trace:
I20260709 13:08:50.033056 21293 rpcz_store.cc:276] 0709 13:08:49.004547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.004956 (+   409us) service_pool.cc:224] Handling call
0709 13:08:49.005240 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.356534 (+351294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.356579 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.356644 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:49.356694 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.032418 (+675724us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54001608d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:50.032461 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.032577 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807405312}
I20260709 13:08:50.036165 26546 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.040459 26713 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.040939 26713 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:49.988654 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.042493 21224 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:50.045872 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:49.969055 26914 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.046412 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.048750 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.052613 21151 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
W20260709 13:08:50.024247 21220 rpcz_store.cc:269] 0709 13:08:48.707544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.707713 (+   169us) service_pool.cc:224] Handling call
0709 13:08:50.023593 (+1315880us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002387d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:50.023732 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330653568}
I20260709 13:08:50.060870 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:50.071667 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.073748 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.059792 26914 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.076435 26934 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.060231 26595 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:50.087811 26926 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.311s	user 0.003s	sys 0.000s
I20260709 13:08:50.072608 26857 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:50.088425 26857 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.088868 26857 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:49.957475 26936 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.131534 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:50.134529 21810 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:50.133734 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 168617us
I20260709 13:08:50.136499 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:49.897251 21147 rpcz_store.cc:276] 0709 13:08:48.740963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.741072 (+   109us) service_pool.cc:224] Handling call
0709 13:08:48.785728 (+ 44656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.785913 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:49.452047 (+666134us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.896241 (+444194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.896315 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:49.896377 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.896572 (+   195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.896752 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":885212,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":213,"thread_start_us":1109211,"threads_started":2}
I20260709 13:08:50.022591 26805 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.144520 26789 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:50.145934 26911 consensus_queue.cc:1059] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.146687 26911 consensus_queue.cc:1243] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer f81bf1abd0b34f518d1f2b79cc4dba77 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:50.155175 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:50.155511 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.152555 21263 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:50.156159 21808 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 10.
I20260709 13:08:50.135866 26625 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.158704 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.158996 21812 raft_consensus.cc:1275] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:50.162132 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.162724 21808 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:50.164731 26625 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.166877 26625 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.167009 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.168241 26933 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.168664 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.087867 26595 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.170532 26933 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.169418 21149 raft_consensus.cc:2393] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 17: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:50.171563 26595 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.169965 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.172427 21143 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:50.172502 26805 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.147190 26911 raft_consensus.cc:3055] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:50.136458 26824 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.174407 21148 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:50.159956 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:50.176324 21114 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.177469 21814 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 18: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:50.181289 21807 raft_consensus.cc:606] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:50.181655 21807 raft_consensus.cc:614] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.181849 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.179248 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.186301 21114 leader_election.cc:400] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:50.195211 21114 leader_election.cc:403] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.195870 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.202354 21226 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:50.177829 26911 raft_consensus.cc:740] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:50.153972 26941 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:50.214258 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.185149 26415 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.184728 26625 raft_consensus.cc:493] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.224836 26625 raft_consensus.cc:515] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.226958 26625 leader_election.cc:290] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.227190 26891 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.227344 26933 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.236121 26933 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.238773 26933 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.239622 26415 raft_consensus.cc:2749] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:50.185191 26824 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.240688 26936 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.242105 26765 leader_election.cc:290] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.242398 26713 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.242839 26824 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.231204 21293 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 17: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:50.228157 26904 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:50.228276 26955 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:50.192557 26956 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.247952 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.248481 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.248976 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.227933 26911 consensus_queue.cc:260] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.186113 26914 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.249616 21810 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:08:50.233016 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:50.255988 21298 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.198019 26598 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:08:50.233271 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:50.256567 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 287502us
I20260709 13:08:50.233407 26805 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.252374 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:50.261170 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 219438us
I20260709 13:08:50.262014 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:50.230911 26941 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.228448 26625 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:50.259451 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.265662 25922 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.267297 25922 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.267665 25922 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.256433 26956 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.269985 26546 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:50.270980 26956 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.273332 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.265512 26805 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.229470 26866 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.290588 25922 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.297699 21115 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:50.300318 21298 raft_consensus.cc:2468] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:50.303372 21778 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:50.306572 21810 raft_consensus.cc:1275] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:50.307761 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.309811 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.310092 25922 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.311874 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.274945 26595 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.276073 26598 raft_consensus.cc:493] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.319257 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.319639 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.298676 26792 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:50.255267 26955 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.322198 21813 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:50.325212 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.320798 21808 raft_consensus.cc:1240] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 17. Ops: []
I20260709 13:08:50.276321 26625 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.329562 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.310902 26936 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.318923 26919 raft_consensus.cc:493] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:50.345736 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.347625 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.348711 21808 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:50.348591 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.319003 26818 raft_consensus.cc:2804] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:50.353466 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.354115 21148 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 9.
I20260709 13:08:50.354502 21811 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:50.332340 26889 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.356882 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.357287 21150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35748 (request call id 1979) took 1388 ms. Trace:
W20260709 13:08:50.358758 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 172793us
I20260709 13:08:50.359288 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.323186 26595 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.359941 21808 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 9.
I20260709 13:08:50.360046 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.358283 21150 rpcz_store.cc:276] 0709 13:08:48.968787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.968937 (+   150us) service_pool.cc:224] Handling call
0709 13:08:48.969188 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.390422 (+421234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.390461 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.390499 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:49.390528 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.357016 (+966488us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400065c54. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:50.357076 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.357221 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968364416}
I20260709 13:08:50.361210 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.358764 26818 raft_consensus.cc:697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:50.355549 26857 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.325177 26598 raft_consensus.cc:515] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.351214 26936 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.350466 26919 raft_consensus.cc:515] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.394752 21298 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:50.382174 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.362955 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:50.365574 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:50.423487 21150 raft_consensus.cc:2393] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 18: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:50.423784 21224 raft_consensus.cc:2368] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:50.398672 21292 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:50.426231 21263 leader_election.cc:400] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:50.396286 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.426793 21263 leader_election.cc:403] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.377879 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.362280 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:50.405030 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.396745 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.428009 21808 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
W20260709 13:08:50.428958 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 60232.2us
I20260709 13:08:50.370739 21114 leader_election.cc:400] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:50.431294 21114 leader_election.cc:403] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.427213 21300 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
W20260709 13:08:50.444410 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73809.5us
I20260709 13:08:50.451967 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67929a23f7cc4a9a8f64f854df93b149" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.452379 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.452986 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.453079 21808 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:50.453697 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:50.402033 26901 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:50.461212 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.470819 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.381415 26914 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:50.461730 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 164105us
I20260709 13:08:50.371851 26805 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.471901 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.472314 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.475337 21808 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 10.
I20260709 13:08:50.437397 26765 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.374298 26955 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.483884 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:50.484576 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.486464 21808 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 17: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:50.452337 26889 raft_consensus.cc:3060] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.443694 26866 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.492278 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.501614 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.489396 26976 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:50.461011 26965 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:50.488152 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.490398 26824 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.496876 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:50.497931 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 120441us
I20260709 13:08:50.470948 26901 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:50.520325 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.522255 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:50.523458 26963 log.cc:927] Time spent T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:08:50.524205 26962 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:08:50.525229 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.538004 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 1189) took 1493 ms. Trace:
I20260709 13:08:50.538093 21814 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:50.525563 26598 leader_election.cc:290] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.525892 26919 leader_election.cc:290] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.526453 26625 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.477155 26710 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.534447 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.536530 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.546381 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.500432 26857 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.496325 26907 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.545182 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.498972 26936 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.547268 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:50.538610 21294 rpcz_store.cc:276] 0709 13:08:49.045119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.411645 (+366526us) service_pool.cc:224] Handling call
0709 13:08:49.412032 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.734667 (+322635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.734716 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.793211 (+ 58495us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.908681 (+115470us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:49.908819 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.527968 (+619149us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540022ced4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:50.528016 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.528062 (+    46us) raft_consensus.cc:1685] finished
0709 13:08:50.528075 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.537928 (+  9853us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4657,"spinlock_wait_cycles":701805952,"thread_start_us":58172,"threads_started":1,"wal-append.queue_time_us":154260}
I20260709 13:08:50.561493 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.497702 26960 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
W20260709 13:08:50.550997 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.488229 26909 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.565210 26960 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.565703 26909 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.496228 26713 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.567809 21814 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:50.568090 26713 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.570088 26713 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.555636 26841 raft_consensus.cc:493] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.572055 21300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:50.567616 26960 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.492224 26825 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:08:50.577746 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.529806 26904 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.574265 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.572795 21300 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:08:50.497834 26914 consensus_queue.cc:1048] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:50.547902 26415 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.491753 26765 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.578992 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.542956 26515 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.599552 21778 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:50.613355 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.571009 26841 raft_consensus.cc:515] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.555850 26710 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.583576 26789 consensus_queue.cc:1059] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:50.623685 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:50.614128 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.529677 26824 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.617141 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7b1fec990b4785a3b45b520909244c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.628701 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.567852 26909 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:50.596705 26966 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:50.622757 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.536099 26901 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.499501 26818 consensus_queue.cc:237] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.634047 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:50.575874 26907 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.637172 21190 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:50.646817 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:50.628516 26546 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:50.605698 26904 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.651232 26710 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.670377 21807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51204 (request call id 6) took 1636 ms. Trace:
I20260709 13:08:50.672865 21809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1591) took 1426 ms. Trace:
I20260709 13:08:50.673350 21809 rpcz_store.cc:276] 0709 13:08:49.246688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.249245 (+  2557us) service_pool.cc:224] Handling call
0709 13:08:50.672007 (+1422762us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d53fc0 00007f2b72d3e929 00007f2b72d3e3d2 00007f2b6c2b5bd4
0709 13:08:50.672258 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.672451 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.672487 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.672538 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:50.672580 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.672658 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.672777 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24774528}
I20260709 13:08:50.675952 26907 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.678396 26904 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:50.679884 26971 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:50.640204 26901 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.640204 26885 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:50.619408 26415 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:50.688273 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.661192 26841 leader_election.cc:290] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.662559 26765 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:50.696027 21114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 228073us
I20260709 13:08:50.632318 26595 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.656499 21299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 1175) took 2509 ms. Trace:
I20260709 13:08:50.670912 21807 rpcz_store.cc:276] 0709 13:08:49.246275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.264173 (+ 17898us) service_pool.cc:224] Handling call
0709 13:08:50.034497 (+770324us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800092798. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6ac55b71 00007f2b6ac55a22 00007f2b73b6ec09 00007f2b72cc8ee0 00007f2b72d920ab 00007f2b72d92131 00007f2b72d56c40 00007f2b72d42bb9 00007f2b72d4247c 00007f2b6c2c87d4
0709 13:08:50.670121 (+635624us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54006f0254. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd74853 00007f2b72d4260a 00007f2b6c2c87d4 00007f2b6c2c8762 00007f2b6c2c8691 00007f2b6c2c860c 00007f2b6c2c78c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:50.670260 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362580480}
I20260709 13:08:50.655130 26891 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:50.707562 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.655509 26920 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:50.665802 26824 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:50.717301 21263 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:50.667048 26546 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.723831 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:50.729001 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574f49e93265460891ff981be2cee774" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.738094 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.739142 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.729319 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.729524 21144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.730749 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.731949 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.697057 26885 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.698328 21299 rpcz_store.cc:276] 0709 13:08:48.146923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.147055 (+   132us) service_pool.cc:224] Handling call
0709 13:08:48.301599 (+154544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.306409 (+  4810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.306443 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.432154 (+125711us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.949156 (+517002us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:49.798525 (+849369us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.803303 (+  4778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.803389 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.031613 (+228224us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b1800332ec0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d522 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:50.651659 (+620046us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800332ec0. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac8d3f3 00007f2b6ac8f7c1 00007f2b6ac8f779 00007f2b6ac8f709 00007f2b6ac8f6d1 00007f2b6ac8e9cd 000000000038f354 000000000038f199 00007f2b6ac7083a
0709 13:08:50.656271 (+  4612us) raft_consensus.cc:1685] finished
0709 13:08:50.656291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.656424 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41985,"prepare.queue_time_us":296487,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":20077,"raft.queue_time_us":137889,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":7353,"spinlock_wait_cycles":72790144,"thread_start_us":1225116,"threads_started":2,"wal-append.queue_time_us":711634}
I20260709 13:08:50.742027 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.743341 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.744602 21150 raft_consensus.cc:1240] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:50.735460 26710 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.752920 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.754495 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc65b57b7ce480581c0933f52538838" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.761106 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.763103 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.768428 21809 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:50.711284 26920 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:08:50.771497 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 301499us
I20260709 13:08:50.736459 26919 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.739022 26546 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:50.776275 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.774848 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:50.737090 26891 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:50.752207 26885 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.787971 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.787135 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.760666 26824 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.793520 21808 raft_consensus.cc:1240] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:08:50.800601 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 153860us
I20260709 13:08:50.773144 26515 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.766500 26914 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.806583 21217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 937) took 1997 ms. Trace:
I20260709 13:08:50.807003 21263 leader_election.cc:304] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:50.808593 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:50.807137 21217 rpcz_store.cc:276] 0709 13:08:48.808965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.809085 (+   120us) service_pool.cc:224] Handling call
0709 13:08:50.802374 (+1993289us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000ed8d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:50.806513 (+  4139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761264384}
I20260709 13:08:50.780819 26609 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.811825 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.805539 21190 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:08:50.810528 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 336698us
I20260709 13:08:50.774392 26920 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.815481 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:50.816025 21808 raft_consensus.cc:2393] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:08:50.818809 21117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.821213 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:50.821734 21147 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.821766 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.822464 21223 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:50.822865 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.826136 26792 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.826588 26792 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.826800 26710 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.810891 26841 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.792655 26907 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.827706 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.828336 26765 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:50.828796 26765 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.829169 26765 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.829574 26965 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 for earlier term 14. Current term is 15.
I20260709 13:08:50.832527 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2308648f35c4faf94816331179c44aa" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.834244 26891 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.835593 21218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55554 (request call id 1933) took 1379 ms. Trace:
I20260709 13:08:50.835943 21218 rpcz_store.cc:276] 0709 13:08:49.456657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.456770 (+   113us) service_pool.cc:224] Handling call
0709 13:08:50.835430 (+1378660us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540038c554. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7e2fa 00007f2b72d3fb17 00007f2b6c2ba6d4 00007f2b6c2ba662 00007f2b6c2ba591 00007f2b6c2ba50c 00007f2b6c2b97c2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:50.835532 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169663872}
I20260709 13:08:50.837277 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.837975 21225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55550 (request call id 3087) took 1179 ms. Trace:
I20260709 13:08:50.838505 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.840082 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.793956 26713 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.803627 26904 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:50.851691 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.841614 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:50.843931 21116 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.828341 21805 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:50.838323 21225 rpcz_store.cc:276] 0709 13:08:49.658204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.658373 (+   169us) service_pool.cc:224] Handling call
0709 13:08:50.836711 (+1178338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.836877 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.836918 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.836964 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:50.836994 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.837058 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.837826 (+   768us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540038c550. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd798ad 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6 00007f2b6c0b426f
0709 13:08:50.837924 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709152512}
I20260709 13:08:50.854702 25922 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.792896 26824 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:50.861093 21147 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:50.849794 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:50.862958 21222 raft_consensus.cc:1240] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Rejecting Update request from peer 7c5246dc52bb49f38aef22aba1467452 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.871356 26975 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.876008 21225 pending_rounds.cc:85] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 8
I20260709 13:08:50.876413 21225 pending_rounds.cc:107] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:50.876685 21225 raft_consensus.cc:2889] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.784462 26919 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:50.884040 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 96132.5us
I20260709 13:08:50.844311 26710 raft_consensus.cc:2749] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.846019 26515 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.851691 26965 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.855624 26938 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.855762 26904 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:50.867652 26824 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.827741 26841 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:50.892212 26958 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:50.904119 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:50.895709 21116 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:50.913839 21149 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:50.917191 21116 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:50.924224 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:50.905803 26904 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.889573 26983 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:08:50.937160 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.939112 21220 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:50.941838 21291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57018 (request call id 1187) took 1910 ms. Trace:
I20260709 13:08:50.918602 26958 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:50.942216 21291 rpcz_store.cc:276] 0709 13:08:49.030973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.387114 (+356141us) service_pool.cc:224] Handling call
0709 13:08:49.439477 (+ 52363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.604268 (+164791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.604310 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.604360 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:49.604404 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.941633 (+1337229us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540018b0d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:50.941681 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.941789 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378469760}
W20260709 13:08:50.943979 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 94217.2us
I20260709 13:08:50.922930 26595 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:50.927368 26900 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.952360 26415 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:50.953547 26841 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:50.905582 26938 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:50.950942 21189 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:50.949865 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 138084us
I20260709 13:08:50.943367 26981 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.962550 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.943516 26616 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:50.945957 26958 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.978477 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:50.979925 26964 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:50.967986 26989 log.cc:927] Time spent T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:08:50.951113 26595 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:50.976302 26546 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:50.977460 26991 log.cc:927] Time spent T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:50.990391 26595 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.002517 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.003552 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.004084 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:50.965161 26891 raft_consensus.cc:2804] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.006655 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.005963 26889 raft_consensus.cc:2749] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757) with higher term. Message: Invalid argument: T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16.
I20260709 13:08:51.008672 21226 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:51.010484 21814 raft_consensus.cc:1240] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:51.009824 21143 raft_consensus.cc:1275] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:51.011629 26907 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:51.013619 26907 raft_consensus.cc:493] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:51.013965 26907 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.989313 26616 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.017323 26616 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.008082 26919 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:51.021781 26934 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:51.022538 26958 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.012523 26891 raft_consensus.cc:697] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:51.024237 26891 consensus_queue.cc:237] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.025189 21810 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:51.025275 26904 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.027832 27001 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.021808 26938 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:51.034706 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.036556 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:51.035040 26980 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:08:51.010119 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:51.043498 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.062934 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.063294 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.063611 21147 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:51.047523 26898 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:51.030710 26792 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:51.068024 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.980646 26981 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.073446 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.050913 26904 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.036067 26765 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.073650 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:51.082839 26792 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.110348 26792 raft_consensus.cc:3055] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:51.110720 26792 raft_consensus.cc:740] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:51.111593 26792 consensus_queue.cc:260] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.068617 26898 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:51.113056 26898 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.115036 26909 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:51.115495 26909 raft_consensus.cc:493] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.108553 26765 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.115854 26909 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.088361 26885 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.119460 26515 consensus_queue.cc:1048] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:51.089893 26958 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:51.094240 26954 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.096078 26546 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:51.120481 21148 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:51.120760 26954 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.100312 26598 raft_consensus.cc:3055] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:51.122924 26598 raft_consensus.cc:740] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.123373 26954 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:51.123839 26598 consensus_queue.cc:260] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.089932 26911 raft_consensus.cc:3060] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.125133 26885 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.127900 26898 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:51.104235 26981 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.108225 21223 raft_consensus.cc:1240] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:51.128773 26595 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.130308 26898 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:08:51.080938 21191 connection.cc:256] RPC call timeout handler was delayed by -1.1564968479999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:08:51.132946 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.138182 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1600) took 1044 ms. Trace:
I20260709 13:08:51.138602 21812 rpcz_store.cc:276] 0709 13:08:50.093658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.093977 (+   319us) service_pool.cc:224] Handling call
0709 13:08:50.140845 (+ 46868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.161959 (+ 21114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.137964 (+976005us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54007481d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:51.138124 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30070144}
I20260709 13:08:51.139595 26920 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.143952 21219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58884ca99bd494292202a75faf1833c"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:51.144650 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.144676 21219 raft_consensus.cc:606] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:51.149518 26824 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.150053 26909 raft_consensus.cc:515] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:51.151401 26616 raft_consensus.cc:493] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:51.151906 26616 raft_consensus.cc:515] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:51.152457 26909 leader_election.cc:290] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:51.153885 26616 leader_election.cc:290] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:51.155452 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.155975 21148 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.156421 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.159629 21191 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.160754 26881 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.162792 21148 raft_consensus.cc:2468] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:51.165099 21263 leader_election.cc:304] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:51.168290 21219 raft_consensus.cc:1240] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:51.171702 21191 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.177883 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.182230 21293 raft_consensus.cc:2410] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:51.186229 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.175002 26881 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.187505 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.188177 21297 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:51.184780 26825 consensus_queue.cc:1059] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:51.188308 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:51.189040 21296 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:51.165532 26595 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.182952 26904 raft_consensus.cc:2804] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:51.197369 21148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13baf7007c44fb5a2efa7e30933caf3"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:51.200559 21148 raft_consensus.cc:606] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.200479 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.201340 21148 raft_consensus.cc:614] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:51.185197 26920 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.204049 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:51.212275 26824 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.215245 26907 raft_consensus.cc:515] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.217759 26907 leader_election.cc:290] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.207955 26595 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.223528 26918 raft_consensus.cc:3055] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.224062 26918 raft_consensus.cc:740] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:51.229934 21146 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:51.208698 26904 raft_consensus.cc:697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:51.231487 26967 consensus_queue.cc:1059] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:51.232118 26904 consensus_queue.cc:237] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:51.236896 21219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:51.237598 21219 raft_consensus.cc:606] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.237895 21219 raft_consensus.cc:614] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:51.237968 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.239439 21297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.241221 21293 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:51.244086 21299 raft_consensus.cc:1240] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.244496 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:51.245384 26730 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:08:51.254552 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 251061us
I20260709 13:08:51.240564 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.255424 21776 leader_election.cc:304] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.255722 21296 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:08:51.257658 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef3aae03e94e30acb5d8592f3f75b2" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.258419 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.260823 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22f29b50b474596adeb0f179b9eb385" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.260879 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.235044 26976 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.264055 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
W20260709 13:08:51.254755 27006 log.cc:927] Time spent T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:51.269200 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d3af139eae4d85981a3afde9289604" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.271106 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:51.272159 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63893.6us
I20260709 13:08:51.273545 21291 raft_consensus.cc:1275] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:51.273613 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.274299 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.274637 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:51.275030 21812 raft_consensus.cc:2393] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:51.257853 26730 raft_consensus.cc:3055] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.272365 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.273965 21291 pending_rounds.cc:85] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 8
I20260709 13:08:51.276718 21291 pending_rounds.cc:107] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:08:51.276846 21266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.276958 21295 raft_consensus.cc:2410] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:51.277099 21291 raft_consensus.cc:2889] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:51.273037 21116 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:51.268014 26976 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.268043 26902 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.245535 26848 consensus_queue.cc:1048] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:08:51.282107 27005 log.cc:927] Time spent T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:51.290709 21191 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.292510 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.293391 21191 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.283433 21222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55554 (request call id 1926) took 2553 ms. Trace:
I20260709 13:08:51.283932 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.280736 26967 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:51.256744 26975 consensus_queue.cc:1059] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:51.294086 21222 rpcz_store.cc:276] 0709 13:08:48.730049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.730165 (+   116us) service_pool.cc:224] Handling call
0709 13:08:48.730435 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.864990 (+2134555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.283175 (+418185us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002391d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:51.283355 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4904020864}
I20260709 13:08:51.276548 26730 raft_consensus.cc:740] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:51.296497 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e32a83beeb475fa3edaac416334c5d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.281347 26976 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.299557 26891 consensus_queue.cc:1059] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:51.300509 26967 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:51.300745 27014 log.cc:927] Time spent T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:51.301795 26975 raft_consensus.cc:3055] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:51.301553 26967 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.302162 26975 raft_consensus.cc:740] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.302946 26975 consensus_queue.cc:260] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.304106 26975 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.298177 26639 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.297663 21191 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:51.309203 26730 consensus_queue.cc:260] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.310597 26730 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.310650 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.272358 27009 raft_consensus.cc:2749] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.299247 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:51.313392 26792 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.314919 26920 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.310842 26983 raft_consensus.cc:3055] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:51.315487 26983 raft_consensus.cc:740] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.316283 26983 consensus_queue.cc:260] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.317375 21191 leader_election.cc:304] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.317646 26983 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.295738 26881 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.319126 26918 consensus_queue.cc:260] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.319995 26920 raft_consensus.cc:2749] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.311483 26848 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.320215 26918 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.320571 26848 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:51.321034 26848 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.322494 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198128dc1acc4c9bbe56ff48a07e23a4" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.323042 21806 raft_consensus.cc:3060] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:51.328482 21265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.329101 21191 leader_election.cc:304] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.331349 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.331965 21812 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.336760 21806 raft_consensus.cc:2468] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 14.
I20260709 13:08:51.337102 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.344074 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.344833 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.337585 21814 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:51.339560 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.339820 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.339548 26920 raft_consensus.cc:2749] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.340260 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.340734 26575 consensus_queue.cc:1048] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:51.348248 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.341393 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.341975 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cca46a22ac5436d9438fe96be0e2fbe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.350136 21809 raft_consensus.cc:1275] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:51.342684 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.343343 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a837dff96224f8b8795bace63448d84" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.339900 26598 raft_consensus.cc:3060] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.351893 21298 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:51.354209 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.354586 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac63da274d954b86ab071da6f6b5148c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.355547 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.356101 21220 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.361003 21148 raft_consensus.cc:2468] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:51.361979 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
W20260709 13:08:51.299855 21263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.363611 21298 pending_rounds.cc:85] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Aborting all ops after (but not including) 7
I20260709 13:08:51.363962 21298 pending_rounds.cc:107] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:51.364243 21298 raft_consensus.cc:2889] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:51.365955 21191 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:51.369974 21220 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:51.373134 21812 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:08:51.383665 26920 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:51.384426 26920 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:51.385432 26920 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.391712 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.395236 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:51.399497 21189 leader_election.cc:304] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.386883 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.403837 26996 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.401103 26881 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:08:51.413419 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.414316 21807 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 10: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:51.416042 21296 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:51.421311 21292 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:51.422976 21190 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.427400 21807 raft_consensus.cc:1240] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:51.431375 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.430791 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.436124 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.436301 21264 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.437336 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.438228 21264 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:51.438802 21811 raft_consensus.cc:2393] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 13: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:51.413686 26639 raft_consensus.cc:2749] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.441991 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.446437 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.449072 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:51.452934 21189 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:51.453737 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.410389 26891 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:51.463290 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.463690 21776 leader_election.cc:304] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.464006 21264 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.464460 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.467146 21115 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.467235 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:51.468047 21145 raft_consensus.cc:1275] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:51.461757 26515 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.471153 21143 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 10: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:51.472306 21115 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.484229 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet df140636c4344f32a0253fef2a907c50 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:55540
I20260709 13:08:51.440394 26911 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:51.472772 27013 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:51.472930 26979 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.473552 26938 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:51.490916 26938 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:51.491370 26938 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.488456 26595 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.494051 26976 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.495464 21151 raft_consensus.cc:1240] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 16. Current term is 18. Ops: []
W20260709 13:08:51.474546 21049 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 365) took 33241 ms (client timeout 15000 ms). Trace:
I20260709 13:08:51.486284 26909 raft_consensus.cc:2749] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.498261 21142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40476 (request call id 2478) took 1600 ms. Trace:
I20260709 13:08:51.464843 26898 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.470885 26996 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.498637 21142 rpcz_store.cc:276] 0709 13:08:49.897415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.897617 (+   202us) service_pool.cc:224] Handling call
0709 13:08:49.928426 (+ 30809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.928768 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.928808 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.929328 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.135645 (+1206317us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18000b5360. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b73b55de1 00007f2b73b625b1 00007f2b6ac6fe07 00007f2b73acaab9 00007f2b6ac8c69b 00007f2b6ac8a93f 00007f2b6ac8cc02 00007f2b6d91420b 00007f2b6d919d23 00007f2b6d91a0d1 00007f2b6dd35a0f
0709 13:08:51.264982 (+129337us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:51.265022 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.265092 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.497994 (+232902us) raft_consensus.cc:1685] finished
0709 13:08:51.498014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.498207 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1068,"raft.queue_time_us":93,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":17138,"spinlock_wait_cycles":2426752,"thread_start_us":129156,"threads_started":1,"wal-append.queue_time_us":1405915}
W20260709 13:08:51.496521 21049 rpcz_store.cc:269] 0709 13:08:18.233518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.233730 (+   212us) service_pool.cc:224] Handling call
0709 13:08:51.474472 (+33240742us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:46.692093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:46.775527 (+ 83434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:46.775581 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:46.775598 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:46.776498 (+   900us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:46.776587 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:46.776617 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:46.777288 (+   671us) tablet.cc:701] Row locks acquired
0709 13:08:46.777336 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:46.777513 (+   177us) write_op.cc:270] Start()
0709 13:08:46.777651 (+   138us) write_op.cc:276] Timestamp: P: 1783602526777451 usec, L: 0
0709 13:08:46.777688 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:46.909183 (+131495us) log.cc:844] Serialized 2439 byte log entry
0709 13:08:47.371436 (+462253us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:47.841917 (+470481us) op_driver.cc:464] REPLICATION: finished
0709 13:08:48.033535 (+191618us) write_op.cc:301] APPLY: starting
0709 13:08:48.034674 (+  1139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.046038 (+ 11364us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.046079 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:48.072246 (+ 26167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:48.072561 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:48.072628 (+    67us) write_op.cc:312] APPLY: finished
0709 13:08:48.072935 (+   307us) log.cc:844] Serialized 65 byte log entry
0709 13:08:48.083636 (+ 10701us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.087429 (+  3793us) write_op.cc:454] Released schema lock
0709 13:08:48.096457 (+  9028us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.147959 (+ 51502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.147990 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":420407,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":191333,"apply.run_cpu_time_us":10370,"apply.run_wall_time_us":91230,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29231,"num_ops":6,"prepare.queue_time_us":180084,"prepare.run_cpu_time_us":14752,"prepare.run_wall_time_us":391355,"raft.queue_time_us":428243,"raft.run_cpu_time_us":13438,"raft.run_wall_time_us":199613,"replication_time_us":1064036,"spinlock_wait_cycles":88599424,"thread_start_us":646051,"threads_started":4,"wal-append.queue_time_us":192652,"wal-append.run_cpu_time_us":31964,"wal-append.run_wall_time_us":2121311}]]}
I20260709 13:08:51.500442 21295 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:51.446682 26625 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:51.501991 21812 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:51.446954 26743 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.486263 21115 leader_election.cc:304] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.503556 26625 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:51.480121 26848 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:51.490504 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 54433.3us
I20260709 13:08:51.507676 21297 raft_consensus.cc:1240] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:51.508159 21294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:51.508750 21294 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.483479 26889 consensus_queue.cc:1059] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:51.514111 26889 raft_consensus.cc:3055] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:51.514493 26889 raft_consensus.cc:740] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.515412 26889 consensus_queue.cc:260] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.506099 26967 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:51.460845 26824 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:51.440196 26851 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.472416 26639 raft_consensus.cc:2804] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:51.520960 26824 raft_consensus.cc:493] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:51.485888 25922 raft_consensus.cc:2749] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.521560 26824 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.486378 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.521577 26639 raft_consensus.cc:697] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:51.439733 27012 consensus_queue.cc:1059] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:51.523026 26639 consensus_queue.cc:237] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.523917 27012 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.524572 27012 raft_consensus.cc:3055] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:51.524909 27012 raft_consensus.cc:740] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:51.526335 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.496142 26976 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:51.504566 21115 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:51.543009 21114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.543288 21115 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.543438 21776 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.513103 26848 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:51.439689 26941 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.548295 21115 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.547178 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.504701 26598 raft_consensus.cc:2749] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.516908 26889 raft_consensus.cc:3060] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.562414 25922 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:51.562927 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.563575 21295 raft_consensus.cc:1240] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:51.561024 26934 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.569803 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.570878 26625 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.571404 26954 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.560945 26979 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.566273 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.588855 26837 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:51.589289 26837 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:51.590126 26837 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.566107 26885 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.578291 21044 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:51.525671 27012 consensus_queue.cc:260] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.560977 26595 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.562038 26918 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.597572 21149 raft_consensus.cc:2468] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:51.581838 21776 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.546391 26967 consensus_queue.cc:1059] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:08:51.651434 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 80227us
I20260709 13:08:51.651944 21294 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 18.
I20260709 13:08:51.652215 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.654207 21291 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 LEADER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.655978 21295 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.597668 26902 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.599162 26837 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:51.660653 21776 leader_election.cc:304] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.664283 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.665041 25922 raft_consensus.cc:2749] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.663940 27012 raft_consensus.cc:3060] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.671968 26824 raft_consensus.cc:515] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.674733 26824 leader_election.cc:290] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:51.679068 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.681748 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.655048 26546 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.683846 21220 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:51.684243 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.687045 25922 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.619988 26990 consensus_queue.cc:1059] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:51.687528 21776 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.692904 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.662063 26918 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:51.696604 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 243680us
I20260709 13:08:51.697208 25922 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:51.697577 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 268923us
I20260709 13:08:51.698616 21190 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.685734 26954 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.703612 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.704106 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0495c200ee4175916ed50c64ff61a7" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:51.703735 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 230538us
I20260709 13:08:51.690444 26625 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.704798 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.707088 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.710791 21776 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.711645 21263 leader_election.cc:304] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:51.712931 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.714797 21151 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:08:51.715138 21151 pending_rounds.cc:85] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 11
I20260709 13:08:51.715382 21151 pending_rounds.cc:107] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:51.715642 21151 raft_consensus.cc:2889] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:51.719805 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:51.721948 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:51.701959 26841 raft_consensus.cc:2749] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.694574 26598 consensus_queue.cc:1059] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:51.739809 21147 raft_consensus.cc:1240] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.717139 27009 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:51.754263 27023 log.cc:927] Time spent T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:51.725402 26960 raft_consensus.cc:2804] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:51.754921 26967 raft_consensus.cc:3055] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:51.768486 26967 raft_consensus.cc:740] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
W20260709 13:08:51.768646 27020 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:08:51.770351 26967 consensus_queue.cc:260] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:51.771559 26967 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:51.772428 27018 log.cc:927] Time spent T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:08:51.774513 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 61024.2us
I20260709 13:08:51.775671 21776 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.776232 21190 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:51.655902 21044 catalog_manager.cc:5697] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 15, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 15 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:51.780998 21264 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:51.803423 21044 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 14, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 14 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:51.804298 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.806713 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.767518 26960 raft_consensus.cc:697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:51.777806 27012 raft_consensus.cc:2749] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.786315 26918 consensus_queue.cc:1048] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:51.787732 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet df140636c4344f32a0253fef2a907c50 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
W20260709 13:08:51.833873 21033 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 46289.1us
I20260709 13:08:51.789583 26575 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.790603 26616 consensus_queue.cc:1048] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:51.791229 21190 leader_election.cc:304] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.859987 26955 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.860257 27026 raft_consensus.cc:2749] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.860562 26955 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.798406 26990 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:51.861373 26990 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.799950 27016 raft_consensus.cc:3055] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:51.783664 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:51.862165 27016 raft_consensus.cc:740] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:51.862684 21808 raft_consensus.cc:2393] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 15: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:51.862769 26955 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:51.807741 21116 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:51.863022 27016 consensus_queue.cc:260] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.864483 27016 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.801985 26938 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.806977 25922 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:51.859992 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 68838.3us
I20260709 13:08:51.866300 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
W20260709 13:08:51.868014 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 52177.8us
I20260709 13:08:51.868269 25922 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.868624 25922 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:51.870770 21814 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:51.867343 21151 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:51.874591 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
W20260709 13:08:51.874967 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 67299.1us
I20260709 13:08:51.853410 21806 raft_consensus.cc:2468] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:08:51.873744 25922 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:51.891304 25922 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.812378 26907 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.907732 21293 raft_consensus.cc:1240] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:51.836226 26909 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.846005 26824 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:51.926936 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 48813.3us
I20260709 13:08:51.937281 21151 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:51.805052 21044 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:51.890782 26598 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:51.893242 27036 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:51.963053 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:51.874285 26857 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:08:51.984365 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.964077 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.964828 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:08:51.992455 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 48247.1us
I20260709 13:08:51.996120 21151 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:51.965174 21225 raft_consensus.cc:1240] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:52.010116 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 75954.2us
I20260709 13:08:51.973351 27036 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.973486 27026 raft_consensus.cc:493] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:52.017099 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:51.941851 26967 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:52.018685 26857 consensus_queue.cc:1243] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer 7c5246dc52bb49f38aef22aba1467452 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:52.015237 26598 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:52.021512 27036 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:52.054522 21291 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:52.002681 26960 consensus_queue.cc:237] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.151906 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:52.028340 27026 raft_consensus.cc:515] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.055737 26919 raft_consensus.cc:3055] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:52.178813 21189 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:52.183959 21148 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:52.184931 26848 raft_consensus.cc:2804] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.177889 27024 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:52.187744 27034 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:08:52.187868 26889 consensus_meta.cc:287] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 13:08:52.187000 26857 consensus_queue.cc:1059] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:08:52.193217 26598 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.148715 21044 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 6 to 15, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.211951 21044 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 14, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 14 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:52.213692 21044 catalog_manager.cc:5697] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.220185 21145 raft_consensus.cc:2468] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:52.238005 21226 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
W20260709 13:08:52.186636 27039 log.cc:927] Time spent T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:08:52.160228 27000 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:52.266817 26857 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:52.267078 27000 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.269122 27000 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.178172 26919 raft_consensus.cc:740] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:52.146852 26955 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:08:52.277706 27038 log.cc:927] Time spent T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:08:52.186636 27044 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:08:52.215173 21044 catalog_manager.cc:5697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
W20260709 13:08:52.369881 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 52121.1us
I20260709 13:08:52.313019 26848 raft_consensus.cc:697] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:52.408550 21226 raft_consensus.cc:3055] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:52.418790 21226 raft_consensus.cc:740] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:52.388504 26765 raft_consensus.cc:493] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:52.408895 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:52.419544 21226 consensus_queue.cc:260] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:52.429998 21226 raft_consensus.cc:3060] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:52.393258 26898 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:52.439065 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.442445 21226 raft_consensus.cc:1275] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:08:52.442844 21226 pending_rounds.cc:85] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting all ops after (but not including) 8
I20260709 13:08:52.443117 21226 pending_rounds.cc:107] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:08:52.443416 21226 raft_consensus.cc:2889] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:52.393404 26985 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.019s
I20260709 13:08:52.445509 21299 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:52.500519 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47464.1us
I20260709 13:08:52.426119 26765 raft_consensus.cc:515] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:52.514292 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.530055 21296 raft_consensus.cc:1240] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:52.545760 21299 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:52.495532 27046 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:08:52.537986 26941 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.496368 26848 consensus_queue.cc:237] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.538360 26818 consensus_queue.cc:1059] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:08:52.564213 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 62889.1us
I20260709 13:08:52.566316 27048 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:52.568701 27058 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:52.584124 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:08:52.595865 27016 consensus_meta.cc:287] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.003s
I20260709 13:08:52.559230 26941 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.561735 27000 consensus_queue.cc:1048] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:52.528119 21044 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 16, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 16 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.619390 21226 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:52.623924 27056 log.cc:927] Time spent T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:52.624485 26941 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.631062 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:52.640226 27036 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.642429 27036 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:52.643489 21812 raft_consensus.cc:1240] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:52.621798 26639 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:52.645829 21044 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 15, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 15 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.681804 26919 consensus_queue.cc:260] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.682010 21044 catalog_manager.cc:5697] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 17, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 17 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.649555 27026 leader_election.cc:290] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.692775 21263 leader_election.cc:304] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:52.710719 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:52.683182 26919 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:52.686417 21044 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 15, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 15 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.736537 21044 catalog_manager.cc:5697] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.739327 26960 raft_consensus.cc:2804] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:52.739701 27065 log.cc:927] Time spent T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:52.745442 26598 raft_consensus.cc:493] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.751219 26598 raft_consensus.cc:515] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.753396 26598 leader_election.cc:290] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.757695 26969 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:52.758278 26969 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.769209 26818 raft_consensus.cc:493] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:52.769783 26818 raft_consensus.cc:515] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.772457 26818 leader_election.cc:290] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:52.738845 21044 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.776016 21808 raft_consensus.cc:1275] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:52.783895 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:52.743673 26960 raft_consensus.cc:697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:52.800024 26818 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:52.800033 26954 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:52.800359 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2e5a8d491c4a22ac81fce79a27a7ea" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:52.804756 21813 raft_consensus.cc:3060] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.806257 21808 raft_consensus.cc:1275] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:52.808364 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:52.792562 26956 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:52.810240 26818 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.810014 27044 consensus_queue.cc:1048] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:52.809870 26954 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:52.926347 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.901409 26983 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:52.838743 21044 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 12, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.910554 26905 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:52.957762 26954 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:52.957784 26898 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.927678 26960 consensus_queue.cc:237] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.959496 26983 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.963416 26898 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.970883 26898 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.972420 26818 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:52.973657 27037 log.cc:927] Time spent T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.954s	user 0.019s	sys 0.018s
I20260709 13:08:52.975250 21805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52772 (request call id 1516) took 1269 ms. Trace:
I20260709 13:08:52.962073 26905 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.975675 21805 rpcz_store.cc:276] 0709 13:08:51.706313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.706417 (+   104us) service_pool.cc:224] Handling call
0709 13:08:51.706708 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.707001 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.707029 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.716370 (+  9341us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.783016 (+ 66646us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:51.893073 (+110057us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.894238 (+  1165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.894312 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.973149 (+1078837us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6ab15db1 00007f2b6abb3c85 00007f2b6abb46a2 00007f2b6d9261db 00007f2b6d921aaf 00007f2b6d91586e 00007f2b6d914bb6 00007f2b6d9147d8 00007f2b6d91e221 00007f2b6d91e1d9 00007f2b6d91e169
0709 13:08:52.974910 (+  1761us) raft_consensus.cc:1685] finished
0709 13:08:52.975030 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.975176 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8067,"prepare.queue_time_us":191354,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4321,"raft.queue_time_us":11267,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":7547,"spinlock_wait_cycles":70741632,"thread_start_us":96808,"threads_started":2,"wal-append.queue_time_us":184504}
I20260709 13:08:52.977260 26905 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.961607 26979 raft_consensus.cc:493] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:52.980561 26979 raft_consensus.cc:515] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:52.982662 26979 leader_election.cc:290] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:52.985951 27070 log.cc:927] Time spent T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:52.987848 26969 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.988996 21812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52780 (request call id 1627) took 1110 ms. Trace:
I20260709 13:08:52.989369 21812 rpcz_store.cc:276] 0709 13:08:51.878990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.879168 (+   178us) service_pool.cc:224] Handling call
0709 13:08:51.879423 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.644040 (+764617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.988790 (+344750us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54003912d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:52.988944 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756670848}
I20260709 13:08:52.990585 21293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 3143) took 1483 ms. Trace:
I20260709 13:08:52.990945 21293 rpcz_store.cc:276] 0709 13:08:51.507382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.507861 (+   479us) service_pool.cc:224] Handling call
0709 13:08:51.512232 (+  4371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.908334 (+396102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.990376 (+1082042us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54001a81d4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce3571 00007f2b6dd7ae01 00007f2b6dd7983e 00007f2b72d3e419 00007f2b6c2b5bd4 00007f2b6c2b5b62 00007f2b6c2b5a91 00007f2b6c2b5a0c 00007f2b6c2b4cc2 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:52.990533 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908973312}
I20260709 13:08:52.999920 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.004770 21813 raft_consensus.cc:1275] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:53.004956 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.015748 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.021489 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.022222 21295 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.024688 21044 catalog_manager.cc:5697] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 15, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 15 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:53.020901 26954 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
I20260709 13:08:53.026094 26954 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.026268 21044 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:53.027705 21044 catalog_manager.cc:5697] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 13, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 13 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.028898 26954 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.029482 26954 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.029968 26954 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.029631 21044 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 12, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 12 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.031478 21044 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 12, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:53.032117 26954 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.032887 26954 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.033435 26954 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.034022 21044 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 14, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.037321 26905 consensus_queue.cc:1059] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:53.038187 26598 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:53.038573 26598 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:53.038318 21044 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:52.970858 26983 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:52.961727 27016 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:52.966027 26866 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c5246dc52bb49f38aef22aba1467452)
W20260709 13:08:53.020026 26891 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:08:53.047868 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.050033 21296 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:53.048197 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.051030 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.052407 21778 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:53.040521 26598 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.019804 26546 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.055512 26546 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.056281 26912 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:53.056727 26912 raft_consensus.cc:493] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.057096 26912 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.058221 26546 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.062655 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.035712 26954 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:08:53.065188 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 46737.8us
I20260709 13:08:53.069343 21296 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:53.071678 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:08:53.072557 21116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.084898 26983 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:53.089965 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:53.046576 27016 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.060925 26866 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.098868 26866 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.099429 27009 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:53.101742 27016 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.102399 27009 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:53.103453 27009 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.088248 26954 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.040287 21044 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:53.108999 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.110711 21295 raft_consensus.cc:2368] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17.
I20260709 13:08:53.117672 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797a6a3b284c4ce2b664a3f7e63dfb7e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.120033 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.121073 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.121501 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f88661ef8d64aa7893277b13b46ff04" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.121660 21807 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:53.122226 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.122474 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.123059 21812 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:53.123543 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.124070 21807 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:53.124596 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.125375 21812 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:53.128777 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.129704 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:53.130554 21115 leader_election.cc:304] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.131873 21191 leader_election.cc:400] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17.
I20260709 13:08:53.132196 21191 leader_election.cc:403] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.136166 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.135757 21044 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 14 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:53.135768 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.138830 21264 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.139467 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.140740 21115 leader_election.cc:304] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.142242 21293 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 17: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.142104 21115 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.143944 26889 raft_consensus.cc:2749] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.143463 21044 catalog_manager.cc:5697] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 15, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 15 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.144392 27016 raft_consensus.cc:2749] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.144673 26889 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:53.145380 21044 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:53.146914 21044 catalog_manager.cc:5697] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 12, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 12 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:53.128376 27000 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.149062 27000 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.149576 26907 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.149129 21044 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:53.149992 26907 raft_consensus.cc:493] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.150378 26907 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.142129 26976 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.151779 26976 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:53.152168 26976 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.139927 26837 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.143225 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:53.160666 26901 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.161190 26901 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.141105 26960 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.161921 26960 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.162129 26765 leader_election.cc:290] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.162359 26960 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.164326 21264 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:53.170368 21814 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.183636 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:53.187992 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688a48cc2bc64a7a9e78bf41a84d44ca" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.181660 26546 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.189177 26546 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.164489 26904 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.190033 26904 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.190403 26904 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.191315 26546 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:53.192459 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.168557 27053 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.163200 26901 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.192643 26792 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.165704 27000 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:53.206223 21814 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:53.182299 26885 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.370837 27048 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.250936 26996 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.376554 27048 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.358417 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.376997 26996 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.377779 21145 raft_consensus.cc:2393] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:53.346803 26904 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.365455 26575 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.378970 27048 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.368191 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.343508 27046 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.224238 26912 raft_consensus.cc:515] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.220259 21224 raft_consensus.cc:1240] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:53.227156 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.221776 26990 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.215066 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.225955 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccd55284a3547968acf752c8d6f9f4d" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.263406 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.361881 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.280547 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.243042 26938 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.229712 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17378a57c1c3434a8411ab6894114acb" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.219663 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a59065e5d64bc09a27e51c9955775d" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.238801 21221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.223976 26960 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.213065 26976 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.379221 26996 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.384608 21190 leader_election.cc:304] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.353045 26967 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.364400 26975 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.418720 26976 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.424192 27040 raft_consensus.cc:2749] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.424314 26975 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.426930 27040 consensus_queue.cc:1048] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:53.428361 26975 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.262488 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.345432 27062 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.429768 27040 consensus_queue.cc:1059] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:53.429816 27062 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.249647 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.217417 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.432029 27066 consensus_queue.cc:1048] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.432235 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.433494 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.434563 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.436719 21217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.207747 27053 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.282320 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.443961 26967 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.444545 21225 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 18: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:53.208088 26907 raft_consensus.cc:515] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.446182 26967 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.446863 26907 leader_election.cc:290] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.280859 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.344965 21809 raft_consensus.cc:1275] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:53.379721 26885 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.395924 21811 raft_consensus.cc:1240] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:53.457442 26885 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.227710 21810 raft_consensus.cc:3060] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.458385 21143 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:53.460752 21114 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.462034 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.462778 21296 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 18: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.397660 26912 leader_election.cc:290] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.403731 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.466357 27066 consensus_queue.cc:1059] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:53.467666 27040 raft_consensus.cc:3055] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:53.468256 27040 raft_consensus.cc:740] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:53.402110 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.400535 27048 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:53.470752 27025 raft_consensus.cc:493] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:53.407915 25922 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:53.471293 27025 raft_consensus.cc:515] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.471520 25922 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.473457 25922 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.473569 27025 leader_election.cc:290] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.404845 26990 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.421164 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.403831 26837 raft_consensus.cc:2749] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17.
I20260709 13:08:53.483736 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.484710 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.485220 21805 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:08:53.485970 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.486480 26907 consensus_queue.cc:1048] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.408078 21146 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:53.415482 21293 raft_consensus.cc:1240] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Rejecting Update request from peer f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:53.488819 26955 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.412286 21220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.380401 26575 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.492159 26969 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:53.492910 21776 leader_election.cc:304] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.416952 26960 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.381385 26904 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.403462 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.482121 21114 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.498266 21813 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.498567 21776 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.499109 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.413085 21223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.403501 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ad000b4a9410f80c7796396b878f5" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.431186 27045 raft_consensus.cc:3055] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:53.225651 26598 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.447856 21219 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:53.448930 27062 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.451999 27053 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.388783 27046 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.467724 21810 raft_consensus.cc:1275] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:53.475272 21189 leader_election.cc:304] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:53.512629 21263 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.519562 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:08:53.519995 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 44829.8us
I20260709 13:08:53.469216 27040 consensus_queue.cc:260] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.404599 21807 raft_consensus.cc:2368] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17.
I20260709 13:08:53.477005 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.479681 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.480264 25922 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.526223 25922 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.480621 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.527696 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.407939 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.489277 26955 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.496623 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.501724 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.503551 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.505899 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d2a839d8cf43eea500e735e58a9e28" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.527237 21811 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:53.500458 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.531195 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.512777 21808 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:53.532572 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.496551 26575 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.528913 21776 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.518368 26912 raft_consensus.cc:2749] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.537746 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dee37f119694b8cbc658fd3b84b0563" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.524494 27025 raft_consensus.cc:2749] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.547971 21813 raft_consensus.cc:2468] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 18.
I20260709 13:08:53.548051 21219 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:53.556432 27046 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.511199 27045 raft_consensus.cc:740] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:53.558791 25922 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.558923 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:53.560362 21190 leader_election.cc:400] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 16. Current term is 17.
I20260709 13:08:53.523826 26967 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.564846 26891 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:53.565570 26920 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.565698 26912 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.566224 26920 raft_consensus.cc:493] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.537428 26934 raft_consensus.cc:2749] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:53.567409 26792 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.537284 27000 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.568078 26792 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.524276 26837 consensus_queue.cc:1059] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:08:53.568075 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.579698 26837 raft_consensus.cc:3055] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.580189 26837 raft_consensus.cc:740] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:53.582731 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.582944 26955 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.585834 21148 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 18.
I20260709 13:08:53.566728 26920 raft_consensus.cc:3060] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.530857 26546 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.581075 26837 consensus_queue.cc:260] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.596060 21143 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:53.597995 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09568f2c2c854929b369d24083d81717" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.590474 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.579731 26792 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.595638 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.599953 21776 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.601477 21291 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 18.
I20260709 13:08:53.607065 21189 leader_election.cc:304] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:53.605425 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.606796 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:53.614308 21293 raft_consensus.cc:2393] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 17: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.615063 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.583601 27040 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:53.617699 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 100469us
I20260709 13:08:53.615928 21150 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:53.602423 26990 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.619553 26575 raft_consensus.cc:2749] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.621580 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.628150 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.622692 27066 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:53.619952 21191 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.624733 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.620887 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.625447 21115 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:53.629063 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.613101 26941 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.630007 21226 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:53.636478 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.625633 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.613442 26885 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.631917 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:53.615660 26881 consensus_queue.cc:1048] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:53.635675 26941 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.639277 26905 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.643205 26905 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.643617 26905 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.644907 26904 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.642498 26885 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.630215 26546 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:53.648142 26546 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:53.648550 26546 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.650074 26885 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.660351 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.632967 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.637989 21263 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:53.631561 21293 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 12: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.641134 21264 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.652333 26969 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:53.635521 27066 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.658218 21115 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.658811 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.642113 26941 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.617815 27000 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:08:53.664920 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.671547 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.668494 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.672400 21291 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 11.
I20260709 13:08:53.629583 26990 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.633255 26955 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.584030 27045 consensus_queue.cc:260] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.638139 26575 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.663667 26837 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.665366 26938 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.664623 26912 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.692806 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ede0f4ec7554d9597f6e9c64ce23e46" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.680112 21776 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.693688 21226 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.669632 26909 raft_consensus.cc:2804] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:53.696579 26909 raft_consensus.cc:697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:53.681859 21219 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 17.
W20260709 13:08:53.697916 21191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.676908 26955 raft_consensus.cc:493] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.702921 26955 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.704747 26919 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.676982 26969 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:53.710892 21226 raft_consensus.cc:2468] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 18.
I20260709 13:08:53.677497 26990 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.681445 27062 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.700147 21776 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.689858 26938 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.708043 26909 consensus_queue.cc:237] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.721866 21116 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.717087 27048 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.730500 21809 raft_consensus.cc:1275] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:53.720512 26938 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.741729 21116 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.736537 25922 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.742033 21776 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.737408 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa95e198a0404e91adecdec5338443a0" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.747821 21263 leader_election.cc:304] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:53.750329 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.725862 27000 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.753608 21805 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 17.
I20260709 13:08:53.749856 21116 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.730975 26954 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.731786 26967 raft_consensus.cc:2749] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.746357 26919 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.741528 27048 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.771373 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.772043 21224 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 10.
I20260709 13:08:53.767529 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:53.773409 21291 raft_consensus.cc:2393] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 18: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.774983 21114 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:53.751650 26901 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.740882 27009 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:53.767300 26996 raft_consensus.cc:2804] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:53.765277 26969 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.783656 27062 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:53.790478 27062 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.790841 27062 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.794298 26905 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.788132 26996 raft_consensus.cc:697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:53.796653 27045 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.795986 26996 consensus_queue.cc:237] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.798600 26546 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.821844 26546 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.767922 26967 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:53.769948 27048 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.826503 26955 raft_consensus.cc:515] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.819974 26905 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.802394 27066 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:53.801546 27100 log.cc:927] Time spent T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:53.810377 26941 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.760983 27000 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:08:53.835997 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 88277.3us
I20260709 13:08:53.843523 21115 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.806810 26920 raft_consensus.cc:515] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:53.855705 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 175611us
W20260709 13:08:53.816272 27102 log.cc:927] Time spent T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:08:53.864753 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:53.865732 21143 raft_consensus.cc:2368] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:53.868687 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.844386 26898 consensus_queue.cc:1048] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:53.869728 21291 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 11: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.879573 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.880303 21805 raft_consensus.cc:2368] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 18. Current term is 19.
I20260709 13:08:53.882951 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:53.890197 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:08:53.890635 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 140840us
I20260709 13:08:53.890872 21806 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.892266 21190 leader_election.cc:400] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 18. Current term is 19.
I20260709 13:08:53.892621 21190 leader_election.cc:403] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.905117 21776 leader_election.cc:400] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
I20260709 13:08:53.905467 21776 leader_election.cc:403] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.916225 26920 leader_election.cc:290] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.901391 26743 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.921932 26990 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:53.926796 21148 raft_consensus.cc:2368] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:53.927790 26990 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.928965 26941 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:53.896281 26905 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.930490 26938 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.931694 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.932492 26938 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:53.932535 21219 raft_consensus.cc:2393] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 18: Already voted for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in this term.
I20260709 13:08:53.938203 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:53.939599 27000 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:53.940372 27062 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:53.941939 26955 leader_election.cc:290] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:53.948460 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.949258 21296 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.953013 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:53.953776 21226 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:08:53.956712 21149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:53.959501 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.960220 21293 raft_consensus.cc:3060] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.960878 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.963121 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.970225 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:53.970984 21292 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.971835 21145 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 18.
I20260709 13:08:53.958670 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:53.951563 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:53.975121 21219 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.977154 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605603ac2631443292cd7278cf055b51" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:53.978731 21813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:51204
I20260709 13:08:53.979321 21813 raft_consensus.cc:606] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.979611 21813 raft_consensus.cc:614] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.980813 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:53.982157 21805 raft_consensus.cc:2393] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 18: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:08:53.983439 21190 leader_election.cc:304] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:53.985775 21806 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:53.986766 21189 leader_election.cc:400] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:53.987177 21189 leader_election.cc:403] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.988168 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:53.988981 21142 raft_consensus.cc:2393] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 13: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:53.988240 21293 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 19.
I20260709 13:08:53.991204 21778 leader_election.cc:304] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
W20260709 13:08:53.984360 27072 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.050s	user 0.003s	sys 0.001s
W20260709 13:08:53.989269 27111 log.cc:927] Time spent T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 13:08:53.988394 27036 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 11. Current term is 12.
W20260709 13:08:53.987663 27107 log.cc:927] Time spent T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.083s	user 0.003s	sys 0.022s
W20260709 13:08:53.983966 27087 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.064s	user 0.002s	sys 0.004s
I20260709 13:08:53.970171 27062 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:54.003150 21296 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 12.
I20260709 13:08:54.000226 26955 raft_consensus.cc:2804] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:53.992040 26960 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:53.989013 27046 raft_consensus.cc:2749] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.051891 26955 raft_consensus.cc:697] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:54.012734 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:54.052937 21224 raft_consensus.cc:606] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:54.052804 26955 consensus_queue.cc:237] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.014694 26743 raft_consensus.cc:2749] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709) with higher term. Message: Invalid argument: T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 18. Current term is 19.
I20260709 13:08:54.026119 21292 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:54.054184 26960 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:54.055166 26960 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.033200 21218 raft_consensus.cc:2468] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
W20260709 13:08:54.058079 27112 log.cc:927] Time spent T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:54.046907 21116 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:54.058737 27106 raft_consensus.cc:2764] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:54.062894 21148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:54.063475 21148 raft_consensus.cc:606] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:54.042191 21219 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:54.049474 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a3e5fa488f4d4f813752adf6415abe" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:54.050757 21145 raft_consensus.cc:1240] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Rejecting Update request from peer 5e66e7254b764832b244bb5b07b4a208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:54.068113 21114 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:54.068305 21776 leader_election.cc:304] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:54.076210 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:54.078035 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:54.078680 21805 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.080478 26969 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.085465 26969 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.086326 26969 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.080341 27009 raft_consensus.cc:2804] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:54.091462 27009 raft_consensus.cc:697] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:54.092306 27009 consensus_queue.cc:237] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.067121 27026 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 12. Current term is 13.
I20260709 13:08:54.097286 26919 consensus_queue.cc:1059] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:54.098186 26919 raft_consensus.cc:3055] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:54.098510 26919 raft_consensus.cc:740] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:54.080411 26901 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:54.099790 26901 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.099340 26919 consensus_queue.cc:260] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.100591 26919 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.100593 26901 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.106040 21225 raft_consensus.cc:2468] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 19.
I20260709 13:08:54.107434 21115 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:08:54.120478 21805 raft_consensus.cc:2468] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 18.
I20260709 13:08:54.122759 21264 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:54.144250 27091 raft_consensus.cc:2804] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.155400 27040 raft_consensus.cc:993] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.155910 27040 raft_consensus.cc:1081] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.127116 26990 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:54.169466 27091 raft_consensus.cc:697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:54.171468 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:54.172055 21142 raft_consensus.cc:606] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:54.170503 27091 consensus_queue.cc:237] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.213570 21295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:08:54.216746 21295 raft_consensus.cc:493] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.217101 21295 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.261138 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:54.262027 21142 raft_consensus.cc:606] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:54.267853 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:54.269083 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:54.272639 27117 log.cc:927] Time spent T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 13:08:54.285876 21806 raft_consensus.cc:1240] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Rejecting Update request from peer 3585d99c303e453c8c3762b294caba4e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:54.291879 26905 consensus_queue.cc:1059] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:54.292936 26905 raft_consensus.cc:3055] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:54.293301 26905 raft_consensus.cc:740] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.294257 26905 consensus_queue.cc:260] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.295470 26905 raft_consensus.cc:3060] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.301337 21295 raft_consensus.cc:515] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.304108 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:54.304636 21142 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.309743 21295 leader_election.cc:290] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:54.311687 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb23cad4ade4afea24324bfae738314" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:54.312309 21218 raft_consensus.cc:3055] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:54.312623 21218 raft_consensus.cc:740] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:54.313467 21142 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:54.313351 21218 consensus_queue.cc:260] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.314586 21218 raft_consensus.cc:3060] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.314666 21263 leader_election.cc:304] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:54.317255 27091 raft_consensus.cc:2804] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:54.323897 27091 raft_consensus.cc:697] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:54.324765 27091 consensus_queue.cc:237] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.327180 21225 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:54.328722 26907 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:54.332253 21218 raft_consensus.cc:2468] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:08:54.343228 26905 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.343782 26905 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.345887 26905 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:54.348093 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:54.351500 21813 raft_consensus.cc:3060] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.351900 21225 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:54.354921 26907 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:54.348062 21295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:54.359596 21295 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 14.
I20260709 13:08:54.360793 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:54.361918 26905 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:54.362018 21813 raft_consensus.cc:1275] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:54.362439 26905 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.367322 27062 raft_consensus.cc:993] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.368124 27062 raft_consensus.cc:1081] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.369566 26905 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.376493 21295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:08:54.377147 21295 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.377545 21295 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.383551 21806 raft_consensus.cc:1275] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:54.385572 27121 consensus_queue.cc:1048] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:54.387001 27091 consensus_queue.cc:1048] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:54.408705 26905 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.413826 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:54.414469 21296 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.415241 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:54.414022 21295 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.418740 21044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 378) took 8345 ms. Trace:
I20260709 13:08:54.419127 21044 rpcz_store.cc:276] 0709 13:08:46.073254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.076772 (+  3518us) service_pool.cc:224] Handling call
0709 13:08:54.418654 (+8341882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:53.408826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:53.409414 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:53.409452 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:53.409472 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:53.455388 (+ 45916us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:53.455474 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:53.455508 (+    34us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:08:53.547589 (+ 92081us) tablet.cc:701] Row locks acquired
0709 13:08:53.557961 (+ 10372us) write_op.cc:260] PREPARE: finished
0709 13:08:53.577439 (+ 19478us) write_op.cc:270] Start()
0709 13:08:53.577568 (+   129us) write_op.cc:276] Timestamp: P: 1783602533577377 usec, L: 0
0709 13:08:53.577594 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:53.578401 (+   807us) log.cc:844] Serialized 10892 byte log entry
0709 13:08:53.993698 (+415297us) op_driver.cc:464] REPLICATION: finished
0709 13:08:54.108987 (+115289us) write_op.cc:301] APPLY: starting
0709 13:08:54.109077 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:54.295455 (+186378us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:54.295575 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:54.345319 (+ 49744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:54.345690 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:08:54.345744 (+    54us) write_op.cc:312] APPLY: finished
0709 13:08:54.346199 (+   455us) log.cc:844] Serialized 244 byte log entry
0709 13:08:54.346990 (+   791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:54.347196 (+   206us) write_op.cc:454] Released schema lock
0709 13:08:54.347273 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:54.350902 (+  3629us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:54.350933 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":112783,"apply.run_cpu_time_us":35825,"apply.run_wall_time_us":241854,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121279,"num_ops":28,"prepare.queue_time_us":37748,"prepare.run_cpu_time_us":23266,"prepare.run_wall_time_us":243031,"raft.queue_time_us":8832,"raft.run_cpu_time_us":11936,"raft.run_wall_time_us":170272,"replication_time_us":367859,"thread_start_us":170307,"threads_started":4,"wal-append.queue_time_us":113891}]]}
I20260709 13:08:54.427662 21048 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 10 to 11, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.442726 21295 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:54.443696 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:54.444247 21813 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.447060 21296 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:54.413842 26905 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:54.448201 21116 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:54.453333 26905 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:54.453738 21813 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:54.454520 21142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:54.455129 21142 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:54.455446 21142 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.455404 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:54.456887 21048 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 4 to 8, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 8 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:54.460530 21218 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:54.461472 27091 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:54.460219 21142 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.453882 26905 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.465158 26905 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.463395 26964 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:54.466856 21142 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.466423 21048 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 3 to 11, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.462674 27091 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:54.475768 21145 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:54.479785 21142 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 16.
I20260709 13:08:54.489634 21048 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 11 to 13, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.497278 21048 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 6 to 9, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 9 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:54.488257 26909 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:54.499912 27091 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.510479 21806 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:54.513339 26990 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.523047 26969 raft_consensus.cc:993] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.523651 26969 raft_consensus.cc:1081] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.525261 21048 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 6 to 9, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 9 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:54.526932 21295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:08:54.527653 21295 raft_consensus.cc:493] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.528040 21295 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.532122 21219 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:54.546525 21219 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:54.551529 26546 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:54.562630 26909 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.581086 21296 raft_consensus.cc:1275] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:54.589044 26954 consensus_queue.cc:1048] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:08:54.598731 21296 raft_consensus.cc:3060] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.615487 21296 raft_consensus.cc:1275] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:54.617002 26954 consensus_queue.cc:1048] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:54.619028 26969 raft_consensus.cc:993] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.621891 26969 raft_consensus.cc:1081] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Signalling peer 7c5246dc52bb49f38aef22aba1467452 to start an election
I20260709 13:08:54.631824 21291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:08:54.632360 21291 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.632498 21296 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:54.632730 21291 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.633991 26969 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.638273 21296 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:54.641258 21291 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.644013 21291 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:54.650854 21218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:54.651765 21218 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.659148 26955 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:08:54.659754 26955 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.660070 21145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:54.660598 21145 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:54.660910 21145 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.661630 21145 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.662860 21145 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.663586 21296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:54.664278 21296 raft_consensus.cc:2368] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:54.664023 21295 raft_consensus.cc:515] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.665639 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:54.666587 21778 leader_election.cc:400] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:54.666908 21778 leader_election.cc:403] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.661955 26955 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:54.682214 21295 leader_election.cc:290] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:54.682108 26954 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.644061 26969 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:54.712245 26954 raft_consensus.cc:2749] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115) with higher term. Message: Invalid argument: T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 for earlier term 14. Current term is 15.
I20260709 13:08:54.712777 21226 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:54.717159 26969 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:54.736024 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:54.736626 21148 raft_consensus.cc:3055] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:54.736917 21148 raft_consensus.cc:740] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:54.737589 21148 consensus_queue.cc:260] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.739202 21149 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:54.739351 27026 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.739835 27026 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:54.738884 21148 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.755780 27026 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:54.759707 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:54.760454 21292 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:08:54.760533 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:54.761088 21224 raft_consensus.cc:3060] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.766418 21218 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:54.761806 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:54.781716 21224 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:54.731036 21145 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:08:54.772130 21148 raft_consensus.cc:2468] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 15.
I20260709 13:08:54.774062 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:08:54.832043 21048 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46294 (request call id 380) took 30480 ms (client timeout 15000 ms). Trace:
W20260709 13:08:54.832657 21048 rpcz_store.cc:269] 0709 13:08:24.352018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.442014 (+ 89996us) service_pool.cc:224] Handling call
0709 13:08:54.831938 (+30389924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:54.572062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:54.572631 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:54.572663 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:54.572679 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:54.575587 (+  2908us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:54.577994 (+  2407us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:54.578042 (+    48us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:54.583075 (+  5033us) tablet.cc:701] Row locks acquired
0709 13:08:54.583601 (+   526us) write_op.cc:260] PREPARE: finished
0709 13:08:54.593056 (+  9455us) write_op.cc:270] Start()
0709 13:08:54.593203 (+   147us) write_op.cc:276] Timestamp: P: 1783602534589295 usec, L: 0
0709 13:08:54.593232 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:54.594084 (+   852us) log.cc:844] Serialized 2439 byte log entry
0709 13:08:54.687636 (+ 93552us) op_driver.cc:464] REPLICATION: finished
0709 13:08:54.688042 (+   406us) write_op.cc:301] APPLY: starting
0709 13:08:54.688125 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:54.694659 (+  6534us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:54.694768 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:54.698943 (+  4175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:54.699326 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:54.699394 (+    68us) write_op.cc:312] APPLY: finished
0709 13:08:54.699652 (+   258us) log.cc:844] Serialized 65 byte log entry
0709 13:08:54.700428 (+   776us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:54.700528 (+   100us) write_op.cc:454] Released schema lock
0709 13:08:54.700582 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:54.700934 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:54.700962 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165298,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":146,"apply.run_cpu_time_us":9124,"apply.run_wall_time_us":12835,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25104,"num_ops":6,"prepare.queue_time_us":16216,"prepare.run_cpu_time_us":3965,"prepare.run_wall_time_us":22478,"replication_time_us":78057,"thread_start_us":19513,"threads_started":1}]]}
I20260709 13:08:54.850180 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:54.850796 21806 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:54.855000 26907 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:54.855660 26907 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:54.856513 26907 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:54.773130 26743 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:54.884567 21806 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:54.864655 26743 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.876157 26905 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:54.891789 26743 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.950306 26905 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:55.025663 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 157163us
W20260709 13:08:55.062350 27143 log.cc:927] Time spent T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:08:55.064031 27140 log.cc:927] Time spent T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:55.082276 26743 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:55.084410 27136 log.cc:927] Time spent T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:08:55.089931 26905 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:55.095270 26743 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:55.135998 21045 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.162917 21222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:55.164467 21222 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:55.170805 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:55.154024 21045 catalog_manager.cc:5697] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 12 to 15, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 15 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:55.186136 21045 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 8 to 10, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 10 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.219702 26900 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.220412 26900 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:08:55.220971 26900 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:55.208245 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 167202us
I20260709 13:08:55.268317 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:55.269227 21291 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:55.271337 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.285785 21299 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:55.293205 21045 catalog_manager.cc:5697] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 12 to 16, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:55.295377 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 213050us
W20260709 13:08:55.296248 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 473206us
I20260709 13:08:55.298348 21263 leader_election.cc:304] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:55.300508 27091 raft_consensus.cc:2804] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:55.301167 27091 raft_consensus.cc:697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:55.302299 27091 consensus_queue.cc:237] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:55.313138 21806 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:55.314549 21045 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:55.316962 21045 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.328328 26990 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.335528 27147 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.337088 27153 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:55.355281 21813 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:55.361100 21806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:55.362140 21806 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 17: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:55.387859 21291 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:55.392097 26900 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:55.395572 21045 catalog_manager.cc:5697] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:55.397023 21225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:55.414348 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:55.415179 21811 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:55.419212 21225 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:55.422773 21114 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:55.419370 21045 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 11 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:55.426472 26969 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:55.427000 26969 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:55.428141 26969 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:55.435683 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 82814.1us
I20260709 13:08:55.407366 26900 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:55.444788 27170 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.449713 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:55.450646 21805 raft_consensus.cc:2393] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3585d99c303e453c8c3762b294caba4e in current term 17: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:08:55.458968 21811 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:08:55.481242 21191 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:55.481521 27091 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:55.483421 27161 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:55.484002 27161 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:55.485049 27161 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:55.496726 21045 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 9 to 12, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.508744 21225 raft_consensus.cc:1275] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:55.513239 21150 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:55.513936 21145 raft_consensus.cc:1275] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:08:55.514375 21145 pending_rounds.cc:85] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Aborting all ops after (but not including) 12
I20260709 13:08:55.514609 21145 pending_rounds.cc:107] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:55.514895 21145 raft_consensus.cc:2889] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.515141 21146 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:55.529048 21045 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 11 to 14, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 14 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.575052 27091 consensus_queue.cc:1048] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:55.574779 27164 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:55.581512 27155 consensus_queue.cc:1048] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:55.581516 21219 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:55.540848 21045 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 10 to 11, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 11 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.575079 27153 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:55.606782 27161 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:55.614555 27161 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:55.621690 21148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:55.622851 21148 raft_consensus.cc:2393] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 in current term 11: Already voted for candidate 3585d99c303e453c8c3762b294caba4e in this term.
I20260709 13:08:55.631633 21045 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.645685 26964 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.643522 27147 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:55.646359 26964 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:55.648814 26964 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:55.660105 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e" is_pre_election: true
I20260709 13:08:55.660835 21147 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:08:55.661537 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:55.661979 27161 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:55.662154 21805 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:08:55.663105 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:55.664340 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:08:55.664930 21219 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 10.
I20260709 13:08:55.667606 27156 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:55.668004 27156 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.668354 27156 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.672338 27170 raft_consensus.cc:493] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.672843 27170 raft_consensus.cc:515] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:55.684815 21190 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:55.691529 27066 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:55.691802 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:08:55.692003 27066 raft_consensus.cc:493] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e66e7254b764832b244bb5b07b4a208)
I20260709 13:08:55.697769 27066 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:55.733574 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425aa4009f134d7c94f0050facfd0811" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:08:55.698890 27170 leader_election.cc:290] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:08:55.783636 27181 log.cc:927] Time spent T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:55.859525 21115 leader_election.cc:304] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e; no voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:55.878851 27156 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:55.900347 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 83940.2us
W20260709 13:08:55.961338 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73535.1us
W20260709 13:08:55.978765 21115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 117752us
I20260709 13:08:55.953318 27170 raft_consensus.cc:2749] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.996649 27156 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:08:56.085681 21218 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:56.093415 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
W20260709 13:08:56.100270 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 135261us
I20260709 13:08:56.130376 21148 raft_consensus.cc:1275] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:08:56.157572 27193 log.cc:927] Time spent T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:08:56.158030 27190 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:08:56.159761 27189 log.cc:927] Time spent T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:08:56.184832 27202 log.cc:927] Time spent T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:56.259019 21805 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.265322 21812 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:56.327775 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 45979.9us
I20260709 13:08:56.343660 21226 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:56.323534 26990 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:08:56.350293 27066 consensus_meta.cc:287] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.002s
I20260709 13:08:56.350862 27066 raft_consensus.cc:515] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:56.353332 21298 raft_consensus.cc:1275] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.355064 21219 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.376330 21147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:56.377049 21147 raft_consensus.cc:3060] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.389170 21219 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:56.398788 27162 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:56.406965 27066 leader_election.cc:290] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:56.440346 27160 consensus_queue.cc:1048] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:08:56.465276 26990 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:56.466209 21147 raft_consensus.cc:2468] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:08:56.467479 21776 leader_election.cc:304] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:56.468364 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:56.468456 27192 raft_consensus.cc:2804] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:56.483091 21143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58884ca99bd494292202a75faf1833c" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:56.483937 21143 raft_consensus.cc:2368] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12.
W20260709 13:08:56.486366 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 106627us
I20260709 13:08:56.493561 27192 raft_consensus.cc:697] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:56.531420 26909 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:56.534772 27195 consensus_queue.cc:1048] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:56.570169 21189 leader_election.cc:400] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12.
I20260709 13:08:56.570578 21189 leader_election.cc:403] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:08:56.571029 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 79249us
I20260709 13:08:56.571189 27066 raft_consensus.cc:2749] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145) with higher term. Message: Invalid argument: T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f81bf1abd0b34f518d1f2b79cc4dba77 for earlier term 11. Current term is 12.
I20260709 13:08:56.578668 27192 consensus_queue.cc:237] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:08:56.592068 27230 log.cc:927] Time spent T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:56.696035 21044 catalog_manager.cc:5697] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 13, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 13 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.698129 21044 catalog_manager.cc:5697] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 15, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 15 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.700939 21044 catalog_manager.cc:5697] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 18, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 18 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.702478 21044 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 15 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 16 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.704089 21044 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 17 to 18, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 18 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.715706 21044 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.717025 21044 catalog_manager.cc:5697] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 16 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:56.718408 21044 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 9 to 15, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 15 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.719882 21045 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46294 (request call id 381) took 10766 ms. Trace:
I20260709 13:08:56.727631 21044 catalog_manager.cc:5697] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 16 to 18, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 18 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.729300 21044 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.731591 21044 catalog_manager.cc:5697] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.733069 21044 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 14 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:56.734462 21044 catalog_manager.cc:5697] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.735826 21044 catalog_manager.cc:5697] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 15 to 16, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.739151 21044 catalog_manager.cc:5697] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.720361 21045 rpcz_store.cc:276] 0709 13:08:45.953975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.987760 (+ 33785us) service_pool.cc:224] Handling call
0709 13:08:56.719809 (+10732049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:55.785053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:55.785767 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:55.785816 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:08:55.785850 (+    34us) tablet.cc:662] Decoding operations
0709 13:08:55.787051 (+  1201us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:55.787140 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:55.787170 (+    30us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:55.805023 (+ 17853us) tablet.cc:701] Row locks acquired
0709 13:08:55.805068 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:08:55.805248 (+   180us) write_op.cc:270] Start()
0709 13:08:55.805390 (+   142us) write_op.cc:276] Timestamp: P: 1783602535805185 usec, L: 0
0709 13:08:55.805421 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:55.806126 (+   705us) log.cc:844] Serialized 4782 byte log entry
0709 13:08:56.155880 (+349754us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.474809 (+318929us) write_op.cc:301] APPLY: starting
0709 13:08:56.478924 (+  4115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:56.554196 (+ 75272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:56.554322 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:56.615687 (+ 61365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:56.616050 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:56.616114 (+    64us) write_op.cc:312] APPLY: finished
0709 13:08:56.616484 (+   370us) log.cc:844] Serialized 113 byte log entry
0709 13:08:56.618460 (+  1976us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.618597 (+   137us) write_op.cc:454] Released schema lock
0709 13:08:56.618658 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:56.647497 (+ 28839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.647534 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1198,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":236888,"apply.run_cpu_time_us":16976,"apply.run_wall_time_us":203843,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54335,"num_ops":12,"prepare.queue_time_us":102780,"prepare.run_cpu_time_us":23555,"prepare.run_wall_time_us":94565,"raft.queue_time_us":127290,"raft.run_cpu_time_us":36577,"raft.run_wall_time_us":300244,"replication_time_us":305361,"thread_start_us":293721,"threads_started":4,"wal-append.queue_time_us":121613}]]}
I20260709 13:08:56.740682 21044 catalog_manager.cc:5697] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 15 to 19, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 19 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.756202 21044 catalog_manager.cc:5697] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 17, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 17 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:56.764074 21044 catalog_manager.cc:5697] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 5 to 14, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 14 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.765498 21044 catalog_manager.cc:5697] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 15, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 15 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.767086 21044 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.768360 21044 catalog_manager.cc:5697] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 15 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.769601 21044 catalog_manager.cc:5697] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 14 to 18, leader changed from 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 18 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.771021 21044 catalog_manager.cc:5697] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 15, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 15 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.781769 21044 catalog_manager.cc:5697] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.783560 21044 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 13, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.785228 21044 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.787020 21044 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 10 to 15, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:56.804072 21044 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 12, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 12 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.806233 21044 catalog_manager.cc:5697] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 4 to 14, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.807812 21044 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } }
I20260709 13:08:56.899209 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.952921 21044 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46318 (request call id 379) took 1349 ms. Trace:
I20260709 13:08:56.956908 21044 rpcz_store.cc:276] 0709 13:08:55.616735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.617151 (+   416us) service_pool.cc:224] Handling call
0709 13:08:56.951689 (+1334538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:56.849362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:56.854946 (+  5584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:56.854984 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:56.855003 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:56.859866 (+  4863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:56.859951 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:56.859985 (+    34us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:08:56.867127 (+  7142us) tablet.cc:701] Row locks acquired
0709 13:08:56.867148 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:56.867319 (+   171us) write_op.cc:270] Start()
0709 13:08:56.867444 (+   125us) write_op.cc:276] Timestamp: P: 1783602536867250 usec, L: 0
0709 13:08:56.867465 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:56.868279 (+   814us) log.cc:844] Serialized 11605 byte log entry
0709 13:08:56.872177 (+  3898us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.872505 (+   328us) write_op.cc:301] APPLY: starting
0709 13:08:56.872582 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:56.891517 (+ 18935us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:56.891615 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:56.921442 (+ 29827us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:56.921763 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:08:56.921811 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:56.922277 (+   466us) log.cc:844] Serialized 260 byte log entry
0709 13:08:56.923029 (+   752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.923303 (+   274us) write_op.cc:454] Released schema lock
0709 13:08:56.923363 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:56.945273 (+ 21910us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.945307 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":32824,"apply.run_wall_time_us":72713,"cfile_cache_hit":120,"cfile_cache_hit_bytes":125520,"num_ops":30,"prepare.queue_time_us":22823,"prepare.run_cpu_time_us":7102,"prepare.run_wall_time_us":22716,"replication_time_us":4558,"spinlock_wait_cycles":2432,"thread_start_us":9781,"threads_started":1}]]}
I20260709 13:08:56.956266 21048 catalog_manager.cc:5697] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 12 to 13, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 13 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.962191 21048 catalog_manager.cc:5697] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 10 to 11, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 11 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:56.978891 21146 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:56.981485 27192 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:57.001359 21048 catalog_manager.cc:5697] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.004421 21048 catalog_manager.cc:5697] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 10 to 12, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 12 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.006258 21048 catalog_manager.cc:5697] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.009155 21048 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.012480 21219 raft_consensus.cc:1275] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:57.018992 21048 catalog_manager.cc:5697] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 11 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 14 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.021028 26954 consensus_queue.cc:1048] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:57.021821 21048 catalog_manager.cc:5697] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 11 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 14 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.094942 21044 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:08:57.093951 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff8a809ecee49028cc5d6587518d7c8"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:57.113685 21142 raft_consensus.cc:606] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:57.114092 21142 raft_consensus.cc:614] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.127880 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "7c5246dc52bb49f38aef22aba1467452"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:57.128535 21142 raft_consensus.cc:606] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Received request to transfer leadership to TS 7c5246dc52bb49f38aef22aba1467452
I20260709 13:08:57.128937 21142 raft_consensus.cc:614] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.131817 21142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d142716765ff4750912c13d99d61a1df"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:57.132426 21142 raft_consensus.cc:606] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:57.135138 21224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:08:57.135658 21048 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 258) took 2289 ms. Trace:
I20260709 13:08:57.135735 21224 raft_consensus.cc:606] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:57.139775 21146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef66c45b466e4acb83723f82bb2be36e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:43736
I20260709 13:08:57.140327 21146 raft_consensus.cc:606] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:57.140651 21146 raft_consensus.cc:614] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.141758 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:57.143512 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:57.136160 21048 rpcz_store.cc:276] 0709 13:08:54.846108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.846249 (+   141us) service_pool.cc:224] Handling call
0709 13:08:57.135556 (+2289307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:57.033983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:57.034601 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:57.034632 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:08:57.034651 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:57.035554 (+   903us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:57.035628 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:57.035662 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:57.036309 (+   647us) tablet.cc:701] Row locks acquired
0709 13:08:57.036327 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:57.036445 (+   118us) write_op.cc:270] Start()
0709 13:08:57.036544 (+    99us) write_op.cc:276] Timestamp: P: 1783602537036404 usec, L: 0
0709 13:08:57.036563 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.037168 (+   605us) log.cc:844] Serialized 3194 byte log entry
0709 13:08:57.044064 (+  6896us) op_driver.cc:464] REPLICATION: finished
0709 13:08:57.044524 (+   460us) write_op.cc:301] APPLY: starting
0709 13:08:57.044636 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:57.049252 (+  4616us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:57.049350 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.054560 (+  5210us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.054782 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:57.054828 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:57.055105 (+   277us) log.cc:844] Serialized 81 byte log entry
0709 13:08:57.060234 (+  5129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.067695 (+  7461us) write_op.cc:454] Released schema lock
0709 13:08:57.071909 (+  4214us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:57.081671 (+  9762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.082454 (+   783us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23710,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":125,"apply.run_cpu_time_us":11494,"apply.run_wall_time_us":31614,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33472,"num_ops":8,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":3456,"prepare.run_wall_time_us":10542,"replication_time_us":7358}]]}
I20260709 13:08:57.241150 21046 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 11 to 13, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 13 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.284749 21046 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.333859 21048 catalog_manager.cc:5697] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 7 to 12, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 12 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.336220 21048 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 13 to 17, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 17 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
W20260709 13:08:57.393625 21046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 366) took 13286 ms (client timeout 15000 ms). Trace:
W20260709 13:08:57.394099 21046 rpcz_store.cc:269] 0709 13:08:44.107176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.107428 (+   252us) service_pool.cc:224] Handling call
0709 13:08:57.323332 (+13215904us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.323354 (+    22us) write_op.cc:454] Released schema lock
0709 13:08:57.393536 (+ 70182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:57.312347 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:57.312912 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:57.312955 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:08:57.312974 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:57.313456 (+   482us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:57.313511 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:57.313541 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:57.313887 (+   346us) tablet.cc:701] Row locks acquired
0709 13:08:57.313908 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:57.314058 (+   150us) write_op.cc:270] Start()
0709 13:08:57.314182 (+   124us) write_op.cc:276] Timestamp: P: 1783602537314012 usec, L: 0
0709 13:08:57.314205 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.314844 (+   639us) log.cc:844] Serialized 913 byte log entry
0709 13:08:57.316819 (+  1975us) op_driver.cc:464] REPLICATION: finished
0709 13:08:57.317708 (+   889us) write_op.cc:301] APPLY: starting
0709 13:08:57.317782 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:57.319018 (+  1236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:57.319104 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.320385 (+  1281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.320535 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:57.320586 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:57.320766 (+   180us) log.cc:844] Serialized 33 byte log entry
0709 13:08:57.320910 (+   144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.320984 (+    74us) write_op.cc:454] Released schema lock
0709 13:08:57.321023 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":744883,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":633,"apply.run_cpu_time_us":3558,"apply.run_wall_time_us":3559,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2766,"prepare.run_wall_time_us":2768,"replication_time_us":2501}]]}
I20260709 13:08:57.474494 26990 raft_consensus.cc:993] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:08:57.474972 26990 raft_consensus.cc:1081] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:08:57.480000 21814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d142716765ff4750912c13d99d61a1df"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:08:57.482164 21814 raft_consensus.cc:493] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.483635 21814 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.498800 21814 raft_consensus.cc:515] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:57.518205 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:57.518833 21146 raft_consensus.cc:3055] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:57.519135 21146 raft_consensus.cc:740] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:57.519932 21146 consensus_queue.cc:260] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:57.521104 21146 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.523365 21814 leader_election.cc:290] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:57.523224 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d142716765ff4750912c13d99d61a1df" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:57.524030 21293 raft_consensus.cc:3060] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.542546 21146 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:57.543800 21776 leader_election.cc:304] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208; no voters: 
I20260709 13:08:57.545629 27239 raft_consensus.cc:2804] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:57.546876 27239 raft_consensus.cc:697] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:57.553285 21293 raft_consensus.cc:2468] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:08:57.554378 27239 consensus_queue.cc:237] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:57.556788 27149 raft_consensus.cc:993] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:57.557289 27149 raft_consensus.cc:1081] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:57.560148 21142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:40476
I20260709 13:08:57.560722 21142 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.561048 21142 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:57.579356 21047 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 257) took 18017 ms (client timeout 15000 ms). Trace:
W20260709 13:08:57.579798 21047 rpcz_store.cc:269] 0709 13:08:39.550967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.551385 (+   418us) service_pool.cc:224] Handling call
0709 13:08:39.712404 (+161019us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54003e3ad4. stack: 00007f2b6ac5b343 00007f2b6ac5b240 00007f2b6a5ea1d4 00007f2b74328304 00007f2b74328299 00007f2b6dce4090 00007f2b6dd82f3a 00007f2b73b391cc 00007f2b73c3737e 00007f2b720f82a4 00007f2b720f8232 00007f2b720f8161 00007f2b720f80dc 00007f2b720f7392 00007f2b6c0b548c 00007f2b6c0b48c6
0709 13:08:57.567793 (+17855389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2724,"reported_tablets":44,"spinlock_wait_cycles":74867072}
I20260709 13:08:57.605840 21046 catalog_manager.cc:5697] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 15 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.612177 21142 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:57.618088 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:57.619395 21224 raft_consensus.cc:3055] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:57.618867 21142 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:57.619709 21224 raft_consensus.cc:740] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:08:57.625626 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:57.626180 21292 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.625137 21224 consensus_queue.cc:260] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:57.630537 21224 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.651765 21224 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:57.653097 21114 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:57.653489 21292 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 15.
I20260709 13:08:57.653997 26990 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:57.654549 26990 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:57.655509 26990 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:57.686348 21046 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 14 to 15, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 15 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.941942 21142 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:57.946982 27239 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:58.047894 21292 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:58.062835 27197 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:58.129514 21224 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:58.131053 27197 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:58.132920 21299 raft_consensus.cc:1275] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:58.137380 26954 consensus_queue.cc:1048] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:58.153605 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:58.257035 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 51007.3us
I20260709 13:08:59.295289 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.699795 21292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:37454
I20260709 13:08:59.700431 21292 raft_consensus.cc:606] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:59.716187 21292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54d06546a96347e488abe4e862d0425b"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:37454
I20260709 13:08:59.717586 21292 raft_consensus.cc:606] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:59.733412 21299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:37454
I20260709 13:08:59.733979 21299 raft_consensus.cc:606] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Received request to transfer leadership to TS 5e66e7254b764832b244bb5b07b4a208
I20260709 13:08:59.743577 21299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17"
dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
mode: GRACEFUL
new_leader_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:37454
I20260709 13:08:59.744206 21299 raft_consensus.cc:606] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Received request to transfer leadership to TS 3585d99c303e453c8c3762b294caba4e
I20260709 13:08:59.745368 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:59.746850 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:59.798735 27164 raft_consensus.cc:993] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:08:59.804558 27164 raft_consensus.cc:1081] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Signalling peer 5e66e7254b764832b244bb5b07b4a208 to start an election
I20260709 13:08:59.808230 21812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451"
dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
 from {username='slave'} at 127.0.0.1:52758
I20260709 13:08:59.808755 21812 raft_consensus.cc:493] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.809074 21812 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.809191 27164 raft_consensus.cc:993] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:59.809688 27195 raft_consensus.cc:1081] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:59.811457 21142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:08:59.811951 21142 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.812296 21142 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.816954 21812 raft_consensus.cc:515] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:59.819721 21812 leader_election.cc:290] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:59.819939 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "3585d99c303e453c8c3762b294caba4e"
I20260709 13:08:59.822472 21146 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.824280 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:59.824899 21292 raft_consensus.cc:3055] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:59.825212 21292 raft_consensus.cc:740] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:59.827894 21292 consensus_queue.cc:260] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:59.829283 21292 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.831579 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b6c321dab4a71866dd41996aca451" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:59.832093 21224 raft_consensus.cc:3060] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.842159 21224 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:59.879598 27195 raft_consensus.cc:993] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:59.880113 27195 raft_consensus.cc:1081] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:08:59.881909 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:08:59.882447 21144 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.882802 21144 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.883523 21146 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:59.884771 21142 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:59.887405 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:08:59.887866 21224 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.891338 21144 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:59.891719 21776 leader_election.cc:304] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:59.893481 21144 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Requested vote from peers 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:08:59.894732 27199 raft_consensus.cc:2804] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:59.895243 27199 raft_consensus.cc:697] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:08:59.896164 27199 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:59.903995 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:59.904592 21299 raft_consensus.cc:3055] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:59.913156 21224 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:59.904848 21299 raft_consensus.cc:740] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:59.916956 21114 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:08:59.917078 21299 consensus_queue.cc:260] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:08:59.918474 21299 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.928623 26900 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.929435 26900 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:59.930567 26900 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:59.939144 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:08:59.944494 21142 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:08:59.958539 21298 raft_consensus.cc:3055] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:59.958943 21298 raft_consensus.cc:740] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:08:59.962186 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:08:59.962975 21812 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.953517 21299 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:59.957119 21292 raft_consensus.cc:2468] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:08:59.969647 21116 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:08:59.977201 21298 consensus_queue.cc:260] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:08:59.980228 21298 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.990594 21812 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 17.
I20260709 13:08:59.992141 21298 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 13.
I20260709 13:08:59.997598 27197 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:59.998143 27197 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:08:59.999053 27197 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:00.015530 21116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 47669.5us
I20260709 13:09:00.009996 21045 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 14 to 15, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 15 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.077668 21046 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 12 to 13, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 13 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.127197 27164 raft_consensus.cc:993] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: : Instructing follower 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:09:00.127919 27164 raft_consensus.cc:1081] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Signalling peer 3585d99c303e453c8c3762b294caba4e to start an election
I20260709 13:09:00.129994 21144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54d06546a96347e488abe4e862d0425b"
dest_uuid: "3585d99c303e453c8c3762b294caba4e"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:00.130535 21144 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.130884 21144 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.138121 21144 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:00.141115 21298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:00.141676 21298 raft_consensus.cc:3055] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:00.141963 21298 raft_consensus.cc:740] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:00.142107 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "3585d99c303e453c8c3762b294caba4e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:00.142732 21219 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.143640 21144 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:00.142726 21298 consensus_queue.cc:260] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:00.153947 21298 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.167490 21219 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 19.
I20260709 13:09:00.168773 21114 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:00.169613 27267 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:00.170090 27267 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 19 LEADER]: Becoming Leader. State: Replica: 3585d99c303e453c8c3762b294caba4e, State: Running, Role: LEADER
I20260709 13:09:00.171134 21298 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3585d99c303e453c8c3762b294caba4e in term 19.
I20260709 13:09:00.170885 27267 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:00.277503 21046 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 16 to 17, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 17 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.283110 21046 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e reported cstate change: term changed from 18 to 19, leader changed from 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3) to 3585d99c303e453c8c3762b294caba4e (127.19.145.1). New cstate: current_term: 19 leader_uuid: "3585d99c303e453c8c3762b294caba4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.351083 21142 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:00.353854 27199 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:00.418175 21292 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:00.420351 27268 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:00.460850 21298 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:00.462473 27197 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.480618 21219 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:00.482411 27197 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.486577 21299 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:09:00.497996 21224 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:00.501004 27199 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:00.494001 27197 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:09:00.580569 21226 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:00.587458 27266 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:09:00.656654 21299 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:00.678174 27287 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:09:00.706806 21811 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Refusing update from remote peer 3585d99c303e453c8c3762b294caba4e: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:09:00.729009 26900 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:00.747692 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.872475 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
W20260709 13:09:00.905305 21776 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:09:00.939586 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.947896 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.952739 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.961448 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.965073 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.965118 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.987387 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.041131 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.044679 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.047118 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.050956 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.062865 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:01.064476 20036 tablet_replica.cc:333] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.066572 20036 raft_consensus.cc:2243] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.067694 20036 raft_consensus.cc:2272] T 99d11247a80d4fb5b4034e0a238c9388 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.070449 20036 tablet_replica.cc:333] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.076373 20036 raft_consensus.cc:2243] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.079586 20036 raft_consensus.cc:2272] T d142716765ff4750912c13d99d61a1df P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.082437 20036 tablet_replica.cc:333] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.086431 20036 raft_consensus.cc:2243] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.087703 20036 raft_consensus.cc:2272] T 19d2a839d8cf43eea500e735e58a9e28 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.104544 20036 tablet_replica.cc:333] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.105463 20036 raft_consensus.cc:2243] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.106118 20036 raft_consensus.cc:2272] T 198128dc1acc4c9bbe56ff48a07e23a4 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.109164 20036 tablet_replica.cc:333] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.114007 20036 raft_consensus.cc:2243] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.115012 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.123705 20036 raft_consensus.cc:2272] T c2308648f35c4faf94816331179c44aa P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.126812 20036 tablet_replica.cc:333] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
W20260709 13:09:01.133980 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.135874 20036 raft_consensus.cc:2243] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.137050 20036 raft_consensus.cc:2272] T 398cfd943855433fb7159548a64fbe6e P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.140621 20036 tablet_replica.cc:333] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.141403 20036 raft_consensus.cc:2243] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.142091 20036 raft_consensus.cc:2272] T 1eb23cad4ade4afea24324bfae738314 P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.163478 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.164698 20036 tablet_replica.cc:333] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.165688 20036 raft_consensus.cc:2243] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.166288 20036 raft_consensus.cc:2272] T ddef3aae03e94e30acb5d8592f3f75b2 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.168862 20036 tablet_replica.cc:333] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.169783 20036 raft_consensus.cc:2243] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.170774 20036 raft_consensus.cc:2272] T df140636c4344f32a0253fef2a907c50 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.187165 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.187817 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.193578 20036 tablet_replica.cc:333] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.194399 20036 raft_consensus.cc:2243] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.195144 20036 raft_consensus.cc:2272] T 3dee37f119694b8cbc658fd3b84b0563 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.195580 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.198720 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.204716 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.199396 20036 tablet_replica.cc:333] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.207749 20036 raft_consensus.cc:2243] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:09:01.214393 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.215309 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.216626 20036 raft_consensus.cc:2272] T 33f9268b51e14a8d82c0377b1596e9ce P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.221161 20036 tablet_replica.cc:333] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.222088 20036 raft_consensus.cc:2243] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.222792 20036 raft_consensus.cc:2272] T f13baf7007c44fb5a2efa7e30933caf3 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.236024 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.242077 20036 tablet_replica.cc:333] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.247069 20036 raft_consensus.cc:2243] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.247699 20036 raft_consensus.cc:2272] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.250538 20036 tablet_replica.cc:333] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.251415 20036 raft_consensus.cc:2243] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.252403 20036 raft_consensus.cc:2272] T a40ec5c131174be78b99773258d3da3b P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.254581 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.254940 20036 tablet_replica.cc:333] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.255839 20036 raft_consensus.cc:2243] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.264644 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.267671 20036 raft_consensus.cc:2272] T aff8a809ecee49028cc5d6587518d7c8 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.270095 20036 tablet_replica.cc:333] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.270725 20036 raft_consensus.cc:2243] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.271327 20036 raft_consensus.cc:2272] T 688a48cc2bc64a7a9e78bf41a84d44ca P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.273901 20036 tablet_replica.cc:333] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.276288 20036 raft_consensus.cc:2243] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.277082 20036 raft_consensus.cc:2272] T ac63da274d954b86ab071da6f6b5148c P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.283459 20036 tablet_replica.cc:333] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.286540 20036 raft_consensus.cc:2243] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.287961 20036 raft_consensus.cc:2272] T 574f49e93265460891ff981be2cee774 P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.293326 20036 tablet_replica.cc:333] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.294119 20036 raft_consensus.cc:2243] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.294682 20036 raft_consensus.cc:2272] T 28d3af139eae4d85981a3afde9289604 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.305186 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.307991 20036 tablet_replica.cc:333] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.308892 20036 raft_consensus.cc:2243] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.309612 20036 raft_consensus.cc:2272] T e8a59065e5d64bc09a27e51c9955775d P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.324165 20036 tablet_replica.cc:333] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.327020 20036 raft_consensus.cc:2243] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.328773 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.329053 20036 raft_consensus.cc:2272] T 02e32a83beeb475fa3edaac416334c5d P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.334813 20036 tablet_replica.cc:333] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.335865 20036 raft_consensus.cc:2243] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.336584 20036 raft_consensus.cc:2272] T 8fc62cd1660e437688d81540b9af858b P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.340245 20036 tablet_replica.cc:333] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.340824 20036 raft_consensus.cc:2243] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.348832 20036 raft_consensus.cc:2272] T ef66c45b466e4acb83723f82bb2be36e P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.362735 20036 tablet_replica.cc:333] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
W20260709 13:09:01.384837 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.392021 20036 raft_consensus.cc:2243] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.392685 20036 raft_consensus.cc:2272] T 7a837dff96224f8b8795bace63448d84 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.395218 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.395359 20036 tablet_replica.cc:333] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.397927 20036 raft_consensus.cc:2243] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.401230 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.398794 20036 raft_consensus.cc:2272] T 6b9b6c321dab4a71866dd41996aca451 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.417177 20036 tablet_replica.cc:333] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.418020 20036 raft_consensus.cc:2243] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.419165 20036 raft_consensus.cc:2272] T 3c0599d67fb34b91a3afc1c32163efa4 P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.421787 20036 tablet_replica.cc:333] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.422525 20036 raft_consensus.cc:2243] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:09:01.433669 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.447638 20036 raft_consensus.cc:2272] T 6bbfab1f26fc47bab947744fba7cf062 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.450573 20036 tablet_replica.cc:333] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.451387 20036 raft_consensus.cc:2243] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.455569 20036 raft_consensus.cc:2272] T 425aa4009f134d7c94f0050facfd0811 P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.461766 20036 tablet_replica.cc:333] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.462566 20036 raft_consensus.cc:2243] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.476061 20036 raft_consensus.cc:2272] T 116d5e82da354208af66a0e6f7a51dcf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.478837 20036 tablet_replica.cc:333] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.500737 20036 raft_consensus.cc:2243] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.501492 20036 raft_consensus.cc:2272] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.506604 20036 tablet_replica.cc:333] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.507563 20036 raft_consensus.cc:2243] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.508616 20036 raft_consensus.cc:2272] T e2494cfa0b6749f6b7ba55475fc2cf68 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.511241 20036 tablet_replica.cc:333] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.536154 20036 raft_consensus.cc:2243] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.537228 20036 raft_consensus.cc:2272] T b58884ca99bd494292202a75faf1833c P 3585d99c303e453c8c3762b294caba4e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.540581 20036 tablet_replica.cc:333] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.541452 20036 raft_consensus.cc:2243] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.542040 20036 raft_consensus.cc:2272] T aa95e198a0404e91adecdec5338443a0 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.544731 20036 tablet_replica.cc:333] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.545675 20036 raft_consensus.cc:2243] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.546340 20036 raft_consensus.cc:2272] T 5cca46a22ac5436d9438fe96be0e2fbe P 3585d99c303e453c8c3762b294caba4e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.548940 20036 tablet_replica.cc:333] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.549808 20036 raft_consensus.cc:2243] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.550695 20036 raft_consensus.cc:2272] T 2fc65b57b7ce480581c0933f52538838 P 3585d99c303e453c8c3762b294caba4e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.553426 20036 tablet_replica.cc:333] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.558986 20036 raft_consensus.cc:2243] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.560032 20036 raft_consensus.cc:2272] T 54d06546a96347e488abe4e862d0425b P 3585d99c303e453c8c3762b294caba4e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.575599 20036 tablet_replica.cc:333] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.576761 20036 raft_consensus.cc:2243] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.577914 20036 raft_consensus.cc:2272] T 217f5315ea524ce28a596c2aa95cb43f P 3585d99c303e453c8c3762b294caba4e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.592466 20036 tablet_replica.cc:333] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.593292 20036 raft_consensus.cc:2243] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.593959 20036 raft_consensus.cc:2272] T 09568f2c2c854929b369d24083d81717 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.608341 20036 tablet_replica.cc:333] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.609031 20036 raft_consensus.cc:2243] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.609944 20036 raft_consensus.cc:2272] T a4a7d35cd96a44f7ab838841678c5b17 P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.611915 20036 tablet_replica.cc:333] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.612440 20036 raft_consensus.cc:2243] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.613308 20036 raft_consensus.cc:2272] T 67fb461d83104dcc8a40aac647f74899 P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.617336 20036 tablet_replica.cc:333] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.618008 20036 raft_consensus.cc:2243] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.618713 20036 raft_consensus.cc:2272] T fccd55284a3547968acf752c8d6f9f4d P 3585d99c303e453c8c3762b294caba4e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.621150 20036 tablet_replica.cc:333] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.621837 20036 raft_consensus.cc:2243] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.623312 20036 raft_consensus.cc:2272] T 68ebd645703043ddb9e32ba2d84bbc1e P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.631203 20036 tablet_replica.cc:333] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.631870 20036 raft_consensus.cc:2243] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.632402 20036 raft_consensus.cc:2272] T 17378a57c1c3434a8411ab6894114acb P 3585d99c303e453c8c3762b294caba4e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.635103 20036 tablet_replica.cc:333] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.635763 20036 raft_consensus.cc:2243] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.636755 20036 raft_consensus.cc:2272] T 9f88661ef8d64aa7893277b13b46ff04 P 3585d99c303e453c8c3762b294caba4e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.639319 20036 tablet_replica.cc:333] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e: stopping tablet replica
I20260709 13:09:01.639925 20036 raft_consensus.cc:2243] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.641688 20036 raft_consensus.cc:2272] T 34b1f4f16adf4e74a88911d4906d95bf P 3585d99c303e453c8c3762b294caba4e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.147182 27295 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.147914 27295 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.175091 27295 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.182387 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.191362 27255 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.191979 27255 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.194545 27255 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.196327 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.198879 27255 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.200397 27255 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.204100 27255 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.205408 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.211946 21811 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:09:02.214105 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:02.216234 27271 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:02.224941 27271 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.225638 27271 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.228713 27195 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.229249 27195 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.235358 27195 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:02.235599 21263 leader_election.cc:336] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.236377 27295 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.236887 27295 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.240447 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.241055 21299 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 17.
I20260709 13:09:02.242342 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:02.243224 27199 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:02.243634 27199 raft_consensus.cc:493] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.244006 27199 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.276291 27295 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:02.280838 21776 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.281302 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:09:02.283308 21189 leader_election.cc:336] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.283922 21189 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:09:02.288079 27295 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:02.292127 27255 raft_consensus.cc:2749] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:02.296986 21189 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.301774 27271 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.303617 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.311151 27199 raft_consensus.cc:515] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.313396 27302 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.336585 27286 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
W20260709 13:09:02.338011 21776 leader_election.cc:336] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.340567 27302 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.349469 27302 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.347016 27286 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.352339 27286 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:02.353536 21263 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.348766 27271 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.355755 21814 raft_consensus.cc:2393] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 18: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
I20260709 13:09:02.359349 27199 leader_election.cc:290] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.363541 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.363807 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.364259 21264 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:09:02.365449 27302 raft_consensus.cc:3060] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.375079 27302 raft_consensus.cc:2749] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:02.379231 21264 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:09:02.380836 27195 raft_consensus.cc:2749] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:02.387681 21189 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:02.391916 21776 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.392321 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:02.393093 27295 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:02.394419 21776 leader_election.cc:336] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.395870 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398cfd943855433fb7159548a64fbe6e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:02.402479 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f9268b51e14a8d82c0377b1596e9ce" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:09:02.403048 21814 raft_consensus.cc:3060] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.404119 21299 raft_consensus.cc:2468] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 18.
I20260709 13:09:02.409955 21814 raft_consensus.cc:2468] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 18.
I20260709 13:09:02.421468 21778 leader_election.cc:304] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.422442 27308 raft_consensus.cc:2804] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:02.423470 21190 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.424292 27271 raft_consensus.cc:2804] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:02.424832 27271 raft_consensus.cc:697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:09:02.426052 27308 raft_consensus.cc:697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:02.429325 27302 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.429843 27302 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.427062 27308 consensus_queue.cc:237] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.431784 27271 consensus_queue.cc:237] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.435240 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.436506 27302 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:02.440869 21263 leader_election.cc:336] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.441327 21263 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:09:02.442492 27302 raft_consensus.cc:2749] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:02.476445 27199 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.477005 27199 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.478359 27195 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.478895 27199 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.478890 27195 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.482033 27195 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.485646 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.486301 21219 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
W20260709 13:09:02.487371 21263 leader_election.cc:336] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.488159 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.488552 27195 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.488993 27195 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.492374 27195 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.493384 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:09:02.493947 21776 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.494163 21811 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:09:02.494949 27195 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:02.495425 27195 raft_consensus.cc:493] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.495350 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:02.495980 27195 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.503123 27302 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:02.503602 27302 raft_consensus.cc:493] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.503961 27302 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.508813 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.516917 21047 catalog_manager.cc:5697] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 17 to 18, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 18 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.517676 27302 raft_consensus.cc:515] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.518929 21299 raft_consensus.cc:2393] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e66e7254b764832b244bb5b07b4a208 in current term 13: Already voted for candidate 7c5246dc52bb49f38aef22aba1467452 in this term.
I20260709 13:09:02.520776 21778 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:09:02.521843 27308 raft_consensus.cc:3060] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.528314 27302 leader_election.cc:290] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.528771 27307 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.528900 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0599d67fb34b91a3afc1c32163efa4" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:09:02.529309 27307 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.535465 27307 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:02.543166 21189 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:02.543929 21263 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.544962 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.545627 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 12.
I20260709 13:09:02.546991 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.548039 27271 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:02.548445 27271 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.548834 27271 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.550462 27308 raft_consensus.cc:2749] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:02.552503 27199 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.552999 27199 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.557013 27199 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.558292 27271 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.520043 27195 raft_consensus.cc:515] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:09:02.560135 21263 leader_election.cc:336] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.557468 21814 raft_consensus.cc:2468] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:09:02.567094 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:09:02.571475 21776 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.571784 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d11247a80d4fb5b4034e0a238c9388" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:09:02.577821 21811 raft_consensus.cc:3060] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.578605 21264 leader_election.cc:304] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
W20260709 13:09:02.579735 21189 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.581565 27302 raft_consensus.cc:2804] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.572870 21299 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:09:02.582084 27302 raft_consensus.cc:697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:02.582979 27302 consensus_queue.cc:237] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.585464 21811 raft_consensus.cc:2468] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 13.
I20260709 13:09:02.586436 21190 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.567456 27271 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.587731 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.588850 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ec5c131174be78b99773258d3da3b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:02.589105 27199 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:02.589459 21219 raft_consensus.cc:3060] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.591763 27282 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.592284 27282 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.589506 27199 raft_consensus.cc:493] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.595619 27199 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.576196 27195 leader_election.cc:290] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.597831 21045 catalog_manager.cc:5697] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 17 to 18, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 18 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.600350 21219 raft_consensus.cc:2468] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:09:02.588063 27255 raft_consensus.cc:2804] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.606226 27255 raft_consensus.cc:697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:09:02.607147 27255 consensus_queue.cc:237] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.594478 27282 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:02.603657 21263 leader_election.cc:336] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.615054 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:09:02.616556 21263 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.605268 27199 raft_consensus.cc:515] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.620375 27199 leader_election.cc:290] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.621177 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140636c4344f32a0253fef2a907c50" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:02.621714 21299 raft_consensus.cc:3060] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.627023 21263 leader_election.cc:304] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.628214 27282 raft_consensus.cc:2804] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:02.628751 27282 raft_consensus.cc:697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:02.629727 27282 consensus_queue.cc:237] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.634791 21299 raft_consensus.cc:2468] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:09:02.636040 21778 leader_election.cc:304] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:02.637748 27309 raft_consensus.cc:2804] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.638270 27309 raft_consensus.cc:697] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:02.639143 27309 consensus_queue.cc:237] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.648643 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:02.649844 27195 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:02.657488 21047 catalog_manager.cc:5697] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 13, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 13 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.654507 21045 catalog_manager.cc:5697] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 12 to 13, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 13 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:02.661314 21776 leader_election.cc:336] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.694805 21045 catalog_manager.cc:5697] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.709510 21047 catalog_manager.cc:5697] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 12 to 13, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 13 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.765117 27309 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.765798 27309 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.767196 27302 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.767841 27302 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.769919 27302 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.772063 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.778855 27271 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.779407 27271 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.782146 27271 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.784581 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.785220 21814 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 11.
I20260709 13:09:02.786314 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:09:02.788305 21776 leader_election.cc:336] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:02.788437 21263 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.788900 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:02.791457 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.792696 27302 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:02.792963 21778 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:09:02.793706 21189 leader_election.cc:336] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.794173 27199 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:02.794209 21189 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:09:02.795416 27255 raft_consensus.cc:2749] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:02.795683 27271 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.796237 27271 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.798858 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.799564 21224 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:09:02.800505 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.801193 21291 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:09:02.802320 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:02.803151 27255 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:02.803637 27255 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.804024 27255 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:02.815182 27309 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.819236 27254 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.823838 27254 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.825989 27254 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:02.826469 21189 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.827370 27271 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.828964 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.834064 27295 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.834635 27295 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.836773 27295 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.839690 21291 raft_consensus.cc:1275] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:09:02.841076 27309 consensus_queue.cc:1048] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:09:02.845561 21189 leader_election.cc:336] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.846019 21189 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:09:02.842902 27255 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.856530 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.860107 27255 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.860343 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbfab1f26fc47bab947744fba7cf062" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:02.860931 21291 raft_consensus.cc:3060] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:02.854809 27271 raft_consensus.cc:2749] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:02.857005 27282 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.865101 27282 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.869010 27282 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.870653 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.871387 21226 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 19.
I20260709 13:09:02.875952 21291 raft_consensus.cc:2468] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:09:02.877235 21191 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:02.883421 27271 raft_consensus.cc:2804] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:02.883962 27271 raft_consensus.cc:697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:09:02.885528 27271 consensus_queue.cc:237] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.886303 27313 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.886826 27313 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.890966 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:02.892858 27282 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:02.893246 27282 raft_consensus.cc:493] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.893610 27282 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:02.901664 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:09:02.902010 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.903522 21189 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:02.904520 21776 leader_election.cc:336] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.904997 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:02.905191 27313 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:02.906275 27255 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.906744 27255 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.907802 27282 raft_consensus.cc:515] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.908619 27255 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.909703 27282 leader_election.cc:290] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:02.910192 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:09:02.910163 21263 leader_election.cc:336] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:02.911921 21263 leader_election.cc:336] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.915453 27309 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:02.917791 21264 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, 5e66e7254b764832b244bb5b07b4a208
I20260709 13:09:02.919832 27302 raft_consensus.cc:2749] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:02.920445 27302 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.920897 27302 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.926640 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.927240 21814 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:09:02.930999 27302 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:02.936587 20036 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21172)
I20260709 13:09:02.941974 21045 catalog_manager.cc:5697] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 15 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 16 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:02.951421 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.952384 27199 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.953275 27309 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.953814 27309 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.955852 27309 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:02.958981 21263 leader_election.cc:336] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.961887 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:02.962627 21224 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 11.
I20260709 13:09:02.957576 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:02.963495 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d06546a96347e488abe4e862d0425b" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:02.963667 21299 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 18.
I20260709 13:09:02.964041 21226 raft_consensus.cc:3060] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:02.965082 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:02.967646 27308 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:02.968087 27308 raft_consensus.cc:493] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.968535 27308 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.969619 27255 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.970078 27255 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:02.972782 27255 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:02.973351 21293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
W20260709 13:09:02.979420 21776 leader_election.cc:336] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.979562 27308 raft_consensus.cc:515] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.952860 27199 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:02.985342 21263 leader_election.cc:336] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:02.987668 27271 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.988175 27271 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:02.990865 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:02.991526 21814 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:09:02.992898 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:02.994110 27254 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:02.994500 27254 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:02.994877 27254 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.978988 21226 raft_consensus.cc:2468] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 20.
I20260709 13:09:02.998405 27271 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:02.998538 21189 leader_election.cc:336] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.000021 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:03.000607 21299 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:09:03.001572 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:03.002298 27309 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.002744 27309 raft_consensus.cc:493] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.003114 27309 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.006809 27199 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:03.010113 21814 raft_consensus.cc:1275] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:02.991564 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:02.998972 21189 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
I20260709 13:09:03.011806 27307 consensus_queue.cc:1048] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:03.013375 27307 raft_consensus.cc:2749] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.014336 27302 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:03.014761 27302 raft_consensus.cc:493] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.015161 27302 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.020123 27309 raft_consensus.cc:515] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:03.023752 27282 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.024223 27282 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.026042 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116d5e82da354208af66a0e6f7a51dcf" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:03.026598 21299 raft_consensus.cc:3060] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.026890 27282 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:03.031872 27307 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.032379 27307 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.033960 21299 raft_consensus.cc:2468] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:09:03.034960 21778 leader_election.cc:304] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:03.035730 27199 raft_consensus.cc:2804] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:03.036531 27199 raft_consensus.cc:697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:03.040249 21293 raft_consensus.cc:1275] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:03.042542 27295 consensus_queue.cc:1048] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:03.038899 27307 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:03.006698 27254 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:03.050074 27282 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.050724 27282 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.051991 27254 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:03.053220 27282 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:03.053855 27308 leader_election.cc:290] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:03.054809 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217f5315ea524ce28a596c2aa95cb43f" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:03.055501 21292 raft_consensus.cc:3060] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.058759 21263 leader_election.cc:304] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.062760 27309 leader_election.cc:290] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:03.064090 21292 raft_consensus.cc:2468] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 19.
I20260709 13:09:03.064595 27199 consensus_queue.cc:237] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:03.065119 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb461d83104dcc8a40aac647f74899" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:09:03.065727 21814 raft_consensus.cc:3060] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:03.066701 21189 leader_election.cc:336] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.071321 21189 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e, 7c5246dc52bb49f38aef22aba1467452
W20260709 13:09:03.072522 21776 leader_election.cc:336] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.073206 21776 leader_election.cc:336] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.082433 21814 raft_consensus.cc:2468] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 17.
I20260709 13:09:03.083614 21224 raft_consensus.cc:1275] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:03.084717 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
I20260709 13:09:03.085274 21226 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:09:03.087131 21778 leader_election.cc:304] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.087575 21190 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:03.089569 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:03.090721 21291 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 15.
I20260709 13:09:03.091353 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" is_pre_election: true
W20260709 13:09:03.089550 21263 leader_election.cc:336] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.087761 27282 raft_consensus.cc:2804] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:03.084226 27307 raft_consensus.cc:2749] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.105576 27195 consensus_queue.cc:1048] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:03.107475 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.111498 27195 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.112109 27195 raft_consensus.cc:493] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.112461 27195 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.113838 21226 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:09:03.106765 27282 raft_consensus.cc:697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 20 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:03.120704 27295 raft_consensus.cc:2804] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:03.120293 27282 consensus_queue.cc:237] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.121258 27295 raft_consensus.cc:697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 19 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:03.122303 27295 consensus_queue.cc:237] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:03.124402 21189 leader_election.cc:336] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.128435 27302 raft_consensus.cc:515] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:03.094499 27329 raft_consensus.cc:2804] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:03.136004 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 50671.4us
W20260709 13:09:03.150451 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 63397.3us
I20260709 13:09:03.150517 27329 raft_consensus.cc:697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:09:03.152577 27329 consensus_queue.cc:237] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:03.159287 21776 leader_election.cc:336] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.162492 21189 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.163872 21189 leader_election.cc:336] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.164877 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.177362 27302 leader_election.cc:290] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:03.179731 21191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:44115, user_credentials={real_user=slave}} blocked reactor thread for 85471.5us
I20260709 13:09:03.180521 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.184372 27254 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:03.184738 27254 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.185075 27254 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.186815 21814 raft_consensus.cc:1275] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:03.162387 27195 raft_consensus.cc:515] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.191479 27195 leader_election.cc:290] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:03.191248 21045 catalog_manager.cc:5697] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 13 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 14 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.201346 27254 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.203610 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
I20260709 13:09:03.204219 21814 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.210105 27254 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:03.215726 21291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2494cfa0b6749f6b7ba55475fc2cf68" candidate_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:03.216454 21291 raft_consensus.cc:3060] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.217346 21814 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:09:03.226864 21291 raft_consensus.cc:2468] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81bf1abd0b34f518d1f2b79cc4dba77 in term 16.
I20260709 13:09:03.233646 21191 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
I20260709 13:09:03.235167 27255 raft_consensus.cc:2804] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:03.236038 27255 raft_consensus.cc:697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Becoming Leader. State: Replica: f81bf1abd0b34f518d1f2b79cc4dba77, State: Running, Role: LEADER
I20260709 13:09:03.243078 27255 consensus_queue.cc:237] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.249226 21814 raft_consensus.cc:1275] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:03.250751 27195 consensus_queue.cc:1048] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:03.256268 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.261020 21045 catalog_manager.cc:5697] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 18 to 19, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 19 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.266196 21047 catalog_manager.cc:5697] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 16 to 17, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 17 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.269279 27340 consensus_queue.cc:1048] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:03.270309 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 162937us
W20260709 13:09:03.276525 21263 leader_election.cc:336] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.285099 21189 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:03.296424 21219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ebd645703043ddb9e32ba2d84bbc1e" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:03.296514 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.297256 21219 raft_consensus.cc:3060] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.298278 27195 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.298808 27195 raft_consensus.cc:493] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3585d99c303e453c8c3762b294caba4e)
I20260709 13:09:03.299274 27195 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.300009 21226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b1f4f16adf4e74a88911d4906d95bf" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:03.300740 21226 raft_consensus.cc:3060] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.305946 21219 raft_consensus.cc:2468] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:09:03.323949 21226 raft_consensus.cc:2468] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
I20260709 13:09:03.337914 27195 raft_consensus.cc:515] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:03.352108 21045 catalog_manager.cc:5697] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 reported cstate change: term changed from 15 to 16, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2). New cstate: current_term: 16 leader_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.356801 27195 leader_election.cc:290] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Requested vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:03.401162 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.445497 21291 raft_consensus.cc:1275] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:03.465659 27329 consensus_queue.cc:1048] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:03.489650 21045 catalog_manager.cc:5697] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 19 to 20, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 20 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.502112 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 188630us
W20260709 13:09:03.495004 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.502915 21263 leader_election.cc:304] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:09:03.503238 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.504683 27347 raft_consensus.cc:2804] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:03.505306 27347 raft_consensus.cc:697] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:03.506309 27347 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:03.507741 21189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 46134us
W20260709 13:09:03.514602 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.515058 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.514364 21263 leader_election.cc:304] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 
W20260709 13:09:03.518178 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.518677 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.524173 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.529452 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.539110 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.543865 27348 raft_consensus.cc:2804] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:03.546520 27348 raft_consensus.cc:697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:03.547444 27348 consensus_queue.cc:237] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:09:03.551757 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.556100 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.563975 21224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a7d35cd96a44f7ab838841678c5b17" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77"
I20260709 13:09:03.564662 21224 raft_consensus.cc:3060] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:03.566761 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.568840 21263 leader_election.cc:336] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.569650 21263 leader_election.cc:336] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.570389 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.570783 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.571704 21224 raft_consensus.cc:2468] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 14.
W20260709 13:09:03.584296 21263 leader_election.cc:336] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:03.585081 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.593319 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.603036 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.609124 21263 leader_election.cc:304] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77; no voters: 3585d99c303e453c8c3762b294caba4e
I20260709 13:09:03.610369 27346 raft_consensus.cc:2804] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:03.610855 27346 raft_consensus.cc:697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
I20260709 13:09:03.611675 27346 consensus_queue.cc:237] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
W20260709 13:09:03.619827 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.622237 21045 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 11 to 12, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 12 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.627481 21224 raft_consensus.cc:1275] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 20 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:09:03.631628 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.634805 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.645344 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.645264 27313 consensus_queue.cc:1048] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:03.678467 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.681161 21291 raft_consensus.cc:1275] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:03.683744 27331 consensus_queue.cc:1048] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:03.686196 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.686822 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.709910 21292 raft_consensus.cc:1275] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:03.712357 21292 raft_consensus.cc:1275] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:03.717422 27307 consensus_queue.cc:1048] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:03.721277 27331 consensus_queue.cc:1048] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:03.723999 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.738507 21045 catalog_manager.cc:5697] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.742156 21045 catalog_manager.cc:5697] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 13 to 14, leader changed from 3585d99c303e453c8c3762b294caba4e (127.19.145.1) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 14 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.748315 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.753939 21811 raft_consensus.cc:1275] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Refusing update from remote peer f81bf1abd0b34f518d1f2b79cc4dba77: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:03.758157 27339 consensus_queue.cc:1048] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:03.779719 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.819708 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.822763 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.852443 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.874125 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.897650 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.928478 21814 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:03.930351 27346 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:03.937148 20036 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21172)
I20260709 13:09:03.975015 21218 raft_consensus.cc:1275] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:09:04.029047 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.090190 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:46145, user_credentials={real_user=slave}} blocked reactor thread for 61195.2us
I20260709 13:09:04.101284 27313 consensus_queue.cc:1048] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:04.112964 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.113966 21218 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:04.115594 21224 raft_consensus.cc:1275] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:09:04.116384 21263 consensus_peers.cc:597] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.118077 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.133299 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.139187 27313 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:04.139921 27348 consensus_queue.cc:1048] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:04.141983 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.146241 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.146656 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.286849 21291 consensus_queue.cc:237] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:04.299433 21812 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:04.300740 27362 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:04.310725 21219 raft_consensus.cc:1275] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Refusing update from remote peer 7c5246dc52bb49f38aef22aba1467452: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:04.323096 27313 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:09:04.340951 27348 consensus_queue.cc:1048] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:09:04.341708 21812 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:09:04.358213 21035 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68ebd645703043ddb9e32ba2d84bbc1e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:04.359059 21219 raft_consensus.cc:2955] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:09:04.378523 21047 catalog_manager.cc:5697] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: config changed from index 5 to 10, VOTER 3585d99c303e453c8c3762b294caba4e (127.19.145.1) evicted. New cstate: current_term: 12 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:04.486588 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:04.937592 20036 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:05.265829 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.719372 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.732467 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:05.819391 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:05.927024 21189 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111) [suppressed 400 similar messages]
W20260709 13:09:05.931928 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.938308 20036 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:05.970947 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:05.986563 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.049592 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.104146 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.124085 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.129951 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.159392 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.178467 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.191131 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.201198 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.201864 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.203038 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.218137 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.243744 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.249114 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.333760 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.341300 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.344067 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.375367 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.392016 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.398694 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.430246 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.452201 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.474340 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.478173 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.493222 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.506646 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.520190 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.535844 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.650123 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.671451 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.694613 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.727387 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.746790 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.759313 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.821672 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:06.830307 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.875473 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.938885 20036 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:07.055673 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.234597 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.334185 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.906493 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.945906 20036 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:08.304183 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.327191 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.458182 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.481796 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.519464 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.520138 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.549768 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.553457 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.555546 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.580960 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.628611 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.643208 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.689368 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.730791 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.736936 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.734699 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.790915 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.820214 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.821352 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.836242 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.840826 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.841372 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.851105 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.857661 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.901489 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.937332 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:08.946646 20036 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:08.967415 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:08.993685 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.039985 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.062696 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.068794 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.108855 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.136798 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.141371 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.184914 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.296880 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.305272 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.323088 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.325850 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.358877 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.382818 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.776376 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.776952 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.802235 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:09.947129 20036 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:10.412632 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.630425 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800366300 after lost signal to thread 20039
W20260709 13:09:10.631553 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800362220 after lost signal to thread 21083
W20260709 13:09:10.632834 21321 debug-util.cc:398] Leaking SignalData structure 0x7b0800355740 after lost signal to thread 21250
W20260709 13:09:10.633894 21321 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8ac0 after lost signal to thread 21324
W20260709 13:09:10.635161 21321 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3c00 after lost signal to thread 21838
W20260709 13:09:10.691527 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.786998 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.799065 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.821692 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.939656 21263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 13:09:10.947615 20036 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:11.021459 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.052430 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.071137 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.093616 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.116438 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.144699 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.190310 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.194104 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.223909 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.226671 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.227375 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.299997 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.369092 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.399288 21190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 46306.1us
W20260709 13:09:11.413797 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.427440 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.431147 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.442058 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.456032 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.477409 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.516156 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.529785 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.530311 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.546638 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.560051 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.633666 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.713574 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.728276 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.766465 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.784060 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.845898 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.861475 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.896251 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.902640 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.948474 20036 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:11.960493 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:11.970376 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:12.090430 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.107158 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:12.296916 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:12.330586 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:12.652971 21263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 71694.2us
W20260709 13:09:12.948975 20036 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:13.093472 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.130693 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:13.320020 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.350580 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.415930 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.457036 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.540493 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.588987 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.602851 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.638773 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.720086 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.740466 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.768052 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.792184 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.804785 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.812285 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.816062 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.828928 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.855736 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.857556 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.893452 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.921510 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.933045 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.949893 20036 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 21172)
I20260709 13:09:13.953099 21812 consensus_queue.cc:237] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:13.974086 21299 raft_consensus.cc:1275] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Refusing update from remote peer 5e66e7254b764832b244bb5b07b4a208: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:13.975912 27403 consensus_queue.cc:1048] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:13.981101 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.006237 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:14.015684 27403 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:09:14.018363 21299 raft_consensus.cc:2955] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } } }
I20260709 13:09:14.029343 21034 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b9b6c321dab4a71866dd41996aca451 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:09:14.039425 21046 catalog_manager.cc:5697] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: config changed from index 4 to 11, VOTER f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) evicted. New cstate: current_term: 15 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.086568 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.090993 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:14.128762 21210 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b9b6c321dab4a71866dd41996aca451 with delete_type TABLET_DATA_TOMBSTONED (TS f81bf1abd0b34f518d1f2b79cc4dba77 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55540
W20260709 13:09:14.149089 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:14.151723 27416 tablet_replica.cc:333] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:14.155849 27416 raft_consensus.cc:2243] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:14.156946 27416 raft_consensus.cc:2272] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:14.163229 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:14.165706 27416 ts_tablet_manager.cc:1916] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:14.220270 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:14.226604 27416 ts_tablet_manager.cc:1929] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:09:14.227295 27416 log.cc:1199] T 6b9b6c321dab4a71866dd41996aca451 P f81bf1abd0b34f518d1f2b79cc4dba77: Deleting WAL directory at /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/wals/6b9b6c321dab4a71866dd41996aca451
W20260709 13:09:14.229029 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:14.229390 21033 catalog_manager.cc:5028] TS f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): tablet 6b9b6c321dab4a71866dd41996aca451 (table test-workload [id=dc30fc3f506248fa8e0cc004a6e7fa74]) successfully deleted
W20260709 13:09:14.250846 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.308097 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.379295 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.402806 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.418731 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.434194 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.457912 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.483273 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.511440 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.696067 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.713045 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.742373 21189 consensus_peers.cc:597] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.796208 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.831077 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:14.950383 20036 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 21172)
W20260709 13:09:15.166558 21776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:43757, user_credentials={real_user=slave}} blocked reactor thread for 73730.6us
W20260709 13:09:15.754861 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:15.840010 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:15.845851 21189 consensus_peers.cc:597] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.909307 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.931835 21189 consensus_peers.cc:597] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:15.935169 21189 consensus_peers.cc:597] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:15.946585 21263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260709 13:09:16.034556 21189 consensus_peers.cc:597] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.144760 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.168218 21189 consensus_peers.cc:597] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.184648 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.202096 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.216708 21189 consensus_peers.cc:597] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.281515 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.282269 21189 consensus_peers.cc:597] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.298637 21189 consensus_peers.cc:597] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.308202 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:16.346001 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.420632 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.425133 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.428087 21189 consensus_peers.cc:597] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.428714 21189 consensus_peers.cc:597] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:16.440554 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
W20260709 13:09:16.463055 21189 consensus_peers.cc:597] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.464255 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.494997 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.520674 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.595664 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.601832 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.618088 21189 consensus_peers.cc:597] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.651384 21189 consensus_peers.cc:597] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.651969 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.717097 21263 consensus_peers.cc:597] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.784842 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.818168 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
W20260709 13:09:16.837504 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.869143 21263 consensus_peers.cc:597] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.873073 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.874063 21189 consensus_peers.cc:597] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:16.879433 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.939543 21263 consensus_peers.cc:597] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.949882 21263 consensus_peers.cc:597] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.962062 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:16.970952 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:16.972884 20036 tablet_replica.cc:333] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:16.973899 20036 raft_consensus.cc:2243] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.975544 20036 raft_consensus.cc:2272] T 99d11247a80d4fb5b4034e0a238c9388 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.978756 20036 tablet_replica.cc:333] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:16.979753 20036 raft_consensus.cc:2243] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.981047 20036 raft_consensus.cc:2272] T 198128dc1acc4c9bbe56ff48a07e23a4 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.989646 21776 consensus_peers.cc:597] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.991706 21263 consensus_peers.cc:597] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.998495 20036 tablet_replica.cc:333] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:16.999588 20036 raft_consensus.cc:2243] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.000754 20036 raft_consensus.cc:2272] T 08a13eedafd74dabb8f0219f4c7e9288 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.003664 20036 tablet_replica.cc:333] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.004611 20036 raft_consensus.cc:2243] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.005191 20036 raft_consensus.cc:2272] T 1eb23cad4ade4afea24324bfae738314 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.005311 21263 consensus_peers.cc:597] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.013186 21263 consensus_peers.cc:597] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.016556 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.012688 20036 tablet_replica.cc:333] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.024149 20036 raft_consensus.cc:2243] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.024827 20036 raft_consensus.cc:2272] T e36ad000b4a9410f80c7796396b878f5 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.027842 20036 tablet_replica.cc:333] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.028676 20036 raft_consensus.cc:2243] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.029309 20036 raft_consensus.cc:2272] T ddef3aae03e94e30acb5d8592f3f75b2 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.032186 20036 tablet_replica.cc:333] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.033004 20036 raft_consensus.cc:2243] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:09:17.036932 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.043913 20036 raft_consensus.cc:2272] T 3dee37f119694b8cbc658fd3b84b0563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.045102 21776 consensus_peers.cc:597] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.046792 20036 tablet_replica.cc:333] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.047773 20036 raft_consensus.cc:2243] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.048621 20036 raft_consensus.cc:2272] T 0a0495c200ee4175916ed50c64ff61a7 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.047323 21263 consensus_peers.cc:597] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.050663 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.053848 20036 tablet_replica.cc:333] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.060232 20036 raft_consensus.cc:2243] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.063141 20036 raft_consensus.cc:2272] T 33f9268b51e14a8d82c0377b1596e9ce P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.066696 20036 tablet_replica.cc:333] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.067608 20036 raft_consensus.cc:2243] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.068838 20036 raft_consensus.cc:2272] T f13baf7007c44fb5a2efa7e30933caf3 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.074287 20036 tablet_replica.cc:333] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.075152 20036 raft_consensus.cc:2243] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.075831 20036 raft_consensus.cc:2272] T fe2e5a8d491c4a22ac81fce79a27a7ea P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.078528 20036 tablet_replica.cc:333] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.079375 20036 raft_consensus.cc:2243] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.080307 20036 raft_consensus.cc:2272] T c22f29b50b474596adeb0f179b9eb385 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.084287 20036 tablet_replica.cc:333] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.090963 20036 raft_consensus.cc:2243] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.091935 20036 raft_consensus.cc:2272] T a40ec5c131174be78b99773258d3da3b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.094753 20036 tablet_replica.cc:333] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.095569 20036 raft_consensus.cc:2243] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.096642 20036 raft_consensus.cc:2272] T 5918dc9de89b4d149ecb2548872e4642 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.099813 20036 tablet_replica.cc:333] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.100612 20036 raft_consensus.cc:2243] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:17.108136 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:17.109427 20036 raft_consensus.cc:2272] T aff8a809ecee49028cc5d6587518d7c8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.114543 21263 consensus_peers.cc:597] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:17.115374 20036 tablet_replica.cc:333] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
W20260709 13:09:17.116629 21263 consensus_peers.cc:597] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.117538 20036 raft_consensus.cc:2243] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.117614 21776 consensus_peers.cc:597] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.118463 20036 raft_consensus.cc:2272] T ac63da274d954b86ab071da6f6b5148c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.118989 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.121536 20036 tablet_replica.cc:333] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.122476 20036 raft_consensus.cc:2243] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.123742 20036 raft_consensus.cc:2272] T 574f49e93265460891ff981be2cee774 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.133322 20036 tablet_replica.cc:333] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.134366 20036 raft_consensus.cc:2243] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.135649 20036 raft_consensus.cc:2272] T e8a59065e5d64bc09a27e51c9955775d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.138599 20036 tablet_replica.cc:333] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.139454 20036 raft_consensus.cc:2243] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.140606 20036 raft_consensus.cc:2272] T 02e32a83beeb475fa3edaac416334c5d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.148025 21263 consensus_peers.cc:597] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.153131 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.164280 20036 tablet_replica.cc:333] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
W20260709 13:09:17.167179 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.165261 20036 raft_consensus.cc:2243] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.168004 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.175554 21263 consensus_peers.cc:597] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.178858 20036 raft_consensus.cc:2272] T 8fc62cd1660e437688d81540b9af858b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.181926 20036 tablet_replica.cc:333] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
W20260709 13:09:17.182375 21776 consensus_peers.cc:597] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.182844 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.188381 20036 raft_consensus.cc:2243] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.195775 20036 raft_consensus.cc:2272] T 0ede0f4ec7554d9597f6e9c64ce23e46 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.198452 20036 tablet_replica.cc:333] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.199205 20036 raft_consensus.cc:2243] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.200686 21263 consensus_peers.cc:597] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.200994 20036 raft_consensus.cc:2272] T 7a837dff96224f8b8795bace63448d84 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.204047 20036 tablet_replica.cc:333] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.204880 20036 raft_consensus.cc:2243] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.205513 20036 raft_consensus.cc:2272] T 5e7b1fec990b4785a3b45b520909244c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.207589 20036 tablet_replica.cc:333] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.208395 20036 raft_consensus.cc:2243] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.208978 20036 raft_consensus.cc:2272] T 605603ac2631443292cd7278cf055b51 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.211575 20036 tablet_replica.cc:333] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.218461 20036 raft_consensus.cc:2243] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.222947 20036 raft_consensus.cc:2272] T 67929a23f7cc4a9a8f64f854df93b149 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.225754 20036 tablet_replica.cc:333] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.226645 20036 raft_consensus.cc:2243] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.228629 20036 raft_consensus.cc:2272] T 98b79eeda2784ff4ac1d2f6696c48563 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.232472 20036 tablet_replica.cc:333] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
W20260709 13:09:17.239058 21263 consensus_peers.cc:597] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.244933 20036 raft_consensus.cc:2243] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.245597 20036 raft_consensus.cc:2272] T b58884ca99bd494292202a75faf1833c P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.252076 20036 tablet_replica.cc:333] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.252808 20036 raft_consensus.cc:2243] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.254558 20036 raft_consensus.cc:2272] T e2494cfa0b6749f6b7ba55475fc2cf68 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.258209 20036 tablet_replica.cc:333] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
W20260709 13:09:17.260210 21263 consensus_peers.cc:597] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.261898 20036 raft_consensus.cc:2243] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.262655 20036 raft_consensus.cc:2272] T 5cca46a22ac5436d9438fe96be0e2fbe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.265246 20036 tablet_replica.cc:333] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.268347 20036 raft_consensus.cc:2243] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.270339 20036 raft_consensus.cc:2272] T ba1398186a7e4fe393aecbc014b953c9 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.288636 21776 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:17.293217 20036 tablet_replica.cc:333] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.345816 20036 raft_consensus.cc:2243] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.346639 20036 raft_consensus.cc:2272] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.352129 20036 tablet_replica.cc:333] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.353129 20036 raft_consensus.cc:2243] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.355887 20036 raft_consensus.cc:2272] T 6bbfab1f26fc47bab947744fba7cf062 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.362198 20036 tablet_replica.cc:333] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.362917 20036 raft_consensus.cc:2243] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.364099 20036 raft_consensus.cc:2272] T 54d06546a96347e488abe4e862d0425b P f81bf1abd0b34f518d1f2b79cc4dba77 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.366638 20036 tablet_replica.cc:333] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.367393 20036 raft_consensus.cc:2243] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.368975 20036 raft_consensus.cc:2272] T 09568f2c2c854929b369d24083d81717 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.373908 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:17.375874 20036 tablet_replica.cc:333] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.376832 20036 raft_consensus.cc:2243] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.411209 20036 raft_consensus.cc:2272] T 881a7cf58d404812aa274b116b666741 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.448158 20036 tablet_replica.cc:333] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.461556 20036 raft_consensus.cc:2243] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.477396 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:17.474802 20036 raft_consensus.cc:2272] T a4a7d35cd96a44f7ab838841678c5b17 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.485896 20036 tablet_replica.cc:333] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.487581 20036 raft_consensus.cc:2243] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.488768 20036 raft_consensus.cc:2272] T 67fb461d83104dcc8a40aac647f74899 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.489213 21264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:43709, user_credentials={real_user=slave}} blocked reactor thread for 107609us
I20260709 13:09:17.501207 20036 tablet_replica.cc:333] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.508585 20036 raft_consensus.cc:2243] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.509225 20036 raft_consensus.cc:2272] T fccd55284a3547968acf752c8d6f9f4d P f81bf1abd0b34f518d1f2b79cc4dba77 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.512526 20036 tablet_replica.cc:333] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.513288 20036 raft_consensus.cc:2243] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.513969 20036 raft_consensus.cc:2272] T 28a3e5fa488f4d4f813752adf6415abe P f81bf1abd0b34f518d1f2b79cc4dba77 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.517688 20036 tablet_replica.cc:333] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.518378 20036 raft_consensus.cc:2243] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.519709 20036 raft_consensus.cc:2272] T 68ebd645703043ddb9e32ba2d84bbc1e P f81bf1abd0b34f518d1f2b79cc4dba77 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.528862 20036 tablet_replica.cc:333] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.529641 20036 raft_consensus.cc:2243] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.530973 20036 raft_consensus.cc:2272] T aa95e198a0404e91adecdec5338443a0 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.533702 20036 tablet_replica.cc:333] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.534570 20036 raft_consensus.cc:2243] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.535557 20036 raft_consensus.cc:2272] T 19d2a839d8cf43eea500e735e58a9e28 P f81bf1abd0b34f518d1f2b79cc4dba77 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.539357 20036 tablet_replica.cc:333] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.541167 20036 raft_consensus.cc:2243] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.546644 20036 raft_consensus.cc:2272] T 34b1f4f16adf4e74a88911d4906d95bf P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.557828 20036 tablet_replica.cc:333] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77: stopping tablet replica
I20260709 13:09:17.558478 20036 raft_consensus.cc:2243] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.561134 20036 raft_consensus.cc:2272] T 17378a57c1c3434a8411ab6894114acb P f81bf1abd0b34f518d1f2b79cc4dba77 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.043409 27430 raft_consensus.cc:493] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.044457 27430 raft_consensus.cc:515] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:18.047052 27430 leader_election.cc:290] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.063478 21263 leader_election.cc:336] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.064807 21263 leader_election.cc:336] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.065307 21263 leader_election.cc:304] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.066123 27430 raft_consensus.cc:2749] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.067173 27425 raft_consensus.cc:493] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.067871 27425 raft_consensus.cc:515] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.070327 27425 leader_election.cc:290] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.072650 27430 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.073239 27430 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.076690 27430 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:18.107147 21263 leader_election.cc:336] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.110862 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:09:18.113078 21776 leader_election.cc:336] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.117058 21776 leader_election.cc:336] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.121246 21776 leader_election.cc:304] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.122573 27425 raft_consensus.cc:2749] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.129808 21264 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.131233 27430 raft_consensus.cc:2749] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.159198 27425 raft_consensus.cc:493] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.159797 27425 raft_consensus.cc:515] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.161947 27425 leader_election.cc:290] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.165206 27430 raft_consensus.cc:493] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.165781 27430 raft_consensus.cc:515] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:18.167887 27430 leader_election.cc:290] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.184055 21776 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.186975 21776 leader_election.cc:336] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.191735 21776 leader_election.cc:304] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:09:18.191165 21263 leader_election.cc:336] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.193562 21263 leader_election.cc:336] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.194080 27425 raft_consensus.cc:2749] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.195996 21263 leader_election.cc:304] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.199980 27430 raft_consensus.cc:2749] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:18.236815 21776 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:18.251600 21263 consensus_peers.cc:597] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.256242 27403 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.259804 27403 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.261879 27403 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.263149 21299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:18.263819 21299 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 15.
I20260709 13:09:18.265210 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.266047 27403 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.266381 27403 raft_consensus.cc:493] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.266711 27403 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.280007 27403 raft_consensus.cc:515] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.281786 27403 leader_election.cc:290] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.282725 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5918dc9de89b4d149ecb2548872e4642" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:18.283337 21292 raft_consensus.cc:3060] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:18.289656 21776 leader_election.cc:336] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.290422 21292 raft_consensus.cc:2468] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 16.
I20260709 13:09:18.297096 27429 raft_consensus.cc:493] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.308115 27429 raft_consensus.cc:515] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.310349 27429 leader_election.cc:290] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.312161 27430 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.312810 27430 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.315438 27430 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:18.316879 21778 leader_election.cc:304] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.317812 27434 raft_consensus.cc:2804] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:18.318308 27434 raft_consensus.cc:697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:18.319248 27434 consensus_queue.cc:237] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.339745 27430 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.339152 21045 catalog_manager.cc:5697] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 15 to 16, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 16 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.340408 27430 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.344151 27430 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:18.347249 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
W20260709 13:09:18.347481 21776 leader_election.cc:336] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.349349 27434 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.349869 27434 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.351737 27434 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.353240 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:18.353838 21292 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
W20260709 13:09:18.353981 21263 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.355095 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.356191 27434 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.356547 27434 raft_consensus.cc:493] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.356885 27434 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.363332 21264 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.362756 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:18.364307 27430 raft_consensus.cc:2749] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.365481 27434 raft_consensus.cc:515] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.368151 21808 raft_consensus.cc:2393] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c5246dc52bb49f38aef22aba1467452 in current term 14: Already voted for candidate 5e66e7254b764832b244bb5b07b4a208 in this term.
W20260709 13:09:18.369966 21263 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.373347 27434 leader_election.cc:290] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.375160 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b79eeda2784ff4ac1d2f6696c48563" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:18.375726 21292 raft_consensus.cc:3060] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.376873 21264 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
W20260709 13:09:18.378683 21776 leader_election.cc:336] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.380132 21776 leader_election.cc:336] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.380560 21776 leader_election.cc:304] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.381240 27403 raft_consensus.cc:2749] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:18.384203 21292 raft_consensus.cc:2468] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 14.
I20260709 13:09:18.385399 21778 leader_election.cc:304] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.385504 27430 raft_consensus.cc:2749] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.386302 27434 raft_consensus.cc:2804] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:18.387029 27434 raft_consensus.cc:697] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:18.390373 27434 consensus_queue.cc:237] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:18.391757 21776 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.400954 21776 leader_election.cc:336] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.416090 27429 raft_consensus.cc:493] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.417038 27429 raft_consensus.cc:515] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.420982 27429 leader_election.cc:290] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.424010 21776 leader_election.cc:336] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.430662 21776 leader_election.cc:336] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.431133 21776 leader_election.cc:304] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.432225 27429 raft_consensus.cc:2749] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.435895 21045 catalog_manager.cc:5697] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 13 to 14, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 14 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.436704 27434 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.447644 27434 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.451332 27430 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.451436 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:18.452171 21292 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 12.
I20260709 13:09:18.452047 27430 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.453331 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.454119 27429 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.454254 27430 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:18.454510 27429 raft_consensus.cc:493] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.454900 27429 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:18.461830 21263 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.463333 21776 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.463219 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:18.468815 21264 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 5e66e7254b764832b244bb5b07b4a208, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.470096 27430 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.475015 27434 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.466800 27429 raft_consensus.cc:515] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.480320 27403 raft_consensus.cc:493] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.480849 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a13eedafd74dabb8f0219f4c7e9288" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452"
I20260709 13:09:18.480819 27403 raft_consensus.cc:515] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.481485 21292 raft_consensus.cc:3060] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.482743 27403 leader_election.cc:290] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.488175 21292 raft_consensus.cc:2468] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 13.
I20260709 13:09:18.489321 21778 leader_election.cc:304] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.490077 27403 raft_consensus.cc:2804] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.490530 27403 raft_consensus.cc:697] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Becoming Leader. State: Replica: 5e66e7254b764832b244bb5b07b4a208, State: Running, Role: LEADER
I20260709 13:09:18.491398 27403 consensus_queue.cc:237] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.506662 27429 leader_election.cc:290] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:18.517040 21776 leader_election.cc:336] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.518638 21776 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.519681 21776 leader_election.cc:336] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.520058 21776 leader_election.cc:304] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.520707 27403 raft_consensus.cc:2749] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:18.531739 21045 catalog_manager.cc:5697] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 reported cstate change: term changed from 12 to 13, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4). New cstate: current_term: 13 leader_uuid: "5e66e7254b764832b244bb5b07b4a208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.539645 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:18.557883 27403 raft_consensus.cc:493] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.558399 27403 raft_consensus.cc:515] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.560348 27403 leader_election.cc:290] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.585229 21776 leader_election.cc:336] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.587183 21776 leader_election.cc:336] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.587716 21776 leader_election.cc:304] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.588528 27403 raft_consensus.cc:2749] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.606171 27403 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.606681 27403 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.608661 27403 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
I20260709 13:09:18.610677 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:18.614826 27430 raft_consensus.cc:493] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.615597 27430 raft_consensus.cc:515] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:18.617939 27430 leader_election.cc:290] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.623409 21263 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.628783 27403 raft_consensus.cc:493] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.629366 27403 raft_consensus.cc:515] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.631636 27403 leader_election.cc:290] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.628471 21263 leader_election.cc:336] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.632598 21263 leader_election.cc:304] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.633996 27430 raft_consensus.cc:2749] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.663769 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
I20260709 13:09:18.664650 27430 raft_consensus.cc:493] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.665500 27430 raft_consensus.cc:515] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:18.679991 27430 leader_election.cc:290] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.684641 27430 raft_consensus.cc:493] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.685220 27430 raft_consensus.cc:515] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } }
I20260709 13:09:18.689172 27426 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.689759 27426 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.692657 27426 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
W20260709 13:09:18.686534 21776 leader_election.cc:336] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.697726 21776 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.702911 27429 raft_consensus.cc:2749] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.699200 27430 leader_election.cc:290] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.703358 21776 leader_election.cc:336] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.707087 21776 leader_election.cc:336] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.717104 21776 leader_election.cc:304] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.721719 27403 raft_consensus.cc:2749] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.737347 27403 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.738127 27403 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.742493 21292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881a7cf58d404812aa274b116b666741" candidate_uuid: "5e66e7254b764832b244bb5b07b4a208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c5246dc52bb49f38aef22aba1467452" is_pre_election: true
I20260709 13:09:18.743150 21292 raft_consensus.cc:2468] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e66e7254b764832b244bb5b07b4a208 in term 11.
I20260709 13:09:18.744622 21778 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.745554 27429 raft_consensus.cc:2804] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:18.746030 27429 raft_consensus.cc:493] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.746408 27429 raft_consensus.cc:3060] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.750706 27403 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:18.788343 21263 leader_election.cc:336] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.789983 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208" is_pre_election: true
I20260709 13:09:18.791659 21808 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 12.
I20260709 13:09:18.790863 27429 raft_consensus.cc:515] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:18.796638 21776 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:18.797852 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.799191 27426 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.799606 27426 raft_consensus.cc:493] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.800027 27426 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:18.812964 21776 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.816481 21776 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.818571 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:09:18.827539 27426 raft_consensus.cc:515] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.836831 27426 leader_election.cc:290] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 5e66e7254b764832b244bb5b07b4a208 (127.19.145.4:43709)
I20260709 13:09:18.829161 27429 leader_election.cc:290] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Requested vote from peers f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757), 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115)
W20260709 13:09:18.842278 21776 consensus_peers.cc:597] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.844219 21776 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.844384 21263 leader_election.cc:336] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.844949 21263 leader_election.cc:304] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.845717 27426 raft_consensus.cc:2749] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.847077 21805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1398186a7e4fe393aecbc014b953c9" candidate_uuid: "7c5246dc52bb49f38aef22aba1467452" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e66e7254b764832b244bb5b07b4a208"
W20260709 13:09:18.847602 21263 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.847697 21805 raft_consensus.cc:3060] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:18.854285 21263 leader_election.cc:336] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.858094 21805 raft_consensus.cc:2468] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c5246dc52bb49f38aef22aba1467452 in term 13.
I20260709 13:09:18.859335 21264 leader_election.cc:304] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208, 7c5246dc52bb49f38aef22aba1467452; no voters: 
I20260709 13:09:18.860046 27426 raft_consensus.cc:2804] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:18.860066 21778 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.860716 27426 raft_consensus.cc:697] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Becoming Leader. State: Replica: 7c5246dc52bb49f38aef22aba1467452, State: Running, Role: LEADER
W20260709 13:09:18.862038 21778 consensus_peers.cc:597] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.855095 21263 leader_election.cc:336] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.861677 27426 consensus_queue.cc:237] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.862677 21263 leader_election.cc:304] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c5246dc52bb49f38aef22aba1467452; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.863533 27444 raft_consensus.cc:2749] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:18.867063 21778 leader_election.cc:336] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:18.867508 21778 leader_election.cc:304] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 7c5246dc52bb49f38aef22aba1467452, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.868239 27429 raft_consensus.cc:2749] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:09:18.869488 21778 consensus_peers.cc:597] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.872695 21263 consensus_peers.cc:597] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:18.873555 21263 leader_election.cc:336] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.879419 21263 consensus_peers.cc:597] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.885946 21045 catalog_manager.cc:5697] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 reported cstate change: term changed from 12 to 13, leader changed from f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2) to 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3). New cstate: current_term: 13 leader_uuid: "7c5246dc52bb49f38aef22aba1467452" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5246dc52bb49f38aef22aba1467452" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.907444 27403 raft_consensus.cc:493] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.907915 27403 raft_consensus.cc:515] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
W20260709 13:09:18.908394 21778 consensus_peers.cc:597] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.911988 27403 leader_election.cc:290] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.916894 21776 leader_election.cc:336] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.917652 21776 leader_election.cc:336] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.918092 21776 leader_election.cc:304] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.921514 27429 raft_consensus.cc:2749] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:18.923080 21263 consensus_peers.cc:597] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:18.923754 21778 consensus_peers.cc:597] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.925607 27429 raft_consensus.cc:493] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.926226 27429 raft_consensus.cc:515] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.928854 27403 raft_consensus.cc:493] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f81bf1abd0b34f518d1f2b79cc4dba77)
I20260709 13:09:18.929306 27403 raft_consensus.cc:515] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3585d99c303e453c8c3762b294caba4e" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 46145 } } peers { permanent_uuid: "f81bf1abd0b34f518d1f2b79cc4dba77" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 43757 } } peers { permanent_uuid: "5e66e7254b764832b244bb5b07b4a208" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 43709 } attrs { promote: false } }
I20260709 13:09:18.929713 27429 leader_election.cc:290] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
I20260709 13:09:18.931879 27403 leader_election.cc:290] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145), f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757)
W20260709 13:09:18.936098 21778 consensus_peers.cc:597] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.937139 21776 leader_election.cc:336] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:18.941941 21778 consensus_peers.cc:597] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.942683 21776 leader_election.cc:336] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
I20260709 13:09:18.943188 21776 leader_election.cc:304] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.943914 27403 raft_consensus.cc:2749] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:18.944069 21776 leader_election.cc:336] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111)
W20260709 13:09:18.945165 21776 leader_election.cc:336] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:18.945593 21776 leader_election.cc:304] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e66e7254b764832b244bb5b07b4a208; no voters: 3585d99c303e453c8c3762b294caba4e, f81bf1abd0b34f518d1f2b79cc4dba77
I20260709 13:09:18.946264 27403 raft_consensus.cc:2749] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:18.954527 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:18.956744 21776 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:18.957031 20036 tablet_replica.cc:333] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.958037 20036 raft_consensus.cc:2243] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.958775 20036 raft_consensus.cc:2272] T d142716765ff4750912c13d99d61a1df P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.961663 20036 tablet_replica.cc:333] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.962527 20036 raft_consensus.cc:2243] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.964901 20036 raft_consensus.cc:2272] T 28a3e5fa488f4d4f813752adf6415abe P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.967669 20036 tablet_replica.cc:333] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.968562 20036 raft_consensus.cc:2243] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.969478 20036 raft_consensus.cc:2272] T 0a0495c200ee4175916ed50c64ff61a7 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.975418 20036 tablet_replica.cc:333] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.976164 20036 raft_consensus.cc:2243] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.977140 20036 raft_consensus.cc:2272] T c2308648f35c4faf94816331179c44aa P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.979058 20036 tablet_replica.cc:333] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.979625 20036 raft_consensus.cc:2243] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.980101 20036 raft_consensus.cc:2272] T 08a13eedafd74dabb8f0219f4c7e9288 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.981958 20036 tablet_replica.cc:333] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.982479 20036 raft_consensus.cc:2243] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.983006 20036 raft_consensus.cc:2272] T 398cfd943855433fb7159548a64fbe6e P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.984820 20036 tablet_replica.cc:333] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.985344 20036 raft_consensus.cc:2243] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.986116 20036 raft_consensus.cc:2272] T 1eb23cad4ade4afea24324bfae738314 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.987882 20036 tablet_replica.cc:333] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.988446 20036 raft_consensus.cc:2243] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.989037 20036 raft_consensus.cc:2272] T e36ad000b4a9410f80c7796396b878f5 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.991223 20036 tablet_replica.cc:333] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.991818 20036 raft_consensus.cc:2243] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.992794 20036 raft_consensus.cc:2272] T ddef3aae03e94e30acb5d8592f3f75b2 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:18.994877 21776 consensus_peers.cc:597] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.995159 20036 tablet_replica.cc:333] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.995831 20036 raft_consensus.cc:2243] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.996357 20036 raft_consensus.cc:2272] T df140636c4344f32a0253fef2a907c50 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.998317 20036 tablet_replica.cc:333] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:18.998894 20036 raft_consensus.cc:2243] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.999505 20036 raft_consensus.cc:2272] T f13baf7007c44fb5a2efa7e30933caf3 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.001422 20036 tablet_replica.cc:333] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.001979 20036 raft_consensus.cc:2243] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.002864 20036 raft_consensus.cc:2272] T 688a48cc2bc64a7a9e78bf41a84d44ca P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.005299 20036 tablet_replica.cc:333] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.006074 20036 raft_consensus.cc:2243] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.007747 20036 raft_consensus.cc:2272] T ac63da274d954b86ab071da6f6b5148c P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.009855 20036 tablet_replica.cc:333] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.010586 20036 raft_consensus.cc:2243] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.011344 20036 raft_consensus.cc:2272] T 574f49e93265460891ff981be2cee774 P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.014638 20036 tablet_replica.cc:333] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.015367 20036 raft_consensus.cc:2243] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.016062 20036 raft_consensus.cc:2272] T 28d3af139eae4d85981a3afde9289604 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.018257 21776 consensus_peers.cc:597] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.019124 20036 tablet_replica.cc:333] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.019959 20036 raft_consensus.cc:2243] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.020349 21263 consensus_peers.cc:597] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:19.020653 20036 raft_consensus.cc:2272] T fe2e5a8d491c4a22ac81fce79a27a7ea P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.021452 21776 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:19.023386 20036 tablet_replica.cc:333] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.024240 20036 raft_consensus.cc:2243] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.025053 20036 raft_consensus.cc:2272] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.027582 20036 tablet_replica.cc:333] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.028257 20036 raft_consensus.cc:2243] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.029189 20036 raft_consensus.cc:2272] T c22f29b50b474596adeb0f179b9eb385 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.030952 20036 tablet_replica.cc:333] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.031613 20036 raft_consensus.cc:2243] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.032397 20036 raft_consensus.cc:2272] T a40ec5c131174be78b99773258d3da3b P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.034360 20036 tablet_replica.cc:333] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.034848 20036 raft_consensus.cc:2243] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.035332 20036 raft_consensus.cc:2272] T 5918dc9de89b4d149ecb2548872e4642 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.037240 20036 tablet_replica.cc:333] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.037739 20036 raft_consensus.cc:2243] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.038539 20036 raft_consensus.cc:2272] T 8fc62cd1660e437688d81540b9af858b P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.040472 20036 tablet_replica.cc:333] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.040964 20036 raft_consensus.cc:2243] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.041725 20036 raft_consensus.cc:2272] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.043656 20036 tablet_replica.cc:333] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.044150 20036 raft_consensus.cc:2243] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.044932 20036 raft_consensus.cc:2272] T ef66c45b466e4acb83723f82bb2be36e P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.046677 20036 tablet_replica.cc:333] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.047189 20036 raft_consensus.cc:2243] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.047971 20036 raft_consensus.cc:2272] T 5e7b1fec990b4785a3b45b520909244c P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.049762 20036 tablet_replica.cc:333] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.050251 20036 raft_consensus.cc:2243] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.050979 20036 raft_consensus.cc:2272] T 605603ac2631443292cd7278cf055b51 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.052857 20036 tablet_replica.cc:333] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.053386 20036 raft_consensus.cc:2243] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.054160 20036 raft_consensus.cc:2272] T 67929a23f7cc4a9a8f64f854df93b149 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.056152 20036 tablet_replica.cc:333] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.056808 20036 raft_consensus.cc:2243] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.057591 20036 raft_consensus.cc:2272] T 98b79eeda2784ff4ac1d2f6696c48563 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.060034 20036 tablet_replica.cc:333] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.060681 20036 raft_consensus.cc:2243] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.061483 21776 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:19.061781 20036 raft_consensus.cc:2272] T 3c0599d67fb34b91a3afc1c32163efa4 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.063863 20036 tablet_replica.cc:333] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.064397 20036 raft_consensus.cc:2243] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.064925 20036 raft_consensus.cc:2272] T e2494cfa0b6749f6b7ba55475fc2cf68 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.066965 20036 tablet_replica.cc:333] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.067644 20036 raft_consensus.cc:2243] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.068637 20036 raft_consensus.cc:2272] T 5cca46a22ac5436d9438fe96be0e2fbe P 7c5246dc52bb49f38aef22aba1467452 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.070873 20036 tablet_replica.cc:333] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.071604 20036 raft_consensus.cc:2243] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.072595 20036 pending_rounds.cc:70] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Trying to abort 1 pending ops.
I20260709 13:09:19.072834 20036 pending_rounds.cc:77] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452: Aborting op as it isn't in flight: id { term: 13 index: 11 } timestamp: 7305636081114107904 op_type: NO_OP noop_request { }
I20260709 13:09:19.073173 20036 raft_consensus.cc:2889] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.073496 20036 raft_consensus.cc:2272] T ba1398186a7e4fe393aecbc014b953c9 P 7c5246dc52bb49f38aef22aba1467452 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.076632 20036 tablet_replica.cc:333] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.077391 20036 raft_consensus.cc:2243] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.078343 20036 raft_consensus.cc:2272] T 425aa4009f134d7c94f0050facfd0811 P 7c5246dc52bb49f38aef22aba1467452 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.080714 20036 tablet_replica.cc:333] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.081372 20036 raft_consensus.cc:2243] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.082316 20036 raft_consensus.cc:2272] T c2fd6ed9ddd1486fa7a7ce6aa1ac1ca8 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.084124 21778 consensus_peers.cc:597] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.084653 20036 tablet_replica.cc:333] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.085253 20036 raft_consensus.cc:2243] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.086251 20036 raft_consensus.cc:2272] T 116d5e82da354208af66a0e6f7a51dcf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.088660 20036 tablet_replica.cc:333] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.089444 20036 raft_consensus.cc:2243] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.090106 20036 raft_consensus.cc:2272] T 6bbfab1f26fc47bab947744fba7cf062 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.092079 20036 tablet_replica.cc:333] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.092593 20036 raft_consensus.cc:2243] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.093111 20036 raft_consensus.cc:2272] T 6b9b6c321dab4a71866dd41996aca451 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.094808 20036 tablet_replica.cc:333] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.095337 20036 raft_consensus.cc:2243] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.095819 20036 raft_consensus.cc:2272] T 2fc65b57b7ce480581c0933f52538838 P 7c5246dc52bb49f38aef22aba1467452 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.097554 20036 tablet_replica.cc:333] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.098034 20036 raft_consensus.cc:2243] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.098771 20036 raft_consensus.cc:2272] T 54d06546a96347e488abe4e862d0425b P 7c5246dc52bb49f38aef22aba1467452 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.100764 20036 tablet_replica.cc:333] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.101289 20036 raft_consensus.cc:2243] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.102344 20036 raft_consensus.cc:2272] T 217f5315ea524ce28a596c2aa95cb43f P 7c5246dc52bb49f38aef22aba1467452 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.104673 20036 tablet_replica.cc:333] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
W20260709 13:09:19.104969 21263 consensus_peers.cc:597] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:19.105212 20036 raft_consensus.cc:2243] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.105858 20036 raft_consensus.cc:2272] T 09568f2c2c854929b369d24083d81717 P 7c5246dc52bb49f38aef22aba1467452 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.107758 20036 tablet_replica.cc:333] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.108234 20036 raft_consensus.cc:2243] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.108850 20036 raft_consensus.cc:2272] T 881a7cf58d404812aa274b116b666741 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.110622 20036 tablet_replica.cc:333] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.111075 20036 raft_consensus.cc:2243] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.111850 20036 raft_consensus.cc:2272] T a4a7d35cd96a44f7ab838841678c5b17 P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.113673 20036 tablet_replica.cc:333] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.114192 20036 raft_consensus.cc:2243] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.114988 20036 raft_consensus.cc:2272] T 68ebd645703043ddb9e32ba2d84bbc1e P 7c5246dc52bb49f38aef22aba1467452 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.117038 20036 tablet_replica.cc:333] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.117625 20036 raft_consensus.cc:2243] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.118580 20036 raft_consensus.cc:2272] T 34b1f4f16adf4e74a88911d4906d95bf P 7c5246dc52bb49f38aef22aba1467452 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.120375 20036 tablet_replica.cc:333] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452: stopping tablet replica
I20260709 13:09:19.120958 20036 raft_consensus.cc:2243] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.121351 20036 raft_consensus.cc:2272] T 9f88661ef8d64aa7893277b13b46ff04 P 7c5246dc52bb49f38aef22aba1467452 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.124197 21778 consensus_peers.cc:597] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.127540 21778 consensus_peers.cc:597] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.147598 21778 consensus_peers.cc:597] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.149123 21778 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.179527 21778 consensus_peers.cc:597] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.196092 21776 consensus_peers.cc:597] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:19.240585 21778 consensus_peers.cc:597] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:44115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.257175 21778 consensus_peers.cc:597] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:44115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.260167 21778 consensus_peers.cc:597] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:44115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.460762 21778 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 7c5246dc52bb49f38aef22aba1467452 (127.19.145.3:44115): Couldn't send request to peer 7c5246dc52bb49f38aef22aba1467452. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:44115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.471117 21776 consensus_peers.cc:597] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.474431 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.475522 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.485009 21776 consensus_peers.cc:597] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:19.629238 21776 consensus_peers.cc:597] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:19.649514 21776 consensus_peers.cc:597] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.669975 21776 consensus_peers.cc:597] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.677716 21776 consensus_peers.cc:597] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:19.681797 21776 consensus_peers.cc:597] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 -> Peer 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): Couldn't send request to peer 3585d99c303e453c8c3762b294caba4e. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:19.687191 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
W20260709 13:09:19.702162 21776 consensus_peers.cc:597] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.719905 21776 consensus_peers.cc:597] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.784792 20036 tablet_server.cc:179] TabletServer@127.19.145.4:0 shutting down...
I20260709 13:09:19.832041 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:19.832767 20036 tablet_replica.cc:333] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.833448 20036 raft_consensus.cc:2243] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.833993 20036 raft_consensus.cc:2272] T 881a7cf58d404812aa274b116b666741 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.836282 20036 tablet_replica.cc:333] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.836936 20036 raft_consensus.cc:2243] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.838008 20036 raft_consensus.cc:2272] T df140636c4344f32a0253fef2a907c50 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.840682 20036 tablet_replica.cc:333] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.841320 20036 raft_consensus.cc:2243] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.841797 20036 raft_consensus.cc:2272] T 425aa4009f134d7c94f0050facfd0811 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.842367 21776 consensus_peers.cc:597] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 -> Peer f81bf1abd0b34f518d1f2b79cc4dba77 (127.19.145.2:43757): Couldn't send request to peer f81bf1abd0b34f518d1f2b79cc4dba77. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.844269 20036 tablet_replica.cc:333] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.845067 20036 raft_consensus.cc:2243] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.845745 20036 raft_consensus.cc:2272] T 398cfd943855433fb7159548a64fbe6e P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.848146 20036 tablet_replica.cc:333] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.848690 20036 raft_consensus.cc:2243] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.849114 20036 raft_consensus.cc:2272] T 0a0495c200ee4175916ed50c64ff61a7 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.850875 20036 tablet_replica.cc:333] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.851467 20036 raft_consensus.cc:2243] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.851922 20036 raft_consensus.cc:2272] T 68ebd645703043ddb9e32ba2d84bbc1e P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.853808 20036 tablet_replica.cc:333] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.854408 20036 raft_consensus.cc:2243] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.855189 20036 raft_consensus.cc:2272] T 28a3e5fa488f4d4f813752adf6415abe P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.857218 20036 tablet_replica.cc:333] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.857714 20036 raft_consensus.cc:2243] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.858215 20036 raft_consensus.cc:2272] T 02e32a83beeb475fa3edaac416334c5d P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.859961 20036 tablet_replica.cc:333] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.860493 20036 raft_consensus.cc:2243] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.860904 20036 raft_consensus.cc:2272] T 67929a23f7cc4a9a8f64f854df93b149 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.862613 20036 tablet_replica.cc:333] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.863116 20036 raft_consensus.cc:2243] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.863651 20036 raft_consensus.cc:2272] T 3dee37f119694b8cbc658fd3b84b0563 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.865448 20036 tablet_replica.cc:333] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.866055 20036 raft_consensus.cc:2243] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.866653 20036 raft_consensus.cc:2272] T 28d3af139eae4d85981a3afde9289604 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.868391 20036 tablet_replica.cc:333] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.868909 20036 raft_consensus.cc:2243] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.869396 20036 raft_consensus.cc:2272] T 688a48cc2bc64a7a9e78bf41a84d44ca P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.871124 20036 tablet_replica.cc:333] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.871698 20036 raft_consensus.cc:2243] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.872355 20036 raft_consensus.cc:2272] T e36ad000b4a9410f80c7796396b878f5 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.874177 20036 tablet_replica.cc:333] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.874735 20036 raft_consensus.cc:2243] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.875171 20036 raft_consensus.cc:2272] T ba1398186a7e4fe393aecbc014b953c9 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.876942 20036 tablet_replica.cc:333] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.877502 20036 raft_consensus.cc:2243] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.878159 20036 raft_consensus.cc:2272] T 2fc65b57b7ce480581c0933f52538838 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.879896 20036 tablet_replica.cc:333] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.880434 20036 raft_consensus.cc:2243] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.881035 20036 raft_consensus.cc:2272] T d142716765ff4750912c13d99d61a1df P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.882769 20036 tablet_replica.cc:333] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.883329 20036 raft_consensus.cc:2243] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.883915 20036 raft_consensus.cc:2272] T 9f88661ef8d64aa7893277b13b46ff04 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.885667 20036 tablet_replica.cc:333] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.886235 20036 raft_consensus.cc:2243] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.886647 20036 raft_consensus.cc:2272] T 67fb461d83104dcc8a40aac647f74899 P 5e66e7254b764832b244bb5b07b4a208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.888429 20036 tablet_replica.cc:333] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.888931 20036 raft_consensus.cc:2243] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.889539 20036 raft_consensus.cc:2272] T 797a6a3b284c4ce2b664a3f7e63dfb7e P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.891364 20036 tablet_replica.cc:333] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.891897 20036 raft_consensus.cc:2243] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.892535 20036 raft_consensus.cc:2272] T fe2e5a8d491c4a22ac81fce79a27a7ea P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.894251 20036 tablet_replica.cc:333] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.894769 20036 raft_consensus.cc:2243] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.895498 20036 raft_consensus.cc:2272] T 0ede0f4ec7554d9597f6e9c64ce23e46 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.897620 20036 tablet_replica.cc:333] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.898257 20036 raft_consensus.cc:2243] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.898903 20036 raft_consensus.cc:2272] T ef66c45b466e4acb83723f82bb2be36e P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.900751 20036 tablet_replica.cc:333] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.901217 20036 raft_consensus.cc:2243] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.901885 20036 raft_consensus.cc:2272] T 7a837dff96224f8b8795bace63448d84 P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.903617 20036 tablet_replica.cc:333] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.904173 20036 raft_consensus.cc:2243] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.904779 20036 raft_consensus.cc:2272] T 116d5e82da354208af66a0e6f7a51dcf P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.906493 20036 tablet_replica.cc:333] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.906988 20036 raft_consensus.cc:2243] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.907428 20036 raft_consensus.cc:2272] T c2308648f35c4faf94816331179c44aa P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.909125 20036 tablet_replica.cc:333] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.909610 20036 raft_consensus.cc:2243] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.910326 20036 raft_consensus.cc:2272] T b58884ca99bd494292202a75faf1833c P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.912175 20036 tablet_replica.cc:333] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.912663 20036 raft_consensus.cc:2243] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.913146 20036 raft_consensus.cc:2272] T aa95e198a0404e91adecdec5338443a0 P 5e66e7254b764832b244bb5b07b4a208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.914817 20036 tablet_replica.cc:333] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.915356 20036 raft_consensus.cc:2243] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.915819 20036 raft_consensus.cc:2272] T e8a59065e5d64bc09a27e51c9955775d P 5e66e7254b764832b244bb5b07b4a208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.917551 20036 tablet_replica.cc:333] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.918045 20036 raft_consensus.cc:2243] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.918481 20036 raft_consensus.cc:2272] T 3c0599d67fb34b91a3afc1c32163efa4 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.920248 20036 tablet_replica.cc:333] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.920740 20036 raft_consensus.cc:2243] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.921231 20036 raft_consensus.cc:2272] T 605603ac2631443292cd7278cf055b51 P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.922999 20036 tablet_replica.cc:333] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.923563 20036 raft_consensus.cc:2243] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.923971 20036 raft_consensus.cc:2272] T 33f9268b51e14a8d82c0377b1596e9ce P 5e66e7254b764832b244bb5b07b4a208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.925519 20036 tablet_replica.cc:333] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.926031 20036 raft_consensus.cc:2243] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.926779 20036 raft_consensus.cc:2272] T 19d2a839d8cf43eea500e735e58a9e28 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.928687 20036 tablet_replica.cc:333] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.929215 20036 raft_consensus.cc:2243] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.929957 20036 raft_consensus.cc:2272] T c22f29b50b474596adeb0f179b9eb385 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.931682 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.931734 20036 tablet_replica.cc:333] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.932741 20036 raft_consensus.cc:2243] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.933281 20036 raft_consensus.cc:2272] T 5e7b1fec990b4785a3b45b520909244c P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.935046 20036 tablet_replica.cc:333] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.935576 20036 raft_consensus.cc:2243] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.936396 20036 pending_rounds.cc:70] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Trying to abort 1 pending ops.
I20260709 13:09:19.936615 20036 pending_rounds.cc:77] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305636079589023744 op_type: NO_OP noop_request { }
I20260709 13:09:19.936931 20036 raft_consensus.cc:2889] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.937243 20036 raft_consensus.cc:2272] T 08a13eedafd74dabb8f0219f4c7e9288 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.939642 20036 tablet_replica.cc:333] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.940292 20036 raft_consensus.cc:2243] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.941215 20036 pending_rounds.cc:70] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Trying to abort 1 pending ops.
I20260709 13:09:19.941440 20036 pending_rounds.cc:77] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305636078885732352 op_type: NO_OP noop_request { }
I20260709 13:09:19.941747 20036 raft_consensus.cc:2889] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.942057 20036 raft_consensus.cc:2272] T 5918dc9de89b4d149ecb2548872e4642 P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.944301 20036 tablet_replica.cc:333] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.944927 20036 raft_consensus.cc:2243] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.945755 20036 raft_consensus.cc:2272] T 217f5315ea524ce28a596c2aa95cb43f P 5e66e7254b764832b244bb5b07b4a208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.948050 20036 tablet_replica.cc:333] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.948644 20036 raft_consensus.cc:2243] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.949244 20036 raft_consensus.cc:2272] T 17378a57c1c3434a8411ab6894114acb P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.951741 20036 tablet_replica.cc:333] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.952363 20036 raft_consensus.cc:2243] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.953217 20036 raft_consensus.cc:2272] T 6b9b6c321dab4a71866dd41996aca451 P 5e66e7254b764832b244bb5b07b4a208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.955796 20036 tablet_replica.cc:333] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.956413 20036 raft_consensus.cc:2243] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.956951 20036 raft_consensus.cc:2272] T 198128dc1acc4c9bbe56ff48a07e23a4 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.959442 20036 tablet_replica.cc:333] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.960075 20036 raft_consensus.cc:2243] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.960857 20036 pending_rounds.cc:70] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Trying to abort 1 pending ops.
I20260709 13:09:19.961082 20036 pending_rounds.cc:77] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305636079214710784 op_type: NO_OP noop_request { }
I20260709 13:09:19.961404 20036 raft_consensus.cc:2889] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.961716 20036 raft_consensus.cc:2272] T 98b79eeda2784ff4ac1d2f6696c48563 P 5e66e7254b764832b244bb5b07b4a208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.964156 20036 tablet_replica.cc:333] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.964740 20036 raft_consensus.cc:2243] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.965457 20036 raft_consensus.cc:2272] T 99d11247a80d4fb5b4034e0a238c9388 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.967840 20036 tablet_replica.cc:333] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.968470 20036 raft_consensus.cc:2243] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.969164 20036 raft_consensus.cc:2272] T aff8a809ecee49028cc5d6587518d7c8 P 5e66e7254b764832b244bb5b07b4a208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.971679 20036 tablet_replica.cc:333] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208: stopping tablet replica
I20260709 13:09:19.972251 20036 raft_consensus.cc:2243] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.973179 20036 raft_consensus.cc:2272] T fccd55284a3547968acf752c8d6f9f4d P 5e66e7254b764832b244bb5b07b4a208 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.070632 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.078981 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.156936 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.171994 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.176715 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.193612 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.210320 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.221758 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.253722 21776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.258481 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.275394 21777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.396389 21835 debug-util.cc:398] Leaking SignalData structure 0x7b08003fcbe0 after lost signal to thread 20039
W20260709 13:09:20.397377 21835 debug-util.cc:398] Leaking SignalData structure 0x7b080041eb80 after lost signal to thread 21083
W20260709 13:09:20.445784 21778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.448290 21779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.350320 20036 tablet_server.cc:196] TabletServer@127.19.145.4:0 shutdown complete.
W20260709 13:09:21.369980 21033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111) [suppressed 448 similar messages]
W20260709 13:09:21.374025 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:21.458326 20036 master.cc:562] Master@127.19.145.62:44287 shutting down...
W20260709 13:09:22.424690 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08001728e0 after lost signal to thread 20039
W20260709 13:09:22.425647 21080 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6620 after lost signal to thread 21083
W20260709 13:09:37.788311 21033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
W20260709 13:09:37.791764 21033 catalog_manager.cc:4755] TS 3585d99c303e453c8c3762b294caba4e (127.19.145.1:46145): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 68ebd645703043ddb9e32ba2d84bbc1e: Network error: Client connection negotiation failed: client connection to 127.19.145.1:46145: connect: Connection refused (error 111)
I20260709 13:09:38.493191 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.494328 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.494714 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17f9ac50e9a3445ba29d33dbe0f8af0f: stopping tablet replica
I20260709 13:09:38.687909 20036 master.cc:584] Master@127.19.145.62:44287 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (217412 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:38.800107 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:41169
I20260709 13:09:38.801203 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.807188 27458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.807338 27459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.807963 27461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.808651 20036 server_base.cc:1061] running on GCE node
I20260709 13:09:38.811594 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.811833 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.811990 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602578811972 us; error 0 us; skew 500 ppm
I20260709 13:09:38.812489 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.814750 20036 webserver.cc:533] Webserver started at http://127.19.145.62:46045/ using document root <none> and password file <none>
I20260709 13:09:38.815227 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.815693 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:38.815966 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:38.817165 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "380adda4de534ee386f37dcd0bf89ab3"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-cd6k"
I20260709 13:09:38.821487 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:38.824793 27466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.825433 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:38.825697 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "380adda4de534ee386f37dcd0bf89ab3"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-cd6k"
I20260709 13:09:38.826208 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:38.866766 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:38.868075 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:38.906095 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:41169
I20260709 13:09:38.906200 27517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:41169 every 8 connection(s)
I20260709 13:09:38.910192 27518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.920320 27518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3: Bootstrap starting.
I20260709 13:09:38.925034 27518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.929749 27518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3: No bootstrap required, opened a new log
I20260709 13:09:38.931926 27518 raft_consensus.cc:359] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER }
I20260709 13:09:38.932359 27518 raft_consensus.cc:385] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.932579 27518 raft_consensus.cc:740] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380adda4de534ee386f37dcd0bf89ab3, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.933116 27518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER }
I20260709 13:09:38.933568 27518 raft_consensus.cc:399] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:38.933795 27518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:38.934072 27518 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.938159 27518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER }
I20260709 13:09:38.938669 27518 leader_election.cc:304] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 380adda4de534ee386f37dcd0bf89ab3; no voters: 
I20260709 13:09:38.939777 27518 leader_election.cc:290] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:38.940182 27521 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.941489 27521 raft_consensus.cc:697] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 380adda4de534ee386f37dcd0bf89ab3, State: Running, Role: LEADER
I20260709 13:09:38.942166 27521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER }
I20260709 13:09:38.942664 27518 sys_catalog.cc:565] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:38.949435 27523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 380adda4de534ee386f37dcd0bf89ab3. Latest consensus state: current_term: 1 leader_uuid: "380adda4de534ee386f37dcd0bf89ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER } }
I20260709 13:09:38.949613 27522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "380adda4de534ee386f37dcd0bf89ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380adda4de534ee386f37dcd0bf89ab3" member_type: VOTER } }
I20260709 13:09:38.950217 27523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:38.950294 27522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:38.952234 27531 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:38.958146 27531 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:38.959167 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:38.966842 27531 catalog_manager.cc:1383] Generated new cluster ID: 3ee520fc197445f2a6bbe07621d34056
I20260709 13:09:38.967101 27531 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:38.979699 27531 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:38.980903 27531 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:38.999935 27531 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3: Generated new TSK 0
I20260709 13:09:39.000487 27531 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:39.025300 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.031193 27539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.032274 27540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.034313 20036 server_base.cc:1061] running on GCE node
W20260709 13:09:39.034789 27542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.036509 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.036697 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.036816 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602579036806 us; error 0 us; skew 500 ppm
I20260709 13:09:39.037310 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.039434 20036 webserver.cc:533] Webserver started at http://127.19.145.1:37611/ using document root <none> and password file <none>
I20260709 13:09:39.039832 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.039986 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.040190 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.041253 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.045725 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:39.048774 27547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.049445 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:39.049722 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.049997 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.062309 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.063776 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.065258 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.067574 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.067775 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.068032 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.068194 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.108299 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:36015
I20260709 13:09:39.108385 27609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:36015 every 8 connection(s)
I20260709 13:09:39.113548 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.121640 27614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.124359 27615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.126466 27617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.127121 20036 server_base.cc:1061] running on GCE node
I20260709 13:09:39.129576 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.129860 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.130092 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602579130073 us; error 0 us; skew 500 ppm
I20260709 13:09:39.130767 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.132634 27610 heartbeater.cc:344] Connected to a master server at 127.19.145.62:41169
I20260709 13:09:39.133046 27610 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.133930 20036 webserver.cc:533] Webserver started at http://127.19.145.2:44635/ using document root <none> and password file <none>
I20260709 13:09:39.134238 27610 heartbeater.cc:507] Master 127.19.145.62:41169 requested a full tablet report, sending...
I20260709 13:09:39.134701 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.135041 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.135406 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.137072 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "387a99f68cd34b7c9e89550715e17135"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.137423 27483 ts_manager.cc:194] Registered new tserver with Master: a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:39.139452 27483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52490
I20260709 13:09:39.141994 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:39.145680 27622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.146649 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:39.146996 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "387a99f68cd34b7c9e89550715e17135"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.147253 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.163153 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.164474 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.165902 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.168134 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.168349 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.168569 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.168730 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.213207 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:45745
I20260709 13:09:39.213313 27684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:45745 every 8 connection(s)
I20260709 13:09:39.218115 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.226406 27688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.226958 27689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.229370 27691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.231041 20036 server_base.cc:1061] running on GCE node
I20260709 13:09:39.231747 27685 heartbeater.cc:344] Connected to a master server at 127.19.145.62:41169
I20260709 13:09:39.232184 27685 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.232180 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.232744 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.232972 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602579232953 us; error 0 us; skew 500 ppm
I20260709 13:09:39.233421 27685 heartbeater.cc:507] Master 127.19.145.62:41169 requested a full tablet report, sending...
I20260709 13:09:39.233798 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.235802 27483 ts_manager.cc:194] Registered new tserver with Master: 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:39.236856 20036 webserver.cc:533] Webserver started at http://127.19.145.3:46323/ using document root <none> and password file <none>
I20260709 13:09:39.237497 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.237736 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.237644 27483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52502
I20260709 13:09:39.238147 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.239881 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "2685f76105504ec2ab35ae2893841d01"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.244350 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:39.247406 27696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.248149 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:39.248474 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "2685f76105504ec2ab35ae2893841d01"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.248787 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.265141 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.266443 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.267915 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.270128 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.270306 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.270596 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.270751 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.312598 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:36259
I20260709 13:09:39.312711 27758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:36259 every 8 connection(s)
I20260709 13:09:39.317996 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.327023 27762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.327080 27763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.332919 27759 heartbeater.cc:344] Connected to a master server at 127.19.145.62:41169
W20260709 13:09:39.332914 27765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.333360 20036 server_base.cc:1061] running on GCE node
I20260709 13:09:39.333573 27759 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.334494 27759 heartbeater.cc:507] Master 127.19.145.62:41169 requested a full tablet report, sending...
I20260709 13:09:39.334519 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.334923 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.335119 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602579335097 us; error 0 us; skew 500 ppm
I20260709 13:09:39.335948 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.336723 27483 ts_manager.cc:194] Registered new tserver with Master: 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:39.338256 27483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52506
I20260709 13:09:39.338634 20036 webserver.cc:533] Webserver started at http://127.19.145.4:34633/ using document root <none> and password file <none>
I20260709 13:09:39.339300 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.339587 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.339880 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.341075 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-3-root/instance:
uuid: "6352477d8f544921a79fe2a8a4b84c91"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.345671 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:39.348958 27770 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.349728 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:39.350055 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
uuid: "6352477d8f544921a79fe2a8a4b84c91"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:39.350378 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.381378 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.382740 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.384308 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.386612 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.386863 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.387116 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.387336 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:39.431959 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.4:35273
I20260709 13:09:39.432060 27832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.4:35273 every 8 connection(s)
I20260709 13:09:39.445981 27833 heartbeater.cc:344] Connected to a master server at 127.19.145.62:41169
I20260709 13:09:39.446354 27833 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.447100 27833 heartbeater.cc:507] Master 127.19.145.62:41169 requested a full tablet report, sending...
I20260709 13:09:39.448998 27483 ts_manager.cc:194] Registered new tserver with Master: 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:39.449170 20036 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013660057s
I20260709 13:09:39.450794 27483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52518
I20260709 13:09:39.474648 27483 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52524:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:39.716681 27650 tablet_service.cc:1511] Processing CreateTablet for tablet d1479a6d10c54f62a309817459bcc2ac (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:39.718231 27650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1479a6d10c54f62a309817459bcc2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.719381 27574 tablet_service.cc:1511] Processing CreateTablet for tablet 79d5ebd76b7743ee96caafce6e15dca9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:39.720865 27574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d5ebd76b7743ee96caafce6e15dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.724366 27573 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:39.725804 27573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.727843 27570 tablet_service.cc:1511] Processing CreateTablet for tablet 4eab03f165164c039475da5b90d445ed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:39.729269 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eab03f165164c039475da5b90d445ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.729858 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 79d5ebd76b7743ee96caafce6e15dca9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:39.727845 27569 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffdc09edd634205ab7d40c675eee062 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:39.731793 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d5ebd76b7743ee96caafce6e15dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.732709 27569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffdc09edd634205ab7d40c675eee062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.732594 27572 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe679a9b272470a9ca60d206c005339 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:39.733999 27572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe679a9b272470a9ca60d206c005339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.736392 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 0e19a56e4af742289da53021053e2e16 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:39.737872 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e19a56e4af742289da53021053e2e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.740062 27645 tablet_service.cc:1511] Processing CreateTablet for tablet 23452fbc71a8440fa12d2eb0075c8e15 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:39.740540 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 19c47c6d89604d2d824d3ec0afaac896 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:39.741384 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23452fbc71a8440fa12d2eb0075c8e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.742038 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c47c6d89604d2d824d3ec0afaac896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.744388 27647 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe679a9b272470a9ca60d206c005339 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:39.744966 27567 tablet_service.cc:1511] Processing CreateTablet for tablet be10201ecf4e49fdb34aa543e5dcf264 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:39.745877 27647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe679a9b272470a9ca60d206c005339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.746320 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be10201ecf4e49fdb34aa543e5dcf264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.732390 27648 tablet_service.cc:1511] Processing CreateTablet for tablet ce31eb77bd604406be314032a8b76a81 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:39.736392 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 0e19a56e4af742289da53021053e2e16 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:39.748847 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e19a56e4af742289da53021053e2e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.750341 27575 tablet_service.cc:1511] Processing CreateTablet for tablet d1479a6d10c54f62a309817459bcc2ac (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:39.751652 27648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31eb77bd604406be314032a8b76a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.751760 27575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1479a6d10c54f62a309817459bcc2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.761540 27566 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec9b17465d14db4b8a89886a3edcdbc (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:39.763046 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec9b17465d14db4b8a89886a3edcdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.764704 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 19c47c6d89604d2d824d3ec0afaac896 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:39.766180 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c47c6d89604d2d824d3ec0afaac896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.768160 27642 tablet_service.cc:1511] Processing CreateTablet for tablet 1f54782de6c64f439dcec5270aad77d2 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:39.769590 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f54782de6c64f439dcec5270aad77d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.772456 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffdc09edd634205ab7d40c675eee062 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:39.773895 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffdc09edd634205ab7d40c675eee062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.782040 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 79d5ebd76b7743ee96caafce6e15dca9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:39.783428 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d5ebd76b7743ee96caafce6e15dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.798075 27717 tablet_service.cc:1511] Processing CreateTablet for tablet be10201ecf4e49fdb34aa543e5dcf264 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:39.800454 27724 tablet_service.cc:1511] Processing CreateTablet for tablet d1479a6d10c54f62a309817459bcc2ac (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:39.802707 27723 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:39.804961 27722 tablet_service.cc:1511] Processing CreateTablet for tablet ce31eb77bd604406be314032a8b76a81 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:39.807152 27721 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe679a9b272470a9ca60d206c005339 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:39.809369 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 4eab03f165164c039475da5b90d445ed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:39.811553 27719 tablet_service.cc:1511] Processing CreateTablet for tablet 23452fbc71a8440fa12d2eb0075c8e15 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:39.813746 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffdc09edd634205ab7d40c675eee062 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:39.815382 27716 tablet_service.cc:1511] Processing CreateTablet for tablet 1f54782de6c64f439dcec5270aad77d2 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:39.817134 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 3c61d995a55841e7b383d1ab3091c2e5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:39.818416 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c61d995a55841e7b383d1ab3091c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.820310 27717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be10201ecf4e49fdb34aa543e5dcf264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.823705 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eab03f165164c039475da5b90d445ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.824461 27853 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:39.827649 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31eb77bd604406be314032a8b76a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.828142 27567 tablet_service.cc:1511] Processing CreateTablet for tablet f3e15fde3df7459bbee42a28a244ef86 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:39.829519 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e15fde3df7459bbee42a28a244ef86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.851907 27572 tablet_service.cc:1511] Processing CreateTablet for tablet eb0273d7867b40db9dc87335d36e6f95 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:39.834954 27853 tablet_bootstrap.cc:654] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.835615 27724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1479a6d10c54f62a309817459bcc2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.853641 27572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0273d7867b40db9dc87335d36e6f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.859685 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe679a9b272470a9ca60d206c005339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.863579 27716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f54782de6c64f439dcec5270aad77d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.847115 27568 tablet_service.cc:1511] Processing CreateTablet for tablet ad26bb1b44b8483385cd6155100e6fb3 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:39.865545 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad26bb1b44b8483385cd6155100e6fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.867163 27719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23452fbc71a8440fa12d2eb0075c8e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.871577 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffdc09edd634205ab7d40c675eee062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.875561 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.877211 27570 tablet_service.cc:1511] Processing CreateTablet for tablet 37e5831f4db34d93ace2689b7db99cd1 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:39.878511 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e5831f4db34d93ace2689b7db99cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.893702 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec9b17465d14db4b8a89886a3edcdbc (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:39.895064 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec9b17465d14db4b8a89886a3edcdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.895567 27797 tablet_service.cc:1511] Processing CreateTablet for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:39.896847 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b6a26fb8b24f0eb7d1a0c904eb6280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.910813 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 3c61d995a55841e7b383d1ab3091c2e5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:39.912132 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c61d995a55841e7b383d1ab3091c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.898298 27796 tablet_service.cc:1511] Processing CreateTablet for tablet ce31eb77bd604406be314032a8b76a81 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:39.913712 27796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31eb77bd604406be314032a8b76a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.900071 27795 tablet_service.cc:1511] Processing CreateTablet for tablet 0e19a56e4af742289da53021053e2e16 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:39.916143 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e19a56e4af742289da53021053e2e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.901798 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 4eab03f165164c039475da5b90d445ed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:39.920114 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eab03f165164c039475da5b90d445ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.903563 27793 tablet_service.cc:1511] Processing CreateTablet for tablet 23452fbc71a8440fa12d2eb0075c8e15 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:39.921697 27793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23452fbc71a8440fa12d2eb0075c8e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.905257 27715 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec9b17465d14db4b8a89886a3edcdbc (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:39.924155 27715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec9b17465d14db4b8a89886a3edcdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.906404 27791 tablet_service.cc:1511] Processing CreateTablet for tablet be10201ecf4e49fdb34aa543e5dcf264 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:39.928139 27791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be10201ecf4e49fdb34aa543e5dcf264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.908248 27790 tablet_service.cc:1511] Processing CreateTablet for tablet 1f54782de6c64f439dcec5270aad77d2 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:39.932176 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f54782de6c64f439dcec5270aad77d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.933498 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 7e977dcac25b40f9b4451a087f94be1a (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:39.905257 27792 tablet_service.cc:1511] Processing CreateTablet for tablet 19c47c6d89604d2d824d3ec0afaac896 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:39.934830 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e977dcac25b40f9b4451a087f94be1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.935559 27792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c47c6d89604d2d824d3ec0afaac896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.941680 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 3c61d995a55841e7b383d1ab3091c2e5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:39.943073 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c61d995a55841e7b383d1ab3091c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:39.953421 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:39.961361 27853 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:39.961977 27853 ts_tablet_manager.cc:1403] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.018s
I20260709 13:09:39.962311 27720 tablet_service.cc:1511] Processing CreateTablet for tablet f3e15fde3df7459bbee42a28a244ef86 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:39.963680 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e15fde3df7459bbee42a28a244ef86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.964948 27567 tablet_service.cc:1511] Processing CreateTablet for tablet ce64c49f3477473ba51466f3775c419e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:39.968212 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce64c49f3477473ba51466f3775c419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.980872 27854 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:39.991647 27648 tablet_service.cc:1511] Processing CreateTablet for tablet dde1218f4bbf48f7987c355961adb699 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:39.992961 27648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde1218f4bbf48f7987c355961adb699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.994014 27798 tablet_service.cc:1511] Processing CreateTablet for tablet f3e15fde3df7459bbee42a28a244ef86 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:39.996592 27717 tablet_service.cc:1511] Processing CreateTablet for tablet ad26bb1b44b8483385cd6155100e6fb3 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:40.025276 27793 tablet_service.cc:1511] Processing CreateTablet for tablet 7e977dcac25b40f9b4451a087f94be1a (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:40.011137 27796 tablet_service.cc:1511] Processing CreateTablet for tablet eb0273d7867b40db9dc87335d36e6f95 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:39.998520 27649 tablet_service.cc:1511] Processing CreateTablet for tablet eb0273d7867b40db9dc87335d36e6f95 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:40.020625 27716 tablet_service.cc:1511] Processing CreateTablet for tablet dde1218f4bbf48f7987c355961adb699 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:40.009559 27721 tablet_service.cc:1511] Processing CreateTablet for tablet 37e5831f4db34d93ace2689b7db99cd1 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:40.005381 27853 raft_consensus.cc:359] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.031543 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e15fde3df7459bbee42a28a244ef86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.048238 27796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0273d7867b40db9dc87335d36e6f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.002300 27645 tablet_service.cc:1511] Processing CreateTablet for tablet ad26bb1b44b8483385cd6155100e6fb3 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:40.027398 27719 tablet_service.cc:1511] Processing CreateTablet for tablet 7e977dcac25b40f9b4451a087f94be1a (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:40.050038 27793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e977dcac25b40f9b4451a087f94be1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.050654 27856 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:40.036262 27854 tablet_bootstrap.cc:654] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.025691 27795 tablet_service.cc:1511] Processing CreateTablet for tablet 37e5831f4db34d93ace2689b7db99cd1 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:40.046140 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e5831f4db34d93ace2689b7db99cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.047782 27853 raft_consensus.cc:385] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.046140 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0273d7867b40db9dc87335d36e6f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.053072 27853 raft_consensus.cc:740] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.046380 27570 tablet_service.cc:1511] Processing CreateTablet for tablet fceb102b02094b29b56578adb3b10bc5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:40.053966 27853 consensus_queue.cc:260] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.054663 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fceb102b02094b29b56578adb3b10bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.055474 27719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e977dcac25b40f9b4451a087f94be1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.056144 27716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde1218f4bbf48f7987c355961adb699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.046653 27794 tablet_service.cc:1511] Processing CreateTablet for tablet dde1218f4bbf48f7987c355961adb699 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:40.053741 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad26bb1b44b8483385cd6155100e6fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.058256 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde1218f4bbf48f7987c355961adb699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.066041 27646 tablet_service.cc:1511] Processing CreateTablet for tablet ce64c49f3477473ba51466f3775c419e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:40.067519 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce64c49f3477473ba51466f3775c419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.070943 27642 tablet_service.cc:1511] Processing CreateTablet for tablet fceb102b02094b29b56578adb3b10bc5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:40.072309 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fceb102b02094b29b56578adb3b10bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.066041 27724 tablet_service.cc:1511] Processing CreateTablet for tablet ce64c49f3477473ba51466f3775c419e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:40.075685 27724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce64c49f3477473ba51466f3775c419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.083971 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e5831f4db34d93ace2689b7db99cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.095799 27717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad26bb1b44b8483385cd6155100e6fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.103155 27722 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:40.104483 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.105573 27856 tablet_bootstrap.cc:654] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.110504 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 4f070317853944f7a8c691ed18b301df (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:40.111833 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f070317853944f7a8c691ed18b301df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.112182 27790 tablet_service.cc:1511] Processing CreateTablet for tablet fceb102b02094b29b56578adb3b10bc5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:40.113399 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fceb102b02094b29b56578adb3b10bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.120237 27789 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:40.136117 27857 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:40.138914 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 7b451f9357d24103a777c6e4c9a434b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:40.140295 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b451f9357d24103a777c6e4c9a434b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.142400 27610 heartbeater.cc:499] Master 127.19.145.62:41169 was elected leader, sending a full tablet report...
I20260709 13:09:40.120260 27567 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:40.146520 27853 ts_tablet_manager.cc:1434] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.184s	user 0.007s	sys 0.018s
I20260709 13:09:40.146677 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.147655 27853 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:40.152350 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce1e8262b44f7d9d12d08e0c3fe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.155660 27715 tablet_service.cc:1511] Processing CreateTablet for tablet 4f070317853944f7a8c691ed18b301df (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:40.157362 27715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f070317853944f7a8c691ed18b301df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.158120 27853 tablet_bootstrap.cc:654] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.169407 27795 tablet_service.cc:1511] Processing CreateTablet for tablet 4f070317853944f7a8c691ed18b301df (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:40.172138 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f070317853944f7a8c691ed18b301df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.172032 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 9f027427f56542cbacf08cba476c2e90 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:40.174252 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f027427f56542cbacf08cba476c2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.190769 27572 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1eca5604bf471a859dd26aba03fc9d (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:40.192198 27572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1eca5604bf471a859dd26aba03fc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.198031 27854 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:40.198834 27854 ts_tablet_manager.cc:1403] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.218s	user 0.018s	sys 0.029s
I20260709 13:09:40.202868 27854 raft_consensus.cc:359] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.203421 27858 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.216390 27858 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.213850 27854 raft_consensus.cc:385] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.214737 27566 tablet_service.cc:1511] Processing CreateTablet for tablet e9449fef1f664215b643cd9668147684 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:40.219013 27858 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:40.224087 27854 raft_consensus.cc:740] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.240486 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9449fef1f664215b643cd9668147684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.240707 27685 heartbeater.cc:499] Master 127.19.145.62:41169 was elected leader, sending a full tablet report...
I20260709 13:09:40.244174 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 7b451f9357d24103a777c6e4c9a434b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:40.245448 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b451f9357d24103a777c6e4c9a434b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.248160 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 9f027427f56542cbacf08cba476c2e90 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:40.249512 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f027427f56542cbacf08cba476c2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.252632 27573 tablet_service.cc:1511] Processing CreateTablet for tablet cca597f9d49f4059aaa18be216089f24 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:40.253986 27573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca597f9d49f4059aaa18be216089f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.255002 27721 tablet_service.cc:1511] Processing CreateTablet for tablet 7b451f9357d24103a777c6e4c9a434b5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:40.256336 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b451f9357d24103a777c6e4c9a434b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.268049 27854 consensus_queue.cc:260] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.272481 27857 tablet_bootstrap.cc:654] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.282986 27724 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1eca5604bf471a859dd26aba03fc9d (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:40.283648 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1eca5604bf471a859dd26aba03fc9d (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:40.284346 27724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1eca5604bf471a859dd26aba03fc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.284895 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1eca5604bf471a859dd26aba03fc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.290385 27570 tablet_service.cc:1511] Processing CreateTablet for tablet d6b4d67651944d4c82892d46b4f4948c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:40.291759 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b4d67651944d4c82892d46b4f4948c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.293617 27720 tablet_service.cc:1511] Processing CreateTablet for tablet dca18e3f1a9e486095c1f06ca4168709 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:40.294867 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca18e3f1a9e486095c1f06ca4168709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.295079 27648 tablet_service.cc:1511] Processing CreateTablet for tablet e9449fef1f664215b643cd9668147684 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:40.295854 27789 tablet_service.cc:1511] Processing CreateTablet for tablet dca18e3f1a9e486095c1f06ca4168709 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:40.296331 27648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9449fef1f664215b643cd9668147684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.297099 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca18e3f1a9e486095c1f06ca4168709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.297166 27645 tablet_service.cc:1511] Processing CreateTablet for tablet 9f027427f56542cbacf08cba476c2e90 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:40.301460 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f027427f56542cbacf08cba476c2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.304982 27718 tablet_service.cc:1511] Processing CreateTablet for tablet e9449fef1f664215b643cd9668147684 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:40.306205 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9449fef1f664215b643cd9668147684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.306396 27642 tablet_service.cc:1511] Processing CreateTablet for tablet cca597f9d49f4059aaa18be216089f24 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:40.307829 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca597f9d49f4059aaa18be216089f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.310163 27723 tablet_service.cc:1511] Processing CreateTablet for tablet d6b4d67651944d4c82892d46b4f4948c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:40.299207 27856 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:40.312842 27856 ts_tablet_manager.cc:1403] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.263s	user 0.028s	sys 0.035s
I20260709 13:09:40.313014 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b4d67651944d4c82892d46b4f4948c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.316072 27856 raft_consensus.cc:359] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.316850 27856 raft_consensus.cc:385] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.327473 27793 tablet_service.cc:1511] Processing CreateTablet for tablet cca597f9d49f4059aaa18be216089f24 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:40.328785 27793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca597f9d49f4059aaa18be216089f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.317157 27856 raft_consensus.cc:740] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.335831 27644 tablet_service.cc:1511] Processing CreateTablet for tablet dca18e3f1a9e486095c1f06ca4168709 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:40.337085 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca18e3f1a9e486095c1f06ca4168709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.342394 27759 heartbeater.cc:499] Master 127.19.145.62:41169 was elected leader, sending a full tablet report...
I20260709 13:09:40.344025 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 73b4fe2dd2ab4ecfa2cafe055c364838 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:40.345486 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b4fe2dd2ab4ecfa2cafe055c364838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.353667 27853 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:40.354212 27853 ts_tablet_manager.cc:1403] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.003s
I20260709 13:09:40.360472 27854 ts_tablet_manager.cc:1434] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.161s	user 0.006s	sys 0.012s
I20260709 13:09:40.360896 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:40.361614 27854 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:40.362424 27853 raft_consensus.cc:359] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
W20260709 13:09:40.363415 27611 tablet.cc:2406] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:40.365793 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 0041555667e44a71a863bc5e56bc1745 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:40.368009 27857 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:40.379566 27857 ts_tablet_manager.cc:1403] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.244s	user 0.015s	sys 0.000s
I20260709 13:09:40.384572 27857 raft_consensus.cc:359] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.385545 27857 raft_consensus.cc:385] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.385886 27857 raft_consensus.cc:740] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.369233 27853 raft_consensus.cc:385] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.391628 27853 raft_consensus.cc:740] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.392612 27853 consensus_queue.cc:260] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.394841 27853 ts_tablet_manager.cc:1434] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:09:40.334698 27856 consensus_queue.cc:260] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.395884 27853 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:40.400636 27734 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:40.405797 27798 tablet_service.cc:1511] Processing CreateTablet for tablet d6b4d67651944d4c82892d46b4f4948c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:40.421034 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b4d67651944d4c82892d46b4f4948c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.423290 27548 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:40.424158 27858 raft_consensus.cc:2804] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.424515 27858 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.406015 27642 tablet_service.cc:1511] Processing CreateTablet for tablet 70d6cd1381e9461a906ad5194102295e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:40.407399 27795 tablet_service.cc:1511] Processing CreateTablet for tablet 70d6cd1381e9461a906ad5194102295e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:40.407917 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 0041555667e44a71a863bc5e56bc1745 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:40.408026 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 0041555667e44a71a863bc5e56bc1745 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:40.410437 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041555667e44a71a863bc5e56bc1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.410285 27790 tablet_service.cc:1511] Processing CreateTablet for tablet 73b4fe2dd2ab4ecfa2cafe055c364838 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:40.410537 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 73b4fe2dd2ab4ecfa2cafe055c364838 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:40.410718 27719 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3c90f12dc244b3b4d51189f757ae4f (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:40.428049 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d6cd1381e9461a906ad5194102295e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.428136 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d6cd1381e9461a906ad5194102295e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.428269 27719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3c90f12dc244b3b4d51189f757ae4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.428990 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b4fe2dd2ab4ecfa2cafe055c364838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.429883 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041555667e44a71a863bc5e56bc1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.412220 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 70d6cd1381e9461a906ad5194102295e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:40.432034 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d6cd1381e9461a906ad5194102295e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.386843 27857 consensus_queue.cc:260] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.417809 27854 tablet_bootstrap.cc:654] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.424853 27858 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.431160 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041555667e44a71a863bc5e56bc1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.447697 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b4fe2dd2ab4ecfa2cafe055c364838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.453779 27833 heartbeater.cc:499] Master 127.19.145.62:41169 was elected leader, sending a full tablet report...
I20260709 13:09:40.471086 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3c90f12dc244b3b4d51189f757ae4f (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:40.471442 27858 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.472406 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3c90f12dc244b3b4d51189f757ae4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.473657 27858 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:40.474705 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:40.475337 27734 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.491506 27734 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:40.492733 27548 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:40.498464 27858 raft_consensus.cc:2804] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.500047 27865 raft_consensus.cc:493] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.500569 27865 raft_consensus.cc:515] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.503211 27865 leader_election.cc:290] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:40.510896 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:40.512426 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
W20260709 13:09:40.515997 27548 leader_election.cc:343] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:40.517234 27548 leader_election.cc:343] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.517901 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3c90f12dc244b3b4d51189f757ae4f (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:40.519426 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3c90f12dc244b3b4d51189f757ae4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.522397 27856 ts_tablet_manager.cc:1434] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.209s	user 0.011s	sys 0.022s
I20260709 13:09:40.523864 27856 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:40.510167 27857 ts_tablet_manager.cc:1434] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.008s
I20260709 13:09:40.533048 27854 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:40.538211 27854 ts_tablet_manager.cc:1403] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.021s
I20260709 13:09:40.541213 27854 raft_consensus.cc:359] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.541900 27854 raft_consensus.cc:385] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.542191 27854 raft_consensus.cc:740] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.549110 27853 tablet_bootstrap.cc:654] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.550755 27642 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a60e8e2194989a741cc7cc098f122 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:40.535995 27857 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:40.530808 27858 raft_consensus.cc:697] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:40.561200 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a60e8e2194989a741cc7cc098f122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.562095 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:40.563464 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.571321 27570 tablet_service.cc:1511] Processing CreateTablet for tablet d02f1c4f105748ee996718a3440d2691 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:40.572575 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02f1c4f105748ee996718a3440d2691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.577715 27566 tablet_service.cc:1511] Processing CreateTablet for tablet 663f4c3345b74fdbad7101785ed79efb (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:40.578994 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f4c3345b74fdbad7101785ed79efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.542881 27854 consensus_queue.cc:260] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.582037 27854 ts_tablet_manager.cc:1434] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:09:40.583067 27854 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:40.589859 27857 tablet_bootstrap.cc:654] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.591836 27790 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a60e8e2194989a741cc7cc098f122 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:40.591956 27649 tablet_service.cc:1511] Processing CreateTablet for tablet d02f1c4f105748ee996718a3440d2691 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:40.593078 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a60e8e2194989a741cc7cc098f122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.590571 27719 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a60e8e2194989a741cc7cc098f122 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:40.594563 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 663f4c3345b74fdbad7101785ed79efb (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:40.595796 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f4c3345b74fdbad7101785ed79efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.600737 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:40.601965 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.602885 27720 tablet_service.cc:1511] Processing CreateTablet for tablet d02f1c4f105748ee996718a3440d2691 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:40.604259 27642 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:40.593225 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02f1c4f105748ee996718a3440d2691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.609731 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 663f4c3345b74fdbad7101785ed79efb (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:40.605396 27856 tablet_bootstrap.cc:654] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.605436 27719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a60e8e2194989a741cc7cc098f122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.603034 27858 consensus_queue.cc:237] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.607066 27854 tablet_bootstrap.cc:654] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.612308 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0ccee8df74beb8c4eaa0ba1902c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.623507 27644 tablet_service.cc:1511] Processing CreateTablet for tablet edbc1b203b2b4f0db422b3547ae75eb6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:40.635473 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f4c3345b74fdbad7101785ed79efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.636967 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edbc1b203b2b4f0db422b3547ae75eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.630404 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02f1c4f105748ee996718a3440d2691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.646522 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34416a06254755bef0d2066e8e3416 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:40.647967 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34416a06254755bef0d2066e8e3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.647902 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:40.649291 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:40.654400 27721 tablet_service.cc:1511] Processing CreateTablet for tablet edbc1b203b2b4f0db422b3547ae75eb6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:40.655642 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edbc1b203b2b4f0db422b3547ae75eb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:40.659582 27623 leader_election.cc:343] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:40.660298 27623 leader_election.cc:343] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.660674 27623 leader_election.cc:304] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:40.661531 27865 raft_consensus.cc:2749] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.666678 27789 tablet_service.cc:1511] Processing CreateTablet for tablet edbc1b203b2b4f0db422b3547ae75eb6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:40.667572 27853 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:40.668022 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edbc1b203b2b4f0db422b3547ae75eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.668136 27853 ts_tablet_manager.cc:1403] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.272s	user 0.025s	sys 0.004s
I20260709 13:09:40.671538 27865 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.672087 27865 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.679651 27865 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:40.694625 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:40.695851 27642 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34416a06254755bef0d2066e8e3416 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:40.697139 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34416a06254755bef0d2066e8e3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.681855 27853 raft_consensus.cc:359] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:40.704098 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4fec365128419699378d6468f59415 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:40.704731 27722 tablet_service.cc:1511] Processing CreateTablet for tablet 16478e1d305d4e6db2c2882fe655d75e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:40.705391 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4fec365128419699378d6468f59415. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:40.701392 27623 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.706027 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16478e1d305d4e6db2c2882fe655d75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.705049 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4fec365128419699378d6468f59415 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:40.709022 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4fec365128419699378d6468f59415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.709223 27790 tablet_service.cc:1511] Processing CreateTablet for tablet 16478e1d305d4e6db2c2882fe655d75e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:40.710449 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16478e1d305d4e6db2c2882fe655d75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.700599 27853 raft_consensus.cc:385] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.711625 27853 raft_consensus.cc:740] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.712338 27853 consensus_queue.cc:260] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:40.714005 27869 raft_consensus.cc:493] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.714514 27869 raft_consensus.cc:515] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.717154 27869 leader_election.cc:290] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:40.728011 27857 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:40.728674 27857 ts_tablet_manager.cc:1403] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.011s
I20260709 13:09:40.728739 27483 catalog_manager.cc:5697] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.736083 27857 raft_consensus.cc:359] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.736912 27857 raft_consensus.cc:385] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.737206 27857 raft_consensus.cc:740] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.737777 27856 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:40.738286 27856 ts_tablet_manager.cc:1403] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.215s	user 0.006s	sys 0.013s
I20260709 13:09:40.748252 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 7e34416a06254755bef0d2066e8e3416 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:40.749949 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e34416a06254755bef0d2066e8e3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.750550 27857 consensus_queue.cc:260] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.753676 27856 raft_consensus.cc:359] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.754647 27856 raft_consensus.cc:385] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.755000 27856 raft_consensus.cc:740] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.755918 27856 consensus_queue.cc:260] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.759156 27857 ts_tablet_manager.cc:1434] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:09:40.768671 27857 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:40.767640 27853 ts_tablet_manager.cc:1434] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.001s
I20260709 13:09:40.756424 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97b2b6ae80408999e7abedfeb241a9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:40.773941 27853 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:40.780906 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97b2b6ae80408999e7abedfeb241a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.784551 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4fec365128419699378d6468f59415 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:40.785987 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4fec365128419699378d6468f59415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.787313 27570 tablet_service.cc:1511] Processing CreateTablet for tablet 95b73701f47449cd96689924bfef1787 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:40.788522 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b73701f47449cd96689924bfef1787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.788235 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 16478e1d305d4e6db2c2882fe655d75e (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:40.789573 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16478e1d305d4e6db2c2882fe655d75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.792256 27566 tablet_service.cc:1511] Processing CreateTablet for tablet 86957a4582b64f46b02b50bf5f5d4db0 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:40.793568 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86957a4582b64f46b02b50bf5f5d4db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.793221 27722 tablet_service.cc:1511] Processing CreateTablet for tablet 95b73701f47449cd96689924bfef1787 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:40.794633 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b73701f47449cd96689924bfef1787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.796324 27869 raft_consensus.cc:493] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.796890 27869 raft_consensus.cc:515] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.799211 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97b2b6ae80408999e7abedfeb241a9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:40.799765 27869 leader_election.cc:290] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:40.800652 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97b2b6ae80408999e7abedfeb241a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.804072 27856 ts_tablet_manager.cc:1434] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:09:40.813452 27854 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:40.820393 27854 ts_tablet_manager.cc:1403] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.238s	user 0.015s	sys 0.005s
I20260709 13:09:40.820967 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 86957a4582b64f46b02b50bf5f5d4db0 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:40.822252 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86957a4582b64f46b02b50bf5f5d4db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.824370 27722 tablet_service.cc:1511] Processing CreateTablet for tablet 64de87ddc64f488fb55c8bccc3999da4 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:40.825675 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64de87ddc64f488fb55c8bccc3999da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.827570 27854 raft_consensus.cc:359] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:40.828356 27854 raft_consensus.cc:385] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.828651 27854 raft_consensus.cc:740] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.829416 27854 consensus_queue.cc:260] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:40.803623 27853 tablet_bootstrap.cc:654] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.832036 27856 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:40.833334 27573 tablet_service.cc:1511] Processing CreateTablet for tablet 64de87ddc64f488fb55c8bccc3999da4 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:40.834604 27573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64de87ddc64f488fb55c8bccc3999da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.836601 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:40.839814 27854 ts_tablet_manager.cc:1434] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
W20260709 13:09:40.840055 27774 leader_election.cc:343] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.840960 27854 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:40.841442 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:40.842967 27771 leader_election.cc:343] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.844266 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 86957a4582b64f46b02b50bf5f5d4db0 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:40.845145 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:40.845598 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86957a4582b64f46b02b50bf5f5d4db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.845396 27790 tablet_service.cc:1511] Processing CreateTablet for tablet 64de87ddc64f488fb55c8bccc3999da4 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:40.846861 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64de87ddc64f488fb55c8bccc3999da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.818068 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97b2b6ae80408999e7abedfeb241a9 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:40.846635 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:40.843091 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 95b73701f47449cd96689924bfef1787 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:40.816700 27857 tablet_bootstrap.cc:654] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.848568 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b73701f47449cd96689924bfef1787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.852687 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97b2b6ae80408999e7abedfeb241a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.850883 27858 raft_consensus.cc:493] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.853698 27858 raft_consensus.cc:515] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.856364 27858 leader_election.cc:290] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:40.857162 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:40.859551 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
W20260709 13:09:40.861088 27548 leader_election.cc:343] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.881031 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
W20260709 13:09:40.882390 27548 leader_election.cc:343] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.882890 27548 leader_election.cc:304] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:40.885905 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8977a3bcc74a06b26475b593096889 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:40.887331 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8977a3bcc74a06b26475b593096889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.893931 27566 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9686e9b98e4e07b6f193bb7b36a785 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:40.894785 27858 raft_consensus.cc:2749] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.895287 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9686e9b98e4e07b6f193bb7b36a785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.883085 27856 tablet_bootstrap.cc:654] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.913630 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9686e9b98e4e07b6f193bb7b36a785 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:09:40.908191 27626 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.914639 27626 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:40.915302 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9686e9b98e4e07b6f193bb7b36a785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.915483 27865 raft_consensus.cc:2749] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.916586 27853 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:40.917959 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8977a3bcc74a06b26475b593096889 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:40.918236 27645 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9686e9b98e4e07b6f193bb7b36a785 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:40.918941 27854 tablet_bootstrap.cc:654] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.917147 27853 ts_tablet_manager.cc:1403] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.021s
I20260709 13:09:40.920295 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8977a3bcc74a06b26475b593096889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.921058 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9686e9b98e4e07b6f193bb7b36a785. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:40.909679 27771 leader_election.cc:343] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.924117 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f0319ebab41859ce19c8c53606ca5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:40.925371 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f0319ebab41859ce19c8c53606ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.927342 27771 leader_election.cc:304] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:40.928292 27869 raft_consensus.cc:2749] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.934358 27856 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:40.934245 27853 raft_consensus.cc:359] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:40.934983 27856 ts_tablet_manager.cc:1403] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.103s	user 0.003s	sys 0.009s
I20260709 13:09:40.938486 27856 raft_consensus.cc:359] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:40.940398 27856 raft_consensus.cc:385] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.940750 27856 raft_consensus.cc:740] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.941648 27856 consensus_queue.cc:260] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:40.930198 27771 leader_election.cc:343] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.942853 27771 leader_election.cc:304] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:40.947774 27869 raft_consensus.cc:2749] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.935058 27853 raft_consensus.cc:385] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.948773 27853 raft_consensus.cc:740] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.957541 27856 ts_tablet_manager.cc:1434] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
W20260709 13:09:40.958461 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:40.963271 27867 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.963969 27867 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:40.967830 27856 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:40.958412 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 164e20e1bf464255aacb3064f916feed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:40.950470 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f0319ebab41859ce19c8c53606ca5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:40.969432 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f0319ebab41859ce19c8c53606ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.969403 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164e20e1bf464255aacb3064f916feed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.977510 27854 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:40.978252 27854 ts_tablet_manager.cc:1403] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.007s
I20260709 13:09:40.979110 27865 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.979756 27865 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
W20260709 13:09:40.993381 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 63515us
I20260709 13:09:40.999408 27853 consensus_queue.cc:260] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.001128 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.010823 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 164e20e1bf464255aacb3064f916feed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:09:41.012391 27626 leader_election.cc:343] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.012970 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164e20e1bf464255aacb3064f916feed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.012698 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 164e20e1bf464255aacb3064f916feed (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:41.014210 27853 ts_tablet_manager.cc:1434] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.094s	user 0.013s	sys 0.000s
I20260709 13:09:41.002499 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.019891 27867 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.008539 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8977a3bcc74a06b26475b593096889 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:09:41.020720 27623 leader_election.cc:343] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.014219 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164e20e1bf464255aacb3064f916feed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.021143 27857 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.025965 27857 ts_tablet_manager.cc:1403] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.258s	user 0.012s	sys 0.012s
I20260709 13:09:41.021056 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8977a3bcc74a06b26475b593096889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.028877 27853 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.010568 27794 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f0319ebab41859ce19c8c53606ca5 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:41.036104 27794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f0319ebab41859ce19c8c53606ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.031134 27857 raft_consensus.cc:359] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.047380 27857 raft_consensus.cc:385] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.022876 27722 tablet_service.cc:1511] Processing CreateTablet for tablet ffc7114823164fdf8ec82d57bfb6a56c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:41.032159 27623 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:41.049679 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc7114823164fdf8ec82d57bfb6a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.001338 27865 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.046587 27795 tablet_service.cc:1511] Processing CreateTablet for tablet ffc7114823164fdf8ec82d57bfb6a56c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:41.007431 27856 tablet_bootstrap.cc:654] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.048224 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.051512 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc7114823164fdf8ec82d57bfb6a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.019520 27643 tablet_service.cc:1511] Processing CreateTablet for tablet ffc7114823164fdf8ec82d57bfb6a56c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:09:41.052541 27697 leader_election.cc:343] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.052829 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc7114823164fdf8ec82d57bfb6a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.059356 27857 raft_consensus.cc:740] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.059528 27865 raft_consensus.cc:2749] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.060464 27857 consensus_queue.cc:260] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.061554 27867 raft_consensus.cc:493] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.062084 27867 raft_consensus.cc:515] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.063237 27857 ts_tablet_manager.cc:1434] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:41.064636 27867 leader_election.cc:290] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:41.069612 27571 tablet_service.cc:1511] Processing CreateTablet for tablet de5dcae52b444f76b89d1e20125f2a89 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:41.029433 27854 raft_consensus.cc:359] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.076175 27869 raft_consensus.cc:493] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.076709 27869 raft_consensus.cc:515] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.077450 27721 tablet_service.cc:1511] Processing CreateTablet for tablet de5dcae52b444f76b89d1e20125f2a89 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:41.078747 27869 leader_election.cc:290] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.079272 27646 tablet_service.cc:1511] Processing CreateTablet for tablet de5dcae52b444f76b89d1e20125f2a89 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:41.079588 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.080565 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5dcae52b444f76b89d1e20125f2a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.081334 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.078773 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5dcae52b444f76b89d1e20125f2a89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:41.083055 27700 leader_election.cc:343] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.083568 27700 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:41.070979 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5dcae52b444f76b89d1e20125f2a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.084424 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.085158 27867 raft_consensus.cc:2749] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.086622 27659 raft_consensus.cc:2468] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.090153 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:41.092276 27623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 71619.1us
I20260709 13:09:41.092958 27858 raft_consensus.cc:493] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.071636 27854 raft_consensus.cc:385] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.101796 27857 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
W20260709 13:09:41.102227 27771 leader_election.cc:343] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.093636 27858 raft_consensus.cc:515] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.103410 27771 leader_election.cc:304] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:41.105142 27858 leader_election.cc:290] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.105350 27869 raft_consensus.cc:2804] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.105764 27869 raft_consensus.cc:493] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.105829 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.106153 27869 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:41.093735 27697 leader_election.cc:343] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.109253 27548 leader_election.cc:343] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.106550 27790 tablet_service.cc:1511] Processing CreateTablet for tablet e073b9352b144716a65159d5c779fde6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:41.094647 27854 raft_consensus.cc:740] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.111754 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.112026 27790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073b9352b144716a65159d5c779fde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.113333 27566 tablet_service.cc:1511] Processing CreateTablet for tablet e073b9352b144716a65159d5c779fde6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:41.115401 27854 consensus_queue.cc:260] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.118670 27869 raft_consensus.cc:515] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:41.119993 27697 leader_election.cc:343] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.125023 27697 leader_election.cc:304] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:41.125825 27867 raft_consensus.cc:2749] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.126046 27854 ts_tablet_manager.cc:1434] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.000s
I20260709 13:09:41.127105 27854 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.131285 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.130093 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 55b4a78f3069431e8967dd06c5afb21c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:41.114681 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073b9352b144716a65159d5c779fde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.124349 27853 tablet_bootstrap.cc:654] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.118598 27644 tablet_service.cc:1511] Processing CreateTablet for tablet e073b9352b144716a65159d5c779fde6 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:09:41.136106 27548 leader_election.cc:343] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.152326 27548 leader_election.cc:304] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:41.153101 27858 raft_consensus.cc:2749] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.152923 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073b9352b144716a65159d5c779fde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.154672 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 55b4a78f3069431e8967dd06c5afb21c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:09:41.155761 27548 consensus_peers.cc:597] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 -> Peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Couldn't send request to peer 6352477d8f544921a79fe2a8a4b84c91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.156013 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b4a78f3069431e8967dd06c5afb21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.136416 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b4a78f3069431e8967dd06c5afb21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.138214 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:41.139936 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:41.138779 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 55b4a78f3069431e8967dd06c5afb21c (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:41.112000 27856 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.160172 27856 ts_tablet_manager.cc:1403] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.015s
W20260709 13:09:41.162802 27771 leader_election.cc:343] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.147364 27869 leader_election.cc:290] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.139626 27857 tablet_bootstrap.cc:654] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.159070 27659 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.164386 27858 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.160181 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b4a78f3069431e8967dd06c5afb21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.185127 27858 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.172559 27854 tablet_bootstrap.cc:654] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.222915 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:41.224629 27548 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.226069 27856 raft_consensus.cc:359] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.226827 27856 raft_consensus.cc:385] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.227121 27856 raft_consensus.cc:740] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.229676 27894 consensus_queue.cc:1048] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.230453 27858 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.230993 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.231678 27660 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:41.232568 27891 raft_consensus.cc:493] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.233054 27891 raft_consensus.cc:515] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.235666 27891 leader_election.cc:290] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.237282 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:41.238626 27626 leader_election.cc:343] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.240391 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:41.241824 27623 leader_election.cc:343] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.242275 27623 leader_election.cc:304] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:41.248770 27548 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:41.249959 27891 raft_consensus.cc:2749] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.252197 27853 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.252015 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 671844b3f7454ba090d35213702fd9bf (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:41.252714 27853 ts_tablet_manager.cc:1403] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.224s	user 0.011s	sys 0.016s
I20260709 13:09:41.253264 27857 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.259608 27857 ts_tablet_manager.cc:1403] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.003s
I20260709 13:09:41.261163 27570 tablet_service.cc:1511] Processing CreateTablet for tablet 8bba38370f374fe1b14351e6a8564476 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:41.253367 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671844b3f7454ba090d35213702fd9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.262445 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bba38370f374fe1b14351e6a8564476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.263778 27894 raft_consensus.cc:2804] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.264192 27894 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.264570 27894 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.269389 27659 raft_consensus.cc:2468] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:41.255533 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 671844b3f7454ba090d35213702fd9bf (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:41.292173 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671844b3f7454ba090d35213702fd9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.291898 27857 raft_consensus.cc:359] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.292812 27857 raft_consensus.cc:385] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.293243 27857 raft_consensus.cc:740] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.256130 27854 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.248574 27856 consensus_queue.cc:260] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.294476 27857 consensus_queue.cc:260] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.258106 27853 raft_consensus.cc:359] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.295908 27853 raft_consensus.cc:385] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.296216 27853 raft_consensus.cc:740] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.296917 27853 consensus_queue.cc:260] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.297847 27857 ts_tablet_manager.cc:1434] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:09:41.270471 27643 tablet_service.cc:1511] Processing CreateTablet for tablet 8bba38370f374fe1b14351e6a8564476 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:41.299198 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bba38370f374fe1b14351e6a8564476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.299234 27857 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.273113 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 8bba38370f374fe1b14351e6a8564476 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:41.304021 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bba38370f374fe1b14351e6a8564476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.273718 27789 tablet_service.cc:1511] Processing CreateTablet for tablet 9207861786984e7bb6b269ce94521002 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:41.307862 27857 tablet_bootstrap.cc:654] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.254308 27721 tablet_service.cc:1511] Processing CreateTablet for tablet 671844b3f7454ba090d35213702fd9bf (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:41.276173 27645 tablet_service.cc:1511] Processing CreateTablet for tablet 9207861786984e7bb6b269ce94521002 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:41.309356 27721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671844b3f7454ba090d35213702fd9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.309927 27869 raft_consensus.cc:493] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.310400 27869 raft_consensus.cc:515] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.312336 27869 leader_election.cc:290] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.276726 27722 tablet_service.cc:1511] Processing CreateTablet for tablet 2197e7fe7d9d495e94faf67b9540e800 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:41.313374 27722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2197e7fe7d9d495e94faf67b9540e800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.281205 27568 tablet_service.cc:1511] Processing CreateTablet for tablet 2197e7fe7d9d495e94faf67b9540e800 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:41.290542 27894 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.315724 27854 ts_tablet_manager.cc:1403] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.189s	user 0.004s	sys 0.017s
I20260709 13:09:41.315963 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2197e7fe7d9d495e94faf67b9540e800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.316900 27894 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.292213 27771 leader_election.cc:304] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:41.319788 27856 ts_tablet_manager.cc:1434] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.159s	user 0.011s	sys 0.012s
I20260709 13:09:41.321133 27856 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.322700 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:41.323596 27734 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.307926 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207861786984e7bb6b269ce94521002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.274636 27573 tablet_service.cc:1511] Processing CreateTablet for tablet 9207861786984e7bb6b269ce94521002 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:41.327986 27573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207861786984e7bb6b269ce94521002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.282866 27795 tablet_service.cc:1511] Processing CreateTablet for tablet 2197e7fe7d9d495e94faf67b9540e800 (DEFAULT_TABLE table=test-workload [id=33079f45a5114b2e861b7ba207c1fbf1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:41.332516 27795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2197e7fe7d9d495e94faf67b9540e800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:41.322773 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:41.335687 27659 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.309406 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9207861786984e7bb6b269ce94521002. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:41.339399 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 47284.2us
I20260709 13:09:41.341110 27734 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:41.341333 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.342298 27548 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.343143 27894 raft_consensus.cc:2804] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.343345 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.343640 27894 raft_consensus.cc:697] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:41.344024 27733 raft_consensus.cc:2468] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.344589 27894 consensus_queue.cc:237] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.345615 27771 leader_election.cc:304] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:41.351159 27854 raft_consensus.cc:359] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.352316 27854 raft_consensus.cc:385] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.352741 27854 raft_consensus.cc:740] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.353624 27869 raft_consensus.cc:2804] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.360136 27869 raft_consensus.cc:697] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:41.361131 27659 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:41.361290 27869 consensus_queue.cc:237] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:41.366526 27771 leader_election.cc:343] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.366753 27905 raft_consensus.cc:2804] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.367533 27905 raft_consensus.cc:493] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.367993 27905 raft_consensus.cc:3060] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.387046 27857 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.387625 27857 ts_tablet_manager.cc:1403] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.010s
I20260709 13:09:41.390158 27480 catalog_manager.cc:5697] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.393441 27905 raft_consensus.cc:515] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.384552 27854 consensus_queue.cc:260] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.398164 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
W20260709 13:09:41.409122 27771 leader_election.cc:343] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.400607 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:41.410183 27734 raft_consensus.cc:3060] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.412494 27857 raft_consensus.cc:359] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.413244 27857 raft_consensus.cc:385] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.395169 27856 tablet_bootstrap.cc:654] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.420354 27734 raft_consensus.cc:2468] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:41.416019 27853 ts_tablet_manager.cc:1434] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.163s	user 0.004s	sys 0.014s
I20260709 13:09:41.414978 27857 raft_consensus.cc:740] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.421695 27853 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.421566 27771 leader_election.cc:304] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:41.421473 27857 consensus_queue.cc:260] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.399464 27905 leader_election.cc:290] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.399132 27854 ts_tablet_manager.cc:1434] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.002s
I20260709 13:09:41.424367 27907 raft_consensus.cc:2804] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.432528 27854 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.440071 27856 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.440892 27856 ts_tablet_manager.cc:1403] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.003s
I20260709 13:09:41.442188 27854 tablet_bootstrap.cc:654] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.445309 27856 raft_consensus.cc:359] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.445847 27902 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.449057 27902 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.452167 27902 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.449062 27853 tablet_bootstrap.cc:654] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.452992 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.453955 27659 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:41.454250 27907 raft_consensus.cc:697] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:41.455322 27907 consensus_queue.cc:237] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.456174 27856 raft_consensus.cc:385] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.456617 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.456911 27856 raft_consensus.cc:740] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.458115 27548 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.461685 27902 raft_consensus.cc:2804] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.462172 27902 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.462842 27857 ts_tablet_manager.cc:1434] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.005s
I20260709 13:09:41.462818 27902 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.464299 27857 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.458207 27856 consensus_queue.cc:260] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.466300 27734 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:41.468559 27856 ts_tablet_manager.cc:1434] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:41.471998 27856 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.474473 27853 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.478516 27853 ts_tablet_manager.cc:1403] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.057s	user 0.000s	sys 0.014s
I20260709 13:09:41.483314 27857 tablet_bootstrap.cc:654] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.485647 27854 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.486339 27854 ts_tablet_manager.cc:1403] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.037s
I20260709 13:09:41.487600 27856 tablet_bootstrap.cc:654] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.489089 27902 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.494685 27857 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.495250 27857 ts_tablet_manager.cc:1403] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 13:09:41.490311 27854 raft_consensus.cc:359] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.490819 27853 raft_consensus.cc:359] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.496409 27854 raft_consensus.cc:385] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.496466 27853 raft_consensus.cc:385] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.496477 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:41.496891 27854 raft_consensus.cc:740] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.497126 27853 raft_consensus.cc:740] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.497516 27659 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.497996 27854 consensus_queue.cc:260] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.497996 27853 consensus_queue.cc:260] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.499449 27480 catalog_manager.cc:5697] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.500759 27853 ts_tablet_manager.cc:1434] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:09:41.501735 27853 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.501397 27480 catalog_manager.cc:5697] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.505666 27854 ts_tablet_manager.cc:1434] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:09:41.506759 27854 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.506846 27857 raft_consensus.cc:359] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.507619 27857 raft_consensus.cc:385] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.507910 27857 raft_consensus.cc:740] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.508730 27857 consensus_queue.cc:260] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.513378 27857 ts_tablet_manager.cc:1434] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:41.513466 27853 tablet_bootstrap.cc:654] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.514432 27857 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.515198 27854 tablet_bootstrap.cc:654] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.519448 27856 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.520012 27856 ts_tablet_manager.cc:1403] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.000s
I20260709 13:09:41.521540 27857 tablet_bootstrap.cc:654] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.523963 27856 raft_consensus.cc:359] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.524986 27856 raft_consensus.cc:385] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.525355 27856 raft_consensus.cc:740] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.528353 27856 consensus_queue.cc:260] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.530789 27856 ts_tablet_manager.cc:1434] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:41.531734 27856 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.541668 27853 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.542369 27853 ts_tablet_manager.cc:1403] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 13:09:41.544827 27659 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:41.548202 27548 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.545776 27853 raft_consensus.cc:359] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.549312 27853 raft_consensus.cc:385] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.545774 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:41.546140 27902 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:41.549571 27899 raft_consensus.cc:2804] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.550374 27734 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.550829 27899 raft_consensus.cc:697] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:41.552101 27899 consensus_queue.cc:237] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.551052 27856 tablet_bootstrap.cc:654] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.549631 27853 raft_consensus.cc:740] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.559401 27853 consensus_queue.cc:260] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.560459 27734 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:41.562685 27853 ts_tablet_manager.cc:1434] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:09:41.564492 27853 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.573045 27480 catalog_manager.cc:5697] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.577497 27856 tablet_bootstrap.cc:492] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.579499 27856 ts_tablet_manager.cc:1403] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:09:41.587899 27857 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.588056 27853 tablet_bootstrap.cc:654] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.588528 27857 ts_tablet_manager.cc:1403] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.034s
I20260709 13:09:41.583179 27856 raft_consensus.cc:359] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.589156 27856 raft_consensus.cc:385] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.589527 27856 raft_consensus.cc:740] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.588521 27854 tablet_bootstrap.cc:492] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.590667 27854 ts_tablet_manager.cc:1403] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.037s
I20260709 13:09:41.590281 27856 consensus_queue.cc:260] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.592542 27857 raft_consensus.cc:359] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.593839 27857 raft_consensus.cc:385] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.594200 27857 raft_consensus.cc:740] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.596123 27856 ts_tablet_manager.cc:1434] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:41.597175 27856 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.596712 27857 consensus_queue.cc:260] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.599201 27857 ts_tablet_manager.cc:1434] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:09:41.594156 27854 raft_consensus.cc:359] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.599795 27854 raft_consensus.cc:385] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.600167 27854 raft_consensus.cc:740] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.598021 27853 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.601577 27853 ts_tablet_manager.cc:1403] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260709 13:09:41.602563 27857 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.604633 27856 tablet_bootstrap.cc:654] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.601408 27854 consensus_queue.cc:260] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.604486 27853 raft_consensus.cc:359] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.605213 27853 raft_consensus.cc:385] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.605512 27853 raft_consensus.cc:740] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.606173 27853 consensus_queue.cc:260] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.607087 27854 ts_tablet_manager.cc:1434] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:09:41.611166 27853 ts_tablet_manager.cc:1434] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:41.611388 27854 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.612120 27853 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.617523 27857 tablet_bootstrap.cc:654] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.618438 27853 tablet_bootstrap.cc:654] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.623656 27907 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.624161 27907 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.626654 27854 tablet_bootstrap.cc:654] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.627771 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.628604 27734 raft_consensus.cc:2468] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.630225 27771 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:41.631374 27910 raft_consensus.cc:2804] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.631845 27910 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.632128 27910 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.633267 27853 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.633668 27857 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.634069 27853 ts_tablet_manager.cc:1403] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 13:09:41.634196 27857 ts_tablet_manager.cc:1403] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 13:09:41.638298 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.638141 27853 raft_consensus.cc:359] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.639393 27853 raft_consensus.cc:385] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:41.639895 27774 leader_election.cc:343] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.637377 27857 raft_consensus.cc:359] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.639801 27853 raft_consensus.cc:740] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.641923 27853 consensus_queue.cc:260] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.646035 27853 ts_tablet_manager.cc:1434] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:09:41.648262 27907 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.648813 27854 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.650274 27854 ts_tablet_manager.cc:1403] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:09:41.650404 27853 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.641002 27857 raft_consensus.cc:385] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.653597 27857 raft_consensus.cc:740] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.654366 27857 consensus_queue.cc:260] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.655386 27854 raft_consensus.cc:359] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.656038 27854 raft_consensus.cc:385] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.656299 27854 raft_consensus.cc:740] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.656957 27854 consensus_queue.cc:260] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.658682 27910 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.660655 27907 raft_consensus.cc:493] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.660815 27853 tablet_bootstrap.cc:654] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.665112 27907 raft_consensus.cc:515] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.666836 27910 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.667451 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:41.668026 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:41.662710 27857 ts_tablet_manager.cc:1434] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:09:41.664407 27854 ts_tablet_manager.cc:1434] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 13:09:41.669530 27774 leader_election.cc:343] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.669656 27854 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.668051 27734 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.673211 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:41.674582 27774 leader_election.cc:343] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.678416 27854 tablet_bootstrap.cc:654] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.680362 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
W20260709 13:09:41.681708 27771 leader_election.cc:343] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.682199 27771 leader_election.cc:304] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:41.683075 27910 raft_consensus.cc:2749] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.683534 27891 raft_consensus.cc:493] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.683983 27856 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.684062 27891 raft_consensus.cc:515] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.684860 27856 ts_tablet_manager.cc:1403] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.088s	user 0.036s	sys 0.032s
I20260709 13:09:41.686373 27891 leader_election.cc:290] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:41.683701 27907 leader_election.cc:290] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.681823 27857 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.688417 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.688472 27856 raft_consensus.cc:359] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.689347 27733 raft_consensus.cc:2393] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:41.689297 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23452fbc71a8440fa12d2eb0075c8e15" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.689262 27856 raft_consensus.cc:385] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.691534 27856 raft_consensus.cc:740] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.691623 27623 leader_election.cc:304] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:41.692925 27891 raft_consensus.cc:3060] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.698307 27857 tablet_bootstrap.cc:654] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.704680 27891 raft_consensus.cc:2749] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.705680 27891 raft_consensus.cc:493] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.706249 27891 raft_consensus.cc:515] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.712795 27856 consensus_queue.cc:260] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.715708 27856 ts_tablet_manager.cc:1434] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:09:41.716915 27856 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.725394 27907 raft_consensus.cc:493] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.725922 27907 raft_consensus.cc:515] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.727502 27867 raft_consensus.cc:493] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.728046 27907 leader_election.cc:290] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.728147 27867 raft_consensus.cc:515] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.729772 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.730443 27585 raft_consensus.cc:2468] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.702823 27734 raft_consensus.cc:2468] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:41.731619 27774 leader_election.cc:304] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.730468 27867 leader_election.cc:290] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:41.733073 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.733394 27907 raft_consensus.cc:2804] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.733785 27907 raft_consensus.cc:493] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.733721 27807 raft_consensus.cc:2468] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:41.733424 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.735142 27697 leader_election.cc:304] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:41.735816 27771 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
W20260709 13:09:41.736096 27697 leader_election.cc:343] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.736584 27867 raft_consensus.cc:2804] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.736965 27867 raft_consensus.cc:493] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.737337 27867 raft_consensus.cc:3060] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.737679 27929 raft_consensus.cc:493] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.737869 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.738719 27856 tablet_bootstrap.cc:654] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.738492 27929 raft_consensus.cc:515] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.741278 27910 raft_consensus.cc:2804] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.741813 27910 raft_consensus.cc:697] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:41.742166 27929 leader_election.cc:290] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.734246 27907 raft_consensus.cc:3060] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.743739 27854 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.744208 27854 ts_tablet_manager.cc:1403] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.003s
I20260709 13:09:41.731709 27891 leader_election.cc:290] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.742607 27659 raft_consensus.cc:2468] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.742656 27910 consensus_queue.cc:237] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.747539 27854 raft_consensus.cc:359] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.738545 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c47c6d89604d2d824d3ec0afaac896" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.748194 27854 raft_consensus.cc:385] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.748764 27854 raft_consensus.cc:740] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.749662 27854 consensus_queue.cc:260] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.750885 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.749073 27585 raft_consensus.cc:2468] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:41.752321 27584 raft_consensus.cc:2468] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:41.756711 27626 leader_election.cc:304] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.757719 27891 raft_consensus.cc:2804] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.758105 27891 raft_consensus.cc:493] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.757941 27626 leader_election.cc:304] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.758582 27891 raft_consensus.cc:3060] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.760178 27907 raft_consensus.cc:515] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.759056 27929 raft_consensus.cc:2804] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.762039 27929 raft_consensus.cc:493] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.762465 27929 raft_consensus.cc:3060] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.762837 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:41.763448 27584 raft_consensus.cc:3060] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.764019 27854 ts_tablet_manager.cc:1434] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:09:41.768221 27854 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.768510 27853 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.768942 27853 ts_tablet_manager.cc:1403] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.020s
I20260709 13:09:41.769829 27899 consensus_queue.cc:1048] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.771692 27853 raft_consensus.cc:359] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.772374 27853 raft_consensus.cc:385] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.772624 27853 raft_consensus.cc:740] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.773361 27853 consensus_queue.cc:260] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.774693 27854 tablet_bootstrap.cc:654] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.775374 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c47c6d89604d2d824d3ec0afaac896" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.776278 27807 raft_consensus.cc:2468] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:41.775400 27853 ts_tablet_manager.cc:1434] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:41.781705 27853 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:41.782137 27857 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:41.782691 27857 ts_tablet_manager.cc:1403] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.020s
I20260709 13:09:41.781939 27584 raft_consensus.cc:2468] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:41.785386 27774 leader_election.cc:304] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.786527 27910 raft_consensus.cc:2804] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.787139 27910 raft_consensus.cc:697] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:41.785415 27480 catalog_manager.cc:5697] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.788229 27910 consensus_queue.cc:237] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.794809 27857 raft_consensus.cc:359] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.795538 27857 raft_consensus.cc:385] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.795804 27857 raft_consensus.cc:740] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.798311 27857 consensus_queue.cc:260] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.796957 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.802096 27734 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.802577 27907 leader_election.cc:290] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.806677 27891 raft_consensus.cc:515] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.810364 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c47c6d89604d2d824d3ec0afaac896" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:41.810614 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:41.811410 27807 raft_consensus.cc:3060] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.811830 27899 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.813153 27911 consensus_queue.cc:1048] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.814942 27891 leader_election.cc:290] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.817859 27854 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:41.818313 27854 ts_tablet_manager.cc:1403] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.006s
I20260709 13:09:41.822618 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c47c6d89604d2d824d3ec0afaac896" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:41.823475 27584 raft_consensus.cc:3060] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.824292 27907 raft_consensus.cc:493] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.824952 27907 raft_consensus.cc:515] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.828387 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.829013 27585 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.829981 27856 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:41.830616 27856 ts_tablet_manager.cc:1403] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.012s
I20260709 13:09:41.830749 27907 leader_election.cc:290] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.830626 27774 leader_election.cc:304] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.833374 27899 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.833907 27907 raft_consensus.cc:2804] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.834293 27907 raft_consensus.cc:493] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.834616 27907 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.835567 27899 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:41.836094 27899 consensus_queue.cc:1048] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.836571 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.837684 27584 raft_consensus.cc:2468] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:41.838886 27626 leader_election.cc:304] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.841292 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:41.842437 27856 raft_consensus.cc:359] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.843114 27856 raft_consensus.cc:385] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.843416 27856 raft_consensus.cc:740] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.843230 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:41.847860 27734 raft_consensus.cc:2393] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:41.848544 27856 consensus_queue.cc:260] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.849493 27731 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:41.852334 27548 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:41.852243 27867 raft_consensus.cc:515] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.854440 27867 leader_election.cc:290] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:41.855551 27902 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.857378 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:41.858160 27808 raft_consensus.cc:3060] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.860375 27929 raft_consensus.cc:515] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.861647 27660 raft_consensus.cc:2393] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:41.863793 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:41.864809 27856 ts_tablet_manager.cc:1434] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
W20260709 13:09:41.865232 27697 leader_election.cc:343] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.866736 27857 ts_tablet_manager.cc:1434] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.003s
I20260709 13:09:41.865732 27856 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:41.868621 27857 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:41.821087 27854 raft_consensus.cc:359] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.871078 27854 raft_consensus.cc:385] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.871490 27854 raft_consensus.cc:740] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.873102 27933 raft_consensus.cc:2804] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.873646 27933 raft_consensus.cc:697] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:41.874465 27933 consensus_queue.cc:237] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.879004 27854 consensus_queue.cc:260] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.889828 27854 ts_tablet_manager.cc:1434] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:09:41.892243 27808 raft_consensus.cc:2468] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:41.893872 27697 leader_election.cc:304] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:41.894130 27853 tablet_bootstrap.cc:654] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.901060 27910 consensus_queue.cc:1048] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.898082 27867 raft_consensus.cc:493] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.904865 27929 leader_election.cc:290] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.904721 27867 raft_consensus.cc:515] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:41.910543 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:41.911036 27867 leader_election.cc:290] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:41.911662 27867 raft_consensus.cc:2804] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.911778 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.912195 27867 raft_consensus.cc:697] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:41.912484 27584 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:41.912994 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:41.913086 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e19a56e4af742289da53021053e2e16" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:41.913678 27660 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:41.913172 27867 consensus_queue.cc:237] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.914167 27585 raft_consensus.cc:2393] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:41.914077 27700 leader_election.cc:304] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:41.916455 27857 tablet_bootstrap.cc:654] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.912115 27902 raft_consensus.cc:2749] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.909297 27807 raft_consensus.cc:2468] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:41.922501 27854 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:41.924347 27856 tablet_bootstrap.cc:654] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.918136 27907 raft_consensus.cc:515] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:41.928009 27626 leader_election.cc:304] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:41.929198 27933 raft_consensus.cc:2749] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.938767 27480 catalog_manager.cc:5697] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.940282 27910 consensus_queue.cc:1048] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.950265 27940 raft_consensus.cc:2804] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.952569 27940 raft_consensus.cc:493] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.952976 27940 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.955574 27902 consensus_queue.cc:1048] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.958002 27854 tablet_bootstrap.cc:654] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.965958 27853 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:41.966471 27853 ts_tablet_manager.cc:1403] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.005s
I20260709 13:09:41.977890 27853 raft_consensus.cc:359] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.980314 27853 raft_consensus.cc:385] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.980657 27853 raft_consensus.cc:740] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.981508 27853 consensus_queue.cc:260] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.936219 27479 catalog_manager.cc:5697] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.972803 27939 raft_consensus.cc:493] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6352477d8f544921a79fe2a8a4b84c91)
I20260709 13:09:41.992543 27942 raft_consensus.cc:493] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.994967 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:41.995100 27942 raft_consensus.cc:515] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:41.995100 27939 raft_consensus.cc:515] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:41.998695 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:41.999979 27942 leader_election.cc:290] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:41.974274 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:42.000691 27730 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.000762 27939 leader_election.cc:290] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.001643 27940 raft_consensus.cc:515] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.001857 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.002732 27807 raft_consensus.cc:2468] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:42.003824 27940 leader_election.cc:290] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.008420 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.010253 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.011350 27623 leader_election.cc:304] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:42.011866 27856 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.012317 27856 ts_tablet_manager.cc:1403] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.017s
I20260709 13:09:42.015043 27856 raft_consensus.cc:359] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.015727 27856 raft_consensus.cc:385] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.015522 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.016085 27856 raft_consensus.cc:740] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.016402 27585 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.016810 27856 consensus_queue.cc:260] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
W20260709 13:09:42.016398 27626 leader_election.cc:343] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.021798 27697 leader_election.cc:304] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.019225 27856 ts_tablet_manager.cc:1434] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 13:09:41.972084 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 57823.2us
I20260709 13:09:42.028736 27853 ts_tablet_manager.cc:1434] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 13:09:42.005110 27907 leader_election.cc:290] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.030901 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:42.031716 27659 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.033859 27585 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:42.029690 27856 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:42.035305 27774 leader_election.cc:304] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.036226 27910 raft_consensus.cc:2804] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.036707 27910 raft_consensus.cc:697] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:42.037532 27910 consensus_queue.cc:237] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.028447 27867 raft_consensus.cc:2749] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:42.041189 27856 tablet_bootstrap.cc:654] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.029827 27853 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.028656 27942 raft_consensus.cc:2804] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.043087 27942 raft_consensus.cc:493] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.043610 27942 raft_consensus.cc:3060] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.046058 27945 log.cc:927] Time spent T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:09:42.052255 27952 log.cc:927] Time spent T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:42.055006 27857 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:42.055510 27933 raft_consensus.cc:493] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.055737 27857 ts_tablet_manager.cc:1403] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.187s	user 0.024s	sys 0.010s
I20260709 13:09:42.056041 27933 raft_consensus.cc:515] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.058357 27933 leader_election.cc:290] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.060503 27730 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:42.062193 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.068416 27942 raft_consensus.cc:515] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.069419 27584 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:42.070832 27942 leader_election.cc:290] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.074190 27626 leader_election.cc:304] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.076797 27857 raft_consensus.cc:359] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.077850 27857 raft_consensus.cc:385] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.078239 27857 raft_consensus.cc:740] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.078828 27942 raft_consensus.cc:2804] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.098358 27942 raft_consensus.cc:493] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.076000 27903 consensus_queue.cc:1048] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:09:42.098894 27942 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.098694 27857 consensus_queue.cc:260] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.091542 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.097317 27854 tablet_bootstrap.cc:492] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:42.103117 27854 ts_tablet_manager.cc:1403] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.016s
I20260709 13:09:42.105237 27857 ts_tablet_manager.cc:1434] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.049s	user 0.015s	sys 0.012s
I20260709 13:09:42.077314 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.100549 27659 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:42.106148 27857 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
W20260709 13:09:42.108608 27626 leader_election.cc:343] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.107560 27585 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.112967 27697 leader_election.cc:304] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:42.114310 27867 raft_consensus.cc:2804] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.114787 27867 raft_consensus.cc:697] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:42.115799 27857 tablet_bootstrap.cc:654] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.115602 27867 consensus_queue.cc:237] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
W20260709 13:09:42.102306 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 45876.7us
I20260709 13:09:42.117913 27856 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.118391 27853 tablet_bootstrap.cc:654] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.118446 27856 ts_tablet_manager.cc:1403] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.025s
I20260709 13:09:42.121925 27856 raft_consensus.cc:359] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.122805 27856 raft_consensus.cc:385] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.123184 27856 raft_consensus.cc:740] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.124148 27856 consensus_queue.cc:260] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.111023 27854 raft_consensus.cc:359] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.127306 27854 raft_consensus.cc:385] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.127756 27854 raft_consensus.cc:740] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.128594 27854 consensus_queue.cc:260] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.130183 27585 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:42.130735 27480 catalog_manager.cc:5697] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.132472 27854 ts_tablet_manager.cc:1434] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:42.134209 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.134578 27854 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:42.134902 27808 raft_consensus.cc:3060] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.132546 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.134462 27856 ts_tablet_manager.cc:1434] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:42.137765 27856 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:42.138998 27807 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:42.146860 27808 raft_consensus.cc:2468] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:42.154037 27853 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.157210 27853 ts_tablet_manager.cc:1403] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.011s
I20260709 13:09:42.159595 27854 tablet_bootstrap.cc:654] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.159171 27942 raft_consensus.cc:515] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.161476 27942 leader_election.cc:290] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.162562 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.163717 27856 tablet_bootstrap.cc:654] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.162292 27853 raft_consensus.cc:359] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.165304 27623 leader_election.cc:304] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.165802 27853 raft_consensus.cc:385] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.166122 27853 raft_consensus.cc:740] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.166422 27942 raft_consensus.cc:2804] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.167191 27907 consensus_queue.cc:1048] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.165338 27585 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.169919 27942 raft_consensus.cc:697] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:42.170828 27942 consensus_queue.cc:237] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.171650 27853 consensus_queue.cc:260] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.179152 27479 catalog_manager.cc:5697] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.180629 27857 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:42.181250 27857 ts_tablet_manager.cc:1403] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.003s
I20260709 13:09:42.182574 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.184607 27857 raft_consensus.cc:359] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.185392 27857 raft_consensus.cc:385] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.185673 27857 raft_consensus.cc:740] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.186427 27857 consensus_queue.cc:260] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.188683 27857 ts_tablet_manager.cc:1434] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:42.189047 27808 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.189641 27857 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:42.191591 27585 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:42.192715 27626 leader_election.cc:304] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.195291 27933 raft_consensus.cc:2804] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.195819 27933 raft_consensus.cc:697] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:42.196893 27808 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:42.196674 27933 consensus_queue.cc:237] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.197652 27857 tablet_bootstrap.cc:654] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.199873 27911 consensus_queue.cc:1048] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.215952 27903 raft_consensus.cc:493] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.216506 27903 raft_consensus.cc:515] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.218752 27903 leader_election.cc:290] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.219213 27853 ts_tablet_manager.cc:1434] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:09:42.220343 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.221674 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.223397 27853 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
W20260709 13:09:42.227933 27548 leader_election.cc:343] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.230748 27853 tablet_bootstrap.cc:654] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.230909 27548 leader_election.cc:343] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.232306 27548 leader_election.cc:304] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.233438 27903 raft_consensus.cc:2749] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.237001 27854 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:42.237637 27854 ts_tablet_manager.cc:1403] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.003s
I20260709 13:09:42.244911 27854 raft_consensus.cc:359] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.245620 27854 raft_consensus.cc:385] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.245903 27854 raft_consensus.cc:740] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.246557 27853 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.246654 27854 consensus_queue.cc:260] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.247170 27853 ts_tablet_manager.cc:1403] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 13:09:42.253798 27856 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.254204 27854 ts_tablet_manager.cc:1434] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:09:42.254585 27856 ts_tablet_manager.cc:1403] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.026s
I20260709 13:09:42.254472 27853 raft_consensus.cc:359] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.255191 27854 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:42.255563 27853 raft_consensus.cc:385] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.255930 27853 raft_consensus.cc:740] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.256256 27910 consensus_queue.cc:1048] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.256721 27853 consensus_queue.cc:260] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.258930 27853 ts_tablet_manager.cc:1434] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:42.260515 27853 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.257496 27856 raft_consensus.cc:359] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.263864 27856 raft_consensus.cc:385] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.262354 27480 catalog_manager.cc:5697] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.264154 27856 raft_consensus.cc:740] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.267299 27854 tablet_bootstrap.cc:654] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.267905 27856 consensus_queue.cc:260] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.271098 27853 tablet_bootstrap.cc:654] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.271657 27857 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:42.274026 27857 ts_tablet_manager.cc:1403] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.017s
I20260709 13:09:42.274248 27856 ts_tablet_manager.cc:1434] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:42.275236 27856 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:42.276809 27857 raft_consensus.cc:359] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.285737 27867 raft_consensus.cc:493] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.287953 27857 raft_consensus.cc:385] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.288312 27857 raft_consensus.cc:740] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.288097 27867 raft_consensus.cc:515] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.289075 27857 consensus_queue.cc:260] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.290302 27867 leader_election.cc:290] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.286368 27910 consensus_queue.cc:1048] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.291654 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.292202 27857 ts_tablet_manager.cc:1434] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:42.292413 27658 raft_consensus.cc:2468] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.293633 27857 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:42.295682 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.294287 27697 leader_election.cc:304] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:42.296329 27585 raft_consensus.cc:2468] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.296702 27856 tablet_bootstrap.cc:654] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.296778 27867 raft_consensus.cc:2804] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.297240 27867 raft_consensus.cc:493] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.297583 27867 raft_consensus.cc:3060] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.301553 27857 tablet_bootstrap.cc:654] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.304275 27481 catalog_manager.cc:5697] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.306317 27853 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.306597 27933 raft_consensus.cc:493] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.306839 27853 ts_tablet_manager.cc:1403] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.005s
I20260709 13:09:42.307097 27933 raft_consensus.cc:515] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.308369 27854 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:42.309000 27854 ts_tablet_manager.cc:1403] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.006s
I20260709 13:09:42.309242 27933 leader_election.cc:290] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.309979 27853 raft_consensus.cc:359] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.310681 27853 raft_consensus.cc:385] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.311007 27853 raft_consensus.cc:740] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.311406 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.311924 27853 consensus_queue.cc:260] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:42.312832 27623 leader_election.cc:343] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.314210 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.315650 27853 ts_tablet_manager.cc:1434] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
W20260709 13:09:42.315833 27623 leader_election.cc:343] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.316367 27623 leader_election.cc:304] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.317237 27933 raft_consensus.cc:2749] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.318264 27853 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.318416 27854 raft_consensus.cc:359] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.320902 27854 raft_consensus.cc:385] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.321203 27854 raft_consensus.cc:740] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.322091 27854 consensus_queue.cc:260] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.324442 27854 ts_tablet_manager.cc:1434] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:09:42.325115 27856 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.325296 27854 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:42.325588 27856 ts_tablet_manager.cc:1403] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.011s
I20260709 13:09:42.328783 27856 raft_consensus.cc:359] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.329425 27856 raft_consensus.cc:385] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.329700 27856 raft_consensus.cc:740] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.330341 27856 consensus_queue.cc:260] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.331490 27854 tablet_bootstrap.cc:654] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.332515 27853 tablet_bootstrap.cc:654] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.336217 27856 ts_tablet_manager.cc:1434] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:42.337476 27856 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:42.345444 27854 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:42.346097 27854 ts_tablet_manager.cc:1403] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:09:42.350034 27854 raft_consensus.cc:359] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.350876 27854 raft_consensus.cc:385] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.351215 27854 raft_consensus.cc:740] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.352015 27853 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.352188 27854 consensus_queue.cc:260] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.353003 27853 ts_tablet_manager.cc:1403] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 13:09:42.353417 27933 consensus_queue.cc:1048] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.354609 27856 tablet_bootstrap.cc:654] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.357501 27853 raft_consensus.cc:359] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.362893 27853 raft_consensus.cc:385] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.360816 27854 ts_tablet_manager.cc:1434] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:42.369191 27940 raft_consensus.cc:493] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.369758 27854 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:42.369686 27940 raft_consensus.cc:515] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.371826 27940 leader_election.cc:290] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.372253 27853 raft_consensus.cc:740] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.372886 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.373381 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.378042 27658 raft_consensus.cc:2468] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.374548 27899 raft_consensus.cc:493] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.378249 27853 consensus_queue.cc:260] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:42.378993 27700 leader_election.cc:343] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.379077 27899 raft_consensus.cc:515] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.382130 27853 ts_tablet_manager.cc:1434] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:09:42.384516 27853 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.388320 27903 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.376845 27854 tablet_bootstrap.cc:654] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.388863 27903 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.384351 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.391870 27807 raft_consensus.cc:2393] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:42.382339 27899 leader_election.cc:290] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.375301 27867 raft_consensus.cc:515] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.400645 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.401301 27910 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.401367 27957 consensus_queue.cc:1048] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.402014 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.402103 27933 raft_consensus.cc:493] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.424612 27933 raft_consensus.cc:515] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.406169 27853 tablet_bootstrap.cc:654] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.409924 27929 consensus_queue.cc:1048] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.411029 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c61d995a55841e7b383d1ab3091c2e5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.391095 27903 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.421703 27730 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:42.418854 27697 leader_election.cc:304] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.422150 27910 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.432514 27857 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:42.438884 27857 ts_tablet_manager.cc:1403] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.145s	user 0.027s	sys 0.027s
W20260709 13:09:42.440245 27697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 60260us
I20260709 13:09:42.439241 27899 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.441177 27899 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.443337 27910 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.444988 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.445601 27660 raft_consensus.cc:3060] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.446113 27808 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:42.447855 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.448777 27585 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:42.449437 27548 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.450093 27481 catalog_manager.cc:5697] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.451520 27903 raft_consensus.cc:2804] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.452059 27903 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.452535 27903 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.453545 27939 raft_consensus.cc:2804] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.453760 27856 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.453994 27939 raft_consensus.cc:493] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.454272 27856 ts_tablet_manager.cc:1403] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.117s	user 0.043s	sys 0.030s
I20260709 13:09:42.454351 27939 raft_consensus.cc:3060] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.457516 27940 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.458163 27940 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.461920 27939 raft_consensus.cc:515] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.462855 27774 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.470446 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.465855 27856 raft_consensus.cc:359] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.453187 27857 raft_consensus.cc:359] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.473320 27856 raft_consensus.cc:385] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.473750 27856 raft_consensus.cc:740] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.469395 27867 leader_election.cc:290] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.473379 27857 raft_consensus.cc:385] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.470736 27548 leader_election.cc:304] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.426820 27933 leader_election.cc:290] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.475297 27857 raft_consensus.cc:740] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.479929 27857 consensus_queue.cc:260] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.480485 27899 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.467542 27939 leader_election.cc:290] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.473935 27940 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.480391 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.481158 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.481772 27582 raft_consensus.cc:3060] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.481827 27585 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.485776 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.486419 27807 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.488124 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.488718 27730 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:42.489375 27957 raft_consensus.cc:2804] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.489696 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.489897 27957 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.490381 27731 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:42.486845 27903 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.493940 27903 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.494089 27894 raft_consensus.cc:3060] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.477584 27856 consensus_queue.cc:260] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.495332 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.496160 27808 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:42.497450 27940 consensus_queue.cc:1048] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.488533 27700 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
W20260709 13:09:42.499830 27700 leader_election.cc:343] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.500847 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:42.501168 27940 raft_consensus.cc:2804] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.501730 27940 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.502154 27940 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.502298 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec9b17465d14db4b8a89886a3edcdbc" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:42.509385 27857 ts_tablet_manager.cc:1434] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:09:42.510669 27857 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:42.511472 27658 raft_consensus.cc:3060] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.517520 27548 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.519443 27899 raft_consensus.cc:2804] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.519829 27899 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.520177 27899 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.521255 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:42.521871 27731 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.523733 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.503217 27657 raft_consensus.cc:3060] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.528803 27582 raft_consensus.cc:2468] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:42.530427 27731 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:42.530651 27700 leader_election.cc:304] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.490442 27957 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.531718 27548 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.532677 27903 raft_consensus.cc:2804] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.533169 27903 raft_consensus.cc:697] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:42.534013 27903 consensus_queue.cc:237] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.537058 27940 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.537484 27910 consensus_queue.cc:1048] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.496179 27856 ts_tablet_manager.cc:1434] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 13:09:42.531785 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f54782de6c64f439dcec5270aad77d2" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.565007 27939 raft_consensus.cc:2804] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.582352 27857 tablet_bootstrap.cc:654] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.580124 27939 raft_consensus.cc:697] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:42.587450 27939 consensus_queue.cc:237] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.595575 27910 consensus_queue.cc:1048] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.600960 27856 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:42.603874 27853 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.603799 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.604506 27853 ts_tablet_manager.cc:1403] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.220s	user 0.045s	sys 0.070s
I20260709 13:09:42.607288 27853 raft_consensus.cc:359] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.607962 27853 raft_consensus.cc:385] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.608263 27853 raft_consensus.cc:740] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.583232 27894 raft_consensus.cc:2749] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.609776 27853 consensus_queue.cc:260] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.607750 27940 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:42.609984 27975 log.cc:927] Time spent T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:09:42.623850 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.627158 27867 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.627583 27854 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:42.627874 27657 raft_consensus.cc:2468] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:42.629627 27623 leader_election.cc:304] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.642201 27854 ts_tablet_manager.cc:1403] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.273s	user 0.026s	sys 0.014s
I20260709 13:09:42.631072 27907 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.682204 27939 consensus_queue.cc:1048] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.683439 27907 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.643663 27807 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.687440 27929 raft_consensus.cc:2749] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.702116 27853 ts_tablet_manager.cc:1434] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.097s	user 0.017s	sys 0.024s
I20260709 13:09:42.703424 27853 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.708973 27853 tablet_bootstrap.cc:654] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.673692 27867 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.709215 27957 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.719595 27856 tablet_bootstrap.cc:654] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.690958 27623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:35273, user_credentials={real_user=slave}} blocked reactor thread for 60270us
I20260709 13:09:42.729621 27854 raft_consensus.cc:359] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.726023 27992 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.730708 27854 raft_consensus.cc:385] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.731854 27854 raft_consensus.cc:740] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.721557 27867 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.741132 27806 raft_consensus.cc:2393] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:42.742331 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.743325 27807 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
W20260709 13:09:42.749266 27697 leader_election.cc:343] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.725374 27933 consensus_queue.cc:1048] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:42.761929 27854 consensus_queue.cc:260] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:42.764505 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.769441 27658 raft_consensus.cc:2468] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:42.772018 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.772660 27957 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.772794 27899 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.738126 27992 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.777853 27992 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:42.752650 27907 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.780531 27582 raft_consensus.cc:2393] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:42.779779 27899 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:42.787937 27929 consensus_queue.cc:1048] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:09:42.783651 27774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 50360.8us
I20260709 13:09:42.783206 27584 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:42.796104 27854 ts_tablet_manager.cc:1434] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.002s
I20260709 13:09:42.797334 27854 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:42.788022 27942 consensus_queue.cc:1048] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:42.800236 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.800688 27942 raft_consensus.cc:493] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.801174 27942 raft_consensus.cc:515] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.803442 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:42.803527 27697 leader_election.cc:304] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.804286 27731 raft_consensus.cc:2393] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:42.801668 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.807061 27853 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:42.794159 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:42.807528 27853 ts_tablet_manager.cc:1403] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.006s
I20260709 13:09:42.804980 27867 raft_consensus.cc:2804] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.812526 27734 raft_consensus.cc:2393] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:42.812759 27697 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.813612 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.814009 27939 raft_consensus.cc:2804] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.814471 27804 raft_consensus.cc:2393] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:42.812690 27940 consensus_queue.cc:1048] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.809695 27733 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:42.817903 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.798365 27933 consensus_queue.cc:1048] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:09:42.820559 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.821676 27548 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.827033 27986 raft_consensus.cc:2804] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.828161 27986 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.808072 27942 leader_election.cc:290] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:42.830643 27993 raft_consensus.cc:493] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.831115 27993 raft_consensus.cc:515] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.832144 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.833163 27993 leader_election.cc:290] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.829360 27986 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.834676 27700 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:42.835917 27940 raft_consensus.cc:2804] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.836293 27940 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.836606 27940 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.829864 27548 leader_election.cc:343] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.844328 27989 consensus_queue.cc:1048] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:09:42.871621 27939 raft_consensus.cc:697] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:42.859292 27771 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.876343 27853 raft_consensus.cc:359] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.877051 27853 raft_consensus.cc:385] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.876996 27481 catalog_manager.cc:5697] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:42.873099 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 43872.8us
I20260709 13:09:42.880460 27548 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:42.877511 27853 raft_consensus.cc:740] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.881485 27853 consensus_queue.cc:260] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.882689 27804 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.883780 27894 raft_consensus.cc:2749] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.885676 27583 raft_consensus.cc:2468] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:42.886190 27986 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.886507 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:42.887193 27580 raft_consensus.cc:2468] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:42.888521 27853 ts_tablet_manager.cc:1434] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:09:42.889241 27853 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:42.894590 27939 consensus_queue.cc:237] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:42.896442 27988 log.cc:927] Time spent T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:09:42.903110 27626 leader_election.cc:304] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.905234 27933 raft_consensus.cc:2804] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.905606 27933 raft_consensus.cc:493] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.905992 27933 raft_consensus.cc:3060] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.906944 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 77108.6us
I20260709 13:09:42.870738 27867 raft_consensus.cc:697] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:42.914700 27986 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:42.914963 27774 leader_election.cc:304] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:42.915838 27911 raft_consensus.cc:2804] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.916188 27911 raft_consensus.cc:493] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.916536 27911 raft_consensus.cc:3060] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.916927 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:42.920145 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
W20260709 13:09:42.921531 27548 leader_election.cc:343] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.908051 27771 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.932377 27940 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.935708 27733 raft_consensus.cc:2393] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:42.936120 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.936931 27578 raft_consensus.cc:2393] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:42.937271 27940 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.938459 27997 raft_consensus.cc:2749] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.943819 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.944346 27548 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:42.943799 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:42.947183 27899 raft_consensus.cc:493] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.947650 27899 raft_consensus.cc:515] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.949641 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:42.947939 27986 raft_consensus.cc:2749] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.949813 27899 leader_election.cc:290] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
W20260709 13:09:42.945168 27771 leader_election.cc:343] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:42.966605 27697 leader_election.cc:343] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.967136 27697 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:42.968564 27857 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:42.969218 27857 ts_tablet_manager.cc:1403] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.459s	user 0.009s	sys 0.009s
W20260709 13:09:42.969285 27623 leader_election.cc:343] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.971614 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:42.971819 27481 catalog_manager.cc:5697] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.975292 27899 consensus_queue.cc:1048] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.975764 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce64c49f3477473ba51466f3775c419e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:42.976570 27658 raft_consensus.cc:2393] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:42.978013 27856 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:42.978516 27856 ts_tablet_manager.cc:1403] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.378s	user 0.029s	sys 0.008s
I20260709 13:09:42.978313 27548 leader_election.cc:304] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
W20260709 13:09:42.979034 27995 log.cc:927] Time spent T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:42.981315 27899 raft_consensus.cc:3060] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.981474 27911 raft_consensus.cc:515] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.984316 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.984887 27585 raft_consensus.cc:3060] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.985697 27854 tablet_bootstrap.cc:654] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.986534 27867 consensus_queue.cc:237] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:42.956498 27933 raft_consensus.cc:515] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:42.989614 27857 raft_consensus.cc:359] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:42.990290 27857 raft_consensus.cc:385] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.990545 27857 raft_consensus.cc:740] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.992352 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:42.992545 27911 leader_election.cc:290] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:42.993374 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:42.994760 27578 raft_consensus.cc:3060] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.994948 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
W20260709 13:09:42.995616 27623 leader_election.cc:343] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.996299 28001 raft_consensus.cc:2749] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:09:42.996865 27771 leader_election.cc:343] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.998210 27853 tablet_bootstrap.cc:654] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.001231 27857 consensus_queue.cc:260] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.006055 27857 ts_tablet_manager.cc:1434] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:09:42.997814 27933 leader_election.cc:290] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.008447 27856 raft_consensus.cc:359] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.009038 27856 raft_consensus.cc:385] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.009270 27856 raft_consensus.cc:740] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.009974 27856 consensus_queue.cc:260] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.014034 27856 ts_tablet_manager.cc:1434] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 13:09:43.022555 27899 raft_consensus.cc:2749] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.028278 27578 raft_consensus.cc:2468] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:43.037509 27626 leader_election.cc:304] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:43.038549 27910 raft_consensus.cc:2749] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.040509 27585 raft_consensus.cc:2468] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:43.040937 27929 raft_consensus.cc:2804] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.041435 27929 raft_consensus.cc:697] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:43.050793 27774 leader_election.cc:304] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:43.052886 27929 consensus_queue.cc:237] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.056493 27911 raft_consensus.cc:2804] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.065112 27911 raft_consensus.cc:697] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:43.074622 27911 consensus_queue.cc:237] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.082093 27854 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.082594 27854 ts_tablet_manager.cc:1403] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.286s	user 0.017s	sys 0.009s
I20260709 13:09:43.087839 27989 consensus_queue.cc:1048] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.105383 27856 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
W20260709 13:09:43.099812 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 49878.7us
I20260709 13:09:43.110924 27899 consensus_queue.cc:1048] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.131688 27857 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
W20260709 13:09:43.138199 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.144883 27853 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:43.145733 27853 ts_tablet_manager.cc:1403] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.017s
I20260709 13:09:43.149930 28023 consensus_queue.cc:1048] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.150347 27942 raft_consensus.cc:493] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.150868 27942 raft_consensus.cc:515] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.153034 27942 leader_election.cc:290] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.155827 27856 tablet_bootstrap.cc:654] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.155751 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.155751 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:43.168032 27623 leader_election.cc:343] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:43.191414 27623 leader_election.cc:343] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.191882 27623 leader_election.cc:304] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:43.192632 27942 raft_consensus.cc:2749] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.195389 27854 raft_consensus.cc:359] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.196372 27854 raft_consensus.cc:385] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.196782 27854 raft_consensus.cc:740] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.197741 27854 consensus_queue.cc:260] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:43.198820 28017 log.cc:927] Time spent T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:09:43.208791 27854 ts_tablet_manager.cc:1434] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.001s
I20260709 13:09:43.200064 27479 catalog_manager.cc:5697] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.201944 27853 raft_consensus.cc:359] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.209450 27853 raft_consensus.cc:385] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.209738 27854 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.209736 27853 raft_consensus.cc:740] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.210810 27857 tablet_bootstrap.cc:654] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.211517 27853 consensus_queue.cc:260] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.213548 27853 ts_tablet_manager.cc:1434] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:09:43.214169 27853 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:43.216348 27479 catalog_manager.cc:5697] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.228008 27857 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.228582 27857 ts_tablet_manager.cc:1403] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.005s
I20260709 13:09:43.230051 27854 tablet_bootstrap.cc:654] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.230712 27856 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.231170 27856 ts_tablet_manager.cc:1403] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.006s
I20260709 13:09:43.231652 27857 raft_consensus.cc:359] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.232402 27857 raft_consensus.cc:385] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.232836 27857 raft_consensus.cc:740] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.233733 27857 consensus_queue.cc:260] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.234894 27856 raft_consensus.cc:359] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.235596 27856 raft_consensus.cc:385] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.235862 27856 raft_consensus.cc:740] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.236769 27857 ts_tablet_manager.cc:1434] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:43.238119 27857 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.239974 27997 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.236506 27856 consensus_queue.cc:260] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.240444 27997 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.241598 27854 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.242059 27854 ts_tablet_manager.cc:1403] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 13:09:43.242067 27856 ts_tablet_manager.cc:1434] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:43.242599 27997 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.243414 27856 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.244583 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:43.244997 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.246053 27929 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.246575 27929 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:43.246093 27771 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.248869 27929 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.250638 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:43.251377 27733 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
W20260709 13:09:43.252631 27774 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.252777 27854 raft_consensus.cc:359] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.253572 27854 raft_consensus.cc:385] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.254889 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.254899 27623 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:43.255817 27481 catalog_manager.cc:5697] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:43.256994 27623 leader_election.cc:343] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.257856 27929 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.258253 27929 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.258589 27929 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.259558 27774 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.253654 27857 tablet_bootstrap.cc:654] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.261344 27997 raft_consensus.cc:2749] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.262008 27997 raft_consensus.cc:493] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.262408 27997 raft_consensus.cc:515] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.263739 27856 tablet_bootstrap.cc:654] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.265964 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.264602 27997 leader_election.cc:290] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.266826 27582 raft_consensus.cc:2393] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:43.268095 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fceb102b02094b29b56578adb3b10bc5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.269980 27771 leader_election.cc:304] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.271387 27911 raft_consensus.cc:3060] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.254468 27854 raft_consensus.cc:740] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.274192 27854 consensus_queue.cc:260] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.276511 27853 tablet_bootstrap.cc:654] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.277959 27854 ts_tablet_manager.cc:1434] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:43.279331 27854 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.295939 27482 catalog_manager.cc:5697] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.312290 27856 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.312834 27856 ts_tablet_manager.cc:1403] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.004s
I20260709 13:09:43.316340 27856 raft_consensus.cc:359] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.317200 27856 raft_consensus.cc:385] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.311335 27929 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.317497 27856 raft_consensus.cc:740] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.319033 27856 consensus_queue.cc:260] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.321485 27856 ts_tablet_manager.cc:1434] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:43.322489 27857 tablet_bootstrap.cc:492] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.322844 27853 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:43.322965 27857 ts_tablet_manager.cc:1403] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.027s
I20260709 13:09:43.324579 27854 tablet_bootstrap.cc:654] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.325271 27853 ts_tablet_manager.cc:1403] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.008s
I20260709 13:09:43.325852 27856 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.331343 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:43.332103 27733 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.331993 27929 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.332418 27857 raft_consensus.cc:359] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.333159 27857 raft_consensus.cc:385] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.333452 27857 raft_consensus.cc:740] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.334977 27856 tablet_bootstrap.cc:654] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.336773 27911 raft_consensus.cc:2749] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.339201 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
W20260709 13:09:43.345300 27623 leader_election.cc:343] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.347910 27856 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.348412 27856 ts_tablet_manager.cc:1403] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:09:43.349848 27733 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:43.328296 27853 raft_consensus.cc:359] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.350926 27853 raft_consensus.cc:385] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.351240 27853 raft_consensus.cc:740] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.351076 27623 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:43.351446 27856 raft_consensus.cc:359] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.352358 27929 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.352413 27856 raft_consensus.cc:385] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.352921 27856 raft_consensus.cc:740] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.352967 27929 raft_consensus.cc:697] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:43.353821 27856 consensus_queue.cc:260] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.353976 27929 consensus_queue.cc:237] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.354651 27854 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.355188 27854 ts_tablet_manager.cc:1403] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.016s
I20260709 13:09:43.356026 27856 ts_tablet_manager.cc:1434] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:43.357030 27856 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.358100 27854 raft_consensus.cc:359] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.358831 27854 raft_consensus.cc:385] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.358639 27853 consensus_queue.cc:260] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.359177 27854 raft_consensus.cc:740] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.362232 27854 consensus_queue.cc:260] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.363019 27856 tablet_bootstrap.cc:654] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.342877 27857 consensus_queue.cc:260] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.366864 27911 raft_consensus.cc:493] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.368839 27857 ts_tablet_manager.cc:1434] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:09:43.369923 27857 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.370200 27854 ts_tablet_manager.cc:1434] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:43.370962 27854 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.371233 27911 raft_consensus.cc:515] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.371503 27480 catalog_manager.cc:5697] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.375200 27854 tablet_bootstrap.cc:654] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.376492 27856 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.376371 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.376672 27992 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.376992 27856 ts_tablet_manager.cc:1403] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:09:43.377218 27992 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.379839 27992 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.379993 27856 raft_consensus.cc:359] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.382086 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.377087 27657 raft_consensus.cc:2468] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:43.382947 27806 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:43.383870 27771 leader_election.cc:304] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:43.384791 27957 raft_consensus.cc:2804] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.384676 27548 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:43.385401 27957 raft_consensus.cc:493] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.385802 27957 raft_consensus.cc:3060] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.386425 27992 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.387008 27992 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.387544 27992 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.391636 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:43.392916 27548 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.380697 27856 raft_consensus.cc:385] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.401567 27856 raft_consensus.cc:740] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.364331 27853 ts_tablet_manager.cc:1434] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:09:43.402302 27856 consensus_queue.cc:260] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.394953 27957 raft_consensus.cc:515] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.405009 27856 ts_tablet_manager.cc:1434] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:43.407322 27856 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.408088 27854 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.408543 27854 ts_tablet_manager.cc:1403] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.016s
I20260709 13:09:43.410028 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:43.410753 27733 raft_consensus.cc:2468] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:43.411480 27854 raft_consensus.cc:359] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.412165 27854 raft_consensus.cc:385] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.412380 27853 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:43.412441 27854 raft_consensus.cc:740] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.415710 27854 consensus_queue.cc:260] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.416154 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.416712 27657 raft_consensus.cc:3060] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.417107 27856 tablet_bootstrap.cc:654] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.417830 27854 ts_tablet_manager.cc:1434] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:43.418720 27854 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.414484 27957 leader_election.cc:290] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:43.414664 27911 leader_election.cc:290] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:43.425668 27854 tablet_bootstrap.cc:654] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.428817 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde1218f4bbf48f7987c355961adb699" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:43.429826 28010 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.430016 27733 raft_consensus.cc:3060] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.430469 28010 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.432175 27857 tablet_bootstrap.cc:654] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.434134 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:43.435684 27700 leader_election.cc:343] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.437127 27854 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.437238 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.437588 27854 ts_tablet_manager.cc:1403] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:09:43.438470 27733 raft_consensus.cc:2468] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
W20260709 13:09:43.441064 27697 leader_election.cc:343] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.441506 27697 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.442255 27867 raft_consensus.cc:2749] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.442446 27771 leader_election.cc:304] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:43.437269 27853 tablet_bootstrap.cc:654] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.445282 27997 raft_consensus.cc:2804] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.445780 27997 raft_consensus.cc:697] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:43.446585 27997 consensus_queue.cc:237] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.447671 28010 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.434165 27856 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.455288 27856 ts_tablet_manager.cc:1403] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 13:09:43.402827 27992 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.442826 27657 raft_consensus.cc:2468] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:43.452446 27854 raft_consensus.cc:359] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.461412 27854 raft_consensus.cc:385] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.461453 27857 tablet_bootstrap.cc:492] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.461850 27854 raft_consensus.cc:740] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.462134 27857 ts_tablet_manager.cc:1403] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.003s
I20260709 13:09:43.453703 28010 consensus_queue.cc:1048] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.461969 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:43.465221 27992 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
W20260709 13:09:43.465849 27548 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.457959 27856 raft_consensus.cc:359] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.466961 27856 raft_consensus.cc:385] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.467044 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:43.467099 27867 consensus_queue.cc:1048] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.467823 27804 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.468010 27857 raft_consensus.cc:359] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.468822 27857 raft_consensus.cc:385] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.467916 27854 consensus_queue.cc:260] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.469123 27857 raft_consensus.cc:740] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.469940 27857 consensus_queue.cc:260] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.470821 27854 ts_tablet_manager.cc:1434] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:09:43.467280 27856 raft_consensus.cc:740] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.473243 27856 consensus_queue.cc:260] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.477317 27804 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:43.478634 27857 ts_tablet_manager.cc:1434] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:09:43.483883 27548 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:43.484211 27857 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.486428 27854 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.487205 27992 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.487879 27992 raft_consensus.cc:697] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:43.488725 27992 consensus_queue.cc:237] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.491477 27857 tablet_bootstrap.cc:654] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.492890 27854 tablet_bootstrap.cc:654] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.495750 27856 ts_tablet_manager.cc:1434] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:09:43.497082 27856 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.496726 27481 catalog_manager.cc:5697] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.503895 27856 tablet_bootstrap.cc:654] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.509150 27929 consensus_queue.cc:1048] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.509647 27857 tablet_bootstrap.cc:492] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.510659 27857 ts_tablet_manager.cc:1403] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.014s
I20260709 13:09:43.513981 27857 raft_consensus.cc:359] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.516201 27857 raft_consensus.cc:385] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.516549 27857 raft_consensus.cc:740] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.517379 27854 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.517354 27857 consensus_queue.cc:260] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.518033 27854 ts_tablet_manager.cc:1403] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:09:43.519865 27857 ts_tablet_manager.cc:1434] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:09:43.520787 27854 raft_consensus.cc:359] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.520833 27857 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.524434 27856 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.524917 27856 ts_tablet_manager.cc:1403] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 13:09:43.521524 27854 raft_consensus.cc:385] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.527762 27854 raft_consensus.cc:740] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.529415 27854 consensus_queue.cc:260] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.530606 27856 raft_consensus.cc:359] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.531149 27857 tablet_bootstrap.cc:654] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.531312 27856 raft_consensus.cc:385] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.531659 27856 raft_consensus.cc:740] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.531399 27942 consensus_queue.cc:1048] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.531827 28019 raft_consensus.cc:493] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.532368 28019 raft_consensus.cc:515] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.536022 27856 consensus_queue.cc:260] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.544232 28019 leader_election.cc:290] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.548133 28023 consensus_queue.cc:1048] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.548974 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.549927 27854 ts_tablet_manager.cc:1434] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:09:43.549928 27585 raft_consensus.cc:2393] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:43.552802 27854 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.554221 27856 ts_tablet_manager.cc:1434] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:09:43.555189 27856 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.558156 27867 raft_consensus.cc:493] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.558652 27867 raft_consensus.cc:515] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.560618 27867 leader_election.cc:290] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.562155 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0273d7867b40db9dc87335d36e6f95" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.564746 27853 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:43.565368 27853 ts_tablet_manager.cc:1403] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.018s
I20260709 13:09:43.567184 27623 leader_election.cc:304] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.569109 28019 raft_consensus.cc:3060] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.569806 27853 raft_consensus.cc:359] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.570782 27853 raft_consensus.cc:385] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.571218 27853 raft_consensus.cc:740] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.577107 27853 consensus_queue.cc:260] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.577728 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.594254 28023 raft_consensus.cc:493] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.590178 27808 raft_consensus.cc:2468] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:43.595767 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.596398 27658 raft_consensus.cc:2468] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:43.600555 27853 ts_tablet_manager.cc:1434] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:09:43.594785 28023 raft_consensus.cc:515] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.603684 28023 leader_election.cc:290] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.604034 27989 raft_consensus.cc:493] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.604702 27989 raft_consensus.cc:515] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.598729 27867 raft_consensus.cc:493] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.607555 27856 tablet_bootstrap.cc:654] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.607230 27854 tablet_bootstrap.cc:654] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.612226 27853 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:43.617504 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.620610 27857 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.620733 27989 leader_election.cc:290] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.621099 27857 ts_tablet_manager.cc:1403] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.015s
I20260709 13:09:43.609608 27867 raft_consensus.cc:515] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.630278 27867 leader_election.cc:290] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.631649 27997 consensus_queue.cc:1048] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.632741 28019 raft_consensus.cc:2749] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.624104 27697 leader_election.cc:304] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:43.624368 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.631390 27857 raft_consensus.cc:359] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.640890 27857 raft_consensus.cc:385] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.641342 27857 raft_consensus.cc:740] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.643157 27867 raft_consensus.cc:2804] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.644034 27857 consensus_queue.cc:260] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.641188 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:43.642979 27697 leader_election.cc:343] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.644076 27867 raft_consensus.cc:493] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.650651 27857 ts_tablet_manager.cc:1434] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:09:43.651742 27857 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.647853 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.652887 27867 raft_consensus.cc:3060] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.650666 27578 raft_consensus.cc:2468] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:43.661195 28010 consensus_queue.cc:1048] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:43.662322 27700 leader_election.cc:343] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.662473 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.663232 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.663910 27659 raft_consensus.cc:2468] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
W20260709 13:09:43.667913 27697 leader_election.cc:343] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.668454 27697 leader_election.cc:304] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:43.672812 27992 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.673336 27992 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.676074 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.676764 27808 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:43.677904 27548 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:43.678705 27902 raft_consensus.cc:2804] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.678840 27989 raft_consensus.cc:2749] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.679229 27902 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.679678 27902 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.678639 27700 leader_election.cc:304] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
W20260709 13:09:43.681663 27697 leader_election.cc:343] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.681769 27911 consensus_queue.cc:1048] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.681663 27989 raft_consensus.cc:2804] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.684399 27989 raft_consensus.cc:493] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.684741 27989 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.687350 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.687991 27657 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:43.689282 27992 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.683106 27697 leader_election.cc:304] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.692827 27482 catalog_manager.cc:5697] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.697851 27856 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.698351 27856 ts_tablet_manager.cc:1403] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.000s
I20260709 13:09:43.700779 28010 raft_consensus.cc:2804] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.701247 28010 raft_consensus.cc:493] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.701583 28010 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.703662 27867 raft_consensus.cc:515] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.705555 27853 tablet_bootstrap.cc:654] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.705686 27867 leader_election.cc:290] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:43.708761 28010 raft_consensus.cc:515] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.709856 27854 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.710307 27854 ts_tablet_manager.cc:1403] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.158s	user 0.007s	sys 0.006s
I20260709 13:09:43.711994 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:43.714273 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:43.714900 27808 raft_consensus.cc:3060] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.716223 27700 leader_election.cc:343] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.716768 28019 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.717283 28019 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.718644 27857 tablet_bootstrap.cc:654] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.719218 28019 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.706995 27989 raft_consensus.cc:515] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.722405 27854 raft_consensus.cc:359] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.723038 27854 raft_consensus.cc:385] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.723311 27854 raft_consensus.cc:740] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.700553 27856 raft_consensus.cc:359] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.724712 27856 raft_consensus.cc:385] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.724961 27856 raft_consensus.cc:740] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.723987 27854 consensus_queue.cc:260] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.727200 27856 consensus_queue.cc:260] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.723709 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:43.733485 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.736341 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.736493 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.737072 27658 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.736331 27585 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.737761 27989 leader_election.cc:290] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.738430 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e977dcac25b40f9b4451a087f94be1a" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.739004 27657 raft_consensus.cc:3060] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.746467 27626 leader_election.cc:343] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:43.747764 27623 leader_election.cc:343] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.748185 27623 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.749891 27808 raft_consensus.cc:2468] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:43.750337 28019 raft_consensus.cc:2749] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.751031 28019 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.751500 28019 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.751822 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.753497 28019 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:43.737311 27902 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.757532 27902 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.757560 27697 leader_election.cc:304] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:43.757534 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:43.758467 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.758757 27808 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.758988 27697 leader_election.cc:343] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.759102 27656 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.759392 27585 raft_consensus.cc:2468] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:43.759967 27856 ts_tablet_manager.cc:1434] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:09:43.760564 27700 leader_election.cc:304] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:43.760921 27856 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.761675 27867 raft_consensus.cc:2804] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.762145 27867 raft_consensus.cc:697] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:43.757838 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:43.763515 27989 raft_consensus.cc:2804] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.762956 27867 consensus_queue.cc:237] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.764042 27734 raft_consensus.cc:2393] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:43.764096 27989 raft_consensus.cc:697] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:43.765370 27989 consensus_queue.cc:237] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.766043 27854 ts_tablet_manager.cc:1434] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:09:43.766984 27854 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.767405 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.768159 27578 raft_consensus.cc:2393] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:43.769418 27626 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.770380 27891 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.771082 27658 raft_consensus.cc:2468] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:43.772869 27854 tablet_bootstrap.cc:654] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.772790 27697 leader_election.cc:304] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.729022 28010 leader_election.cc:290] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:43.774785 28023 raft_consensus.cc:2804] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.783131 28023 raft_consensus.cc:697] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:43.788373 28023 consensus_queue.cc:237] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.789740 27808 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:43.790154 27853 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:43.791600 27853 ts_tablet_manager.cc:1403] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.003s
I20260709 13:09:43.791769 27548 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:43.792457 27856 tablet_bootstrap.cc:654] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.792704 27992 raft_consensus.cc:2804] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.793275 27992 raft_consensus.cc:697] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:43.794128 27853 raft_consensus.cc:359] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.794832 27853 raft_consensus.cc:385] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.794159 27992 consensus_queue.cc:237] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.795089 27853 raft_consensus.cc:740] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.802106 27853 consensus_queue.cc:260] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.809185 27853 ts_tablet_manager.cc:1434] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:43.825806 27891 raft_consensus.cc:2749] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.828886 27656 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:43.835753 27857 tablet_bootstrap.cc:492] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.836246 27857 ts_tablet_manager.cc:1403] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.185s	user 0.009s	sys 0.009s
I20260709 13:09:43.841717 27481 catalog_manager.cc:5697] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.839021 27857 raft_consensus.cc:359] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.845860 27857 raft_consensus.cc:385] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.844759 27481 catalog_manager.cc:5697] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.846249 27857 raft_consensus.cc:740] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.847306 27857 consensus_queue.cc:260] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.857571 27857 ts_tablet_manager.cc:1434] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:09:43.859077 27857 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.864234 27657 raft_consensus.cc:2468] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:43.866165 27853 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:43.872484 27853 tablet_bootstrap.cc:654] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.878014 27808 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.880685 27997 consensus_queue.cc:1048] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.884097 27857 tablet_bootstrap.cc:654] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.885601 27911 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.886087 27911 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.889781 27911 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:43.891585 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:43.893488 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:43.894127 27733 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:43.895695 27891 consensus_queue.cc:1048] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.898008 27771 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:43.918259 27997 consensus_queue.cc:1048] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.922017 27854 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:43.922657 27854 ts_tablet_manager.cc:1403] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.156s	user 0.007s	sys 0.003s
I20260709 13:09:43.926124 27854 raft_consensus.cc:359] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.926949 27854 raft_consensus.cc:385] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.927528 27854 raft_consensus.cc:740] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.930866 27856 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:43.931470 27856 ts_tablet_manager.cc:1403] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.171s	user 0.044s	sys 0.056s
I20260709 13:09:43.929432 27854 consensus_queue.cc:260] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:43.940701 27854 ts_tablet_manager.cc:1434] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:09:43.934525 27911 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:43.942313 27854 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:43.941515 27853 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:43.942853 27853 ts_tablet_manager.cc:1403] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.009s
I20260709 13:09:43.947659 27911 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 387a99f68cd34b7c9e89550715e17135)
I20260709 13:09:43.948148 27911 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.951426 27856 raft_consensus.cc:359] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.959770 27856 raft_consensus.cc:385] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.960211 27856 raft_consensus.cc:740] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.961457 27856 consensus_queue.cc:260] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.964397 27857 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:43.964884 27857 ts_tablet_manager.cc:1403] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.106s	user 0.024s	sys 0.000s
I20260709 13:09:43.965314 27856 ts_tablet_manager.cc:1434] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:09:43.957643 27911 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:43.967006 27856 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:43.967948 27481 catalog_manager.cc:5697] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.969347 27857 raft_consensus.cc:359] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.970257 27857 raft_consensus.cc:385] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.970554 27857 raft_consensus.cc:740] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.971405 28010 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.971904 28010 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:43.973228 27857 consensus_queue.cc:260] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.973843 28010 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:43.975492 27857 ts_tablet_manager.cc:1434] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:43.975703 27856 tablet_bootstrap.cc:654] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.980016 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:43.980981 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:43.981498 27911 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:43.981772 27806 raft_consensus.cc:2393] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:43.982546 27857 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:43.984026 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:43.986624 28019 consensus_queue.cc:1048] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.986049 27697 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:43.988199 27853 raft_consensus.cc:359] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.988842 27853 raft_consensus.cc:385] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.989090 27853 raft_consensus.cc:740] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.989697 27853 consensus_queue.cc:260] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:43.991711 28010 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.992281 27857 tablet_bootstrap.cc:654] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.998152 27481 catalog_manager.cc:5697] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.000036 27854 tablet_bootstrap.cc:654] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.004652 27808 raft_consensus.cc:1240] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Rejecting Update request from peer 387a99f68cd34b7c9e89550715e17135 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:44.007257 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.011054 27891 consensus_queue.cc:1059] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:44.017916 28019 raft_consensus.cc:3055] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:44.018275 28019 raft_consensus.cc:740] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:44.019047 28019 consensus_queue.cc:260] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.020195 28019 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.023590 27771 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:44.024721 27997 raft_consensus.cc:2749] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:44.007385 27853 ts_tablet_manager.cc:1434] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:09:44.025954 27853 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.032186 28010 raft_consensus.cc:2749] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.044662 27856 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.045202 27856 ts_tablet_manager.cc:1403] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.006s
I20260709 13:09:44.047523 27854 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.048022 27854 ts_tablet_manager.cc:1403] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.009s
I20260709 13:09:44.048138 27856 raft_consensus.cc:359] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.050199 27857 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.050683 27857 ts_tablet_manager.cc:1403] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.002s
I20260709 13:09:44.051158 27853 tablet_bootstrap.cc:654] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.051064 27854 raft_consensus.cc:359] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.052099 27854 raft_consensus.cc:385] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.052469 27854 raft_consensus.cc:740] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.053344 27857 raft_consensus.cc:359] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.053241 27854 consensus_queue.cc:260] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.054807 27857 raft_consensus.cc:385] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.055094 27857 raft_consensus.cc:740] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.055747 27857 consensus_queue.cc:260] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.056404 27854 ts_tablet_manager.cc:1434] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:09:44.053416 27856 raft_consensus.cc:385] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.056869 27856 raft_consensus.cc:740] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.057719 27854 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.057559 27856 consensus_queue.cc:260] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.062546 27857 ts_tablet_manager.cc:1434] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:09:44.063527 27857 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.065057 27854 tablet_bootstrap.cc:654] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.066381 27853 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:44.066872 27853 ts_tablet_manager.cc:1403] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 13:09:44.073426 27856 ts_tablet_manager.cc:1434] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:09:44.074271 27854 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.074915 27854 ts_tablet_manager.cc:1403] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:09:44.074998 27853 raft_consensus.cc:359] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.075760 27853 raft_consensus.cc:385] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.076045 27853 raft_consensus.cc:740] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.076880 27853 consensus_queue.cc:260] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.077498 27857 tablet_bootstrap.cc:654] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.079073 27853 ts_tablet_manager.cc:1434] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:09:44.074359 27856 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:44.080006 27853 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.081842 27854 raft_consensus.cc:359] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.082540 27854 raft_consensus.cc:385] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.082875 27854 raft_consensus.cc:740] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.084631 27992 consensus_queue.cc:1048] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.086124 27856 tablet_bootstrap.cc:654] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.083724 27854 consensus_queue.cc:260] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.091879 27857 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.092298 27857 ts_tablet_manager.cc:1403] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.007s
I20260709 13:09:44.095257 27854 ts_tablet_manager.cc:1434] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:09:44.096408 27854 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.097426 27853 tablet_bootstrap.cc:654] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.099802 27856 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.100245 27856 ts_tablet_manager.cc:1403] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:09:44.102310 27854 tablet_bootstrap.cc:654] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.095007 27857 raft_consensus.cc:359] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.103758 27857 raft_consensus.cc:385] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.104044 27857 raft_consensus.cc:740] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.102682 27856 raft_consensus.cc:359] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.105334 27856 raft_consensus.cc:385] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.105650 27856 raft_consensus.cc:740] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.106261 27856 consensus_queue.cc:260] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.108335 27856 ts_tablet_manager.cc:1434] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:44.109081 27857 consensus_queue.cc:260] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.114050 27857 ts_tablet_manager.cc:1434] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:44.114928 27992 consensus_queue.cc:1048] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.115980 27856 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:44.115154 27857 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.124411 28019 raft_consensus.cc:493] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.124969 28019 raft_consensus.cc:515] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.127553 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.128331 27578 raft_consensus.cc:2393] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:44.129513 27857 tablet_bootstrap.cc:654] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.136328 28019 leader_election.cc:290] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:44.137952 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.139565 27623 leader_election.cc:304] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.140131 27856 tablet_bootstrap.cc:654] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.140722 28019 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.147583 27857 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.148069 27857 ts_tablet_manager.cc:1403] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:09:44.149821 28019 raft_consensus.cc:2749] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.150849 27857 raft_consensus.cc:359] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.151562 27857 raft_consensus.cc:385] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.151816 27857 raft_consensus.cc:740] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.152493 27857 consensus_queue.cc:260] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.154709 27857 ts_tablet_manager.cc:1434] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:44.156044 27857 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.161557 27854 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.162086 27854 ts_tablet_manager.cc:1403] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.004s
I20260709 13:09:44.162424 27856 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.162910 27856 ts_tablet_manager.cc:1403] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:09:44.164767 27854 raft_consensus.cc:359] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.165429 27856 raft_consensus.cc:359] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.166519 27856 raft_consensus.cc:385] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.166810 27856 raft_consensus.cc:740] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.167209 27857 tablet_bootstrap.cc:654] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.165482 27854 raft_consensus.cc:385] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.167982 27854 raft_consensus.cc:740] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.167507 27856 consensus_queue.cc:260] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.168922 27854 consensus_queue.cc:260] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.170028 27856 ts_tablet_manager.cc:1434] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:44.170990 27856 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:44.175823 27992 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.176671 27856 tablet_bootstrap.cc:654] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.176309 27992 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.178311 27992 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.184508 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.185178 27808 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:44.186343 27548 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.186506 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.187187 27992 raft_consensus.cc:2804] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.187614 27992 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.188063 27992 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.187414 27659 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:44.194010 27853 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:44.194700 27853 ts_tablet_manager.cc:1403] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.008s
I20260709 13:09:44.194823 27854 ts_tablet_manager.cc:1434] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:09:44.199862 27854 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.203327 27992 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.206125 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.206653 27808 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.208842 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:44.199077 27853 raft_consensus.cc:359] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.209944 28019 raft_consensus.cc:493] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.210028 27853 raft_consensus.cc:385] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.210721 27853 raft_consensus.cc:740] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.210593 28019 raft_consensus.cc:515] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.211736 27853 consensus_queue.cc:260] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.213639 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.214280 27733 raft_consensus.cc:2468] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:44.214388 27853 ts_tablet_manager.cc:1434] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:44.214757 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.215417 27806 raft_consensus.cc:2468] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:44.215942 27853 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.216527 27623 leader_election.cc:304] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:44.217993 27891 raft_consensus.cc:2804] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.218328 27891 raft_consensus.cc:493] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.218629 27891 raft_consensus.cc:3060] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.224148 27853 tablet_bootstrap.cc:654] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.228920 28019 leader_election.cc:290] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.229847 27854 tablet_bootstrap.cc:654] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.226940 27891 raft_consensus.cc:515] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.234712 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.235338 27733 raft_consensus.cc:3060] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.235587 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca18e3f1a9e486095c1f06ca4168709" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.236141 27806 raft_consensus.cc:3060] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.242636 27733 raft_consensus.cc:2468] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:44.243036 27806 raft_consensus.cc:2468] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:44.244781 28019 raft_consensus.cc:493] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.246218 27623 leader_election.cc:304] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:44.246694 27857 tablet_bootstrap.cc:492] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.247334 28013 raft_consensus.cc:2804] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.248015 28013 raft_consensus.cc:697] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:44.249024 28013 consensus_queue.cc:237] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.245267 28019 raft_consensus.cc:515] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.257521 27854 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.258229 28010 consensus_queue.cc:1048] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:44.269124 27854 ts_tablet_manager.cc:1403] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.001s
I20260709 13:09:44.275302 27986 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.275777 27986 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.276448 27854 raft_consensus.cc:359] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.277220 27854 raft_consensus.cc:385] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.277499 27854 raft_consensus.cc:740] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.277951 27986 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.278371 28019 leader_election.cc:290] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:44.268154 27989 raft_consensus.cc:493] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.279618 27989 raft_consensus.cc:515] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.280551 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.281162 27806 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:44.243489 27891 leader_election.cc:290] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.282239 27989 leader_election.cc:290] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:44.282809 27548 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.284062 27986 raft_consensus.cc:2804] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.284471 27986 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.284260 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.284996 27986 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.285374 27733 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:44.286792 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.289038 27808 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:44.266947 27853 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:44.289947 27853 ts_tablet_manager.cc:1403] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.012s
I20260709 13:09:44.247378 27857 ts_tablet_manager.cc:1403] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.008s
W20260709 13:09:44.291394 27626 leader_election.cc:343] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.291602 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.291751 28023 consensus_queue.cc:1048] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.293032 28023 raft_consensus.cc:493] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.292889 27853 raft_consensus.cc:359] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.293602 27853 raft_consensus.cc:385] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.293486 28023 raft_consensus.cc:515] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.294080 27853 raft_consensus.cc:740] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.295713 28023 leader_election.cc:290] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.294998 27853 consensus_queue.cc:260] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.292233 27806 raft_consensus.cc:2468] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:44.297835 27853 ts_tablet_manager.cc:1434] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:44.298758 27853 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.299692 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.300292 27656 raft_consensus.cc:2468] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:44.304845 27853 tablet_bootstrap.cc:654] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.298519 27697 leader_election.cc:304] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:44.307425 27867 raft_consensus.cc:2804] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.307654 27697 leader_election.cc:304] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:44.278839 27854 consensus_queue.cc:260] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.282847 27992 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.307830 27867 raft_consensus.cc:493] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.311443 27867 raft_consensus.cc:3060] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.312638 27857 raft_consensus.cc:359] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.313311 27857 raft_consensus.cc:385] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.313585 27857 raft_consensus.cc:740] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.293949 28010 consensus_queue.cc:1048] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.298519 27548 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.315543 27992 raft_consensus.cc:2804] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.316238 27992 raft_consensus.cc:697] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:44.316526 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.317050 27992 consensus_queue.cc:237] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.317951 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.318578 27733 raft_consensus.cc:2468] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:44.317479 27854 ts_tablet_manager.cc:1434] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:09:44.319629 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.319940 28094 raft_consensus.cc:2804] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.320219 27659 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.320345 28094 raft_consensus.cc:493] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.320751 28094 raft_consensus.cc:3060] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.322029 27854 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
W20260709 13:09:44.325394 27700 leader_election.cc:343] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.327670 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.329716 27857 consensus_queue.cc:260] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:44.332463 27700 leader_election.cc:343] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.334173 27854 tablet_bootstrap.cc:654] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.340031 28023 raft_consensus.cc:493] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.340942 27856 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.341444 27856 ts_tablet_manager.cc:1403] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.171s	user 0.069s	sys 0.046s
I20260709 13:09:44.344169 27856 raft_consensus.cc:359] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.344810 27856 raft_consensus.cc:385] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.345093 27856 raft_consensus.cc:740] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.345722 27856 consensus_queue.cc:260] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.347354 27854 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.351625 27854 ts_tablet_manager.cc:1403] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.005s
I20260709 13:09:44.350452 27856 ts_tablet_manager.cc:1434] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:44.354435 27854 raft_consensus.cc:359] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.355094 27854 raft_consensus.cc:385] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.355424 27856 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:44.355401 27854 raft_consensus.cc:740] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.357367 27854 consensus_queue.cc:260] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.352236 27857 ts_tablet_manager.cc:1434] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:09:44.360013 27857 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.365401 27857 tablet_bootstrap.cc:654] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.366250 27578 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.340549 28023 raft_consensus.cc:515] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.358963 27854 ts_tablet_manager.cc:1434] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 13:09:44.372184 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 56055.9us
I20260709 13:09:44.372716 28010 raft_consensus.cc:493] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.373334 27854 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.373260 28010 raft_consensus.cc:515] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.310353 27483 catalog_manager.cc:5697] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.377372 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b4d67651944d4c82892d46b4f4948c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.378000 27585 raft_consensus.cc:2468] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:44.379351 28023 leader_election.cc:290] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:44.379833 27700 leader_election.cc:304] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.383618 28010 leader_election.cc:290] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.384234 28010 raft_consensus.cc:2804] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.384599 28010 raft_consensus.cc:493] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.384951 28010 raft_consensus.cc:3060] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.388404 27867 raft_consensus.cc:515] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.388106 27854 tablet_bootstrap.cc:654] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.390781 27902 consensus_queue.cc:1048] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.391712 27986 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.393692 27902 consensus_queue.cc:1048] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.398241 28023 consensus_queue.cc:1048] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.417774 27867 leader_election.cc:290] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:44.404044 27986 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.434681 27856 tablet_bootstrap.cc:654] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.433893 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
W20260709 13:09:44.445310 27700 leader_election.cc:343] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:44.439251 27697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 131668us
I20260709 13:09:44.455291 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.455951 27733 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.459391 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.459982 27806 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.461800 27854 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.462426 27854 ts_tablet_manager.cc:1403] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.007s
I20260709 13:09:44.468098 27854 raft_consensus.cc:359] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.469067 27854 raft_consensus.cc:385] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.469436 27854 raft_consensus.cc:740] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.470175 27623 leader_election.cc:304] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.470418 27854 consensus_queue.cc:260] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.471436 27891 raft_consensus.cc:2804] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.471807 27891 raft_consensus.cc:493] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.472141 27891 raft_consensus.cc:3060] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.473340 27854 ts_tablet_manager.cc:1434] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:44.474628 27854 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.456935 28010 raft_consensus.cc:515] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.466265 27659 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:44.480782 27857 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.481274 27857 ts_tablet_manager.cc:1403] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.121s	user 0.035s	sys 0.027s
I20260709 13:09:44.482704 27853 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:44.483170 27853 ts_tablet_manager.cc:1403] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.076s
I20260709 13:09:44.483776 27733 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:44.484028 27857 raft_consensus.cc:359] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.484725 27857 raft_consensus.cc:385] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.484982 27857 raft_consensus.cc:740] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.485605 27857 consensus_queue.cc:260] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.486847 27853 raft_consensus.cc:359] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.487393 28010 leader_election.cc:290] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:44.487633 27853 raft_consensus.cc:385] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.488097 27853 raft_consensus.cc:740] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.488487 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b4d67651944d4c82892d46b4f4948c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:44.489095 27584 raft_consensus.cc:3060] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.490696 27857 ts_tablet_manager.cc:1434] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:44.490515 27853 consensus_queue.cc:260] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.452976 28094 raft_consensus.cc:515] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.489233 27891 raft_consensus.cc:515] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.496449 27857 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.501777 27853 ts_tablet_manager.cc:1434] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:09:44.502519 27853 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.509716 28010 raft_consensus.cc:493] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.510756 28019 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.511125 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.511363 28019 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.511790 27657 raft_consensus.cc:2468] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:44.513455 28019 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:44.514590 27857 tablet_bootstrap.cc:654] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.511291 28010 raft_consensus.cc:515] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.515023 27806 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:44.517089 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.520952 27584 raft_consensus.cc:2468] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.523013 27700 leader_election.cc:304] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.524475 27989 raft_consensus.cc:2804] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.525086 27989 raft_consensus.cc:697] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:44.526213 27989 consensus_queue.cc:237] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:44.537007 27626 leader_election.cc:343] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.517089 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.537855 28019 raft_consensus.cc:493] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.538337 28019 raft_consensus.cc:515] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.538806 28010 leader_election.cc:290] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:44.539836 27623 leader_election.cc:343] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.540295 27623 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.540840 28019 leader_election.cc:290] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.541312 28019 raft_consensus.cc:2749] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.542146 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:44.542732 27584 raft_consensus.cc:3060] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.543053 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b4d67651944d4c82892d46b4f4948c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.543347 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.543910 27808 raft_consensus.cc:2468] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
W20260709 13:09:44.544878 27700 leader_election.cc:343] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.545498 27957 raft_consensus.cc:493] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.545980 27957 raft_consensus.cc:515] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.547961 27957 leader_election.cc:290] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:44.548404 27957 raft_consensus.cc:493] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.548806 27957 raft_consensus.cc:515] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.551362 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.552026 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.552153 27807 raft_consensus.cc:3060] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.552361 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.552716 27734 raft_consensus.cc:2468] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:44.552994 27585 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:44.554090 27771 leader_election.cc:304] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:44.554566 27584 raft_consensus.cc:2468] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.555022 27911 raft_consensus.cc:2804] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.555449 27911 raft_consensus.cc:493] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.555892 27911 raft_consensus.cc:3060] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.556250 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.557677 27867 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.558230 27867 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.558387 27774 leader_election.cc:304] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.559731 27697 leader_election.cc:304] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:44.563135 28023 raft_consensus.cc:2804] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.551523 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a60e8e2194989a741cc7cc098f122" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.563530 28023 raft_consensus.cc:493] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.563632 28094 leader_election.cc:290] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.563930 28023 raft_consensus.cc:3060] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.564522 27957 leader_election.cc:290] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.565097 27957 raft_consensus.cc:2804] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.565445 27957 raft_consensus.cc:493] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.565785 27957 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.560310 27548 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.568215 27992 raft_consensus.cc:2804] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.561395 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.564401 28094 consensus_queue.cc:1048] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.559876 27700 leader_election.cc:304] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.560405 27867 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.575227 27854 tablet_bootstrap.cc:654] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.574275 27992 raft_consensus.cc:697] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:44.575801 27656 raft_consensus.cc:2468] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:44.585222 27989 raft_consensus.cc:2804] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:44.586534 27623 leader_election.cc:343] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.599213 27989 raft_consensus.cc:697] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:44.599372 27891 leader_election.cc:290] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:44.600232 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.603578 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:44.610373 27584 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.610682 27657 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:44.611351 27856 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.611827 27856 ts_tablet_manager.cc:1403] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.258s	user 0.032s	sys 0.021s
I20260709 13:09:44.613473 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:44.614126 27657 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.609686 27992 consensus_queue.cc:237] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.614358 27856 raft_consensus.cc:359] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.615545 27700 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.616426 27867 raft_consensus.cc:2804] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.616811 27867 raft_consensus.cc:493] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.617126 27867 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.619561 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:44.615075 27856 raft_consensus.cc:385] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.619931 27989 consensus_queue.cc:237] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.620378 27585 raft_consensus.cc:2393] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:44.622579 27856 raft_consensus.cc:740] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.629544 27856 consensus_queue.cc:260] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.631024 27856 ts_tablet_manager.cc:1434] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:44.628602 27807 raft_consensus.cc:2468] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.623313 27911 raft_consensus.cc:515] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.633749 27911 leader_election.cc:290] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:44.633894 27857 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.636278 28023 raft_consensus.cc:515] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.636853 27808 raft_consensus.cc:2393] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:44.637053 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.637964 27733 raft_consensus.cc:2393] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:44.635102 27857 ts_tablet_manager.cc:1403] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.143s	user 0.035s	sys 0.035s
I20260709 13:09:44.639182 27856 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:44.638236 28023 leader_election.cc:290] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.627117 27867 raft_consensus.cc:515] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.658558 27857 raft_consensus.cc:359] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.659409 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b4d67651944d4c82892d46b4f4948c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.677716 27806 raft_consensus.cc:3060] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.679625 27957 raft_consensus.cc:515] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.681809 27957 leader_election.cc:290] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.663167 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:44.682477 27585 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.683722 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:44.684515 27805 raft_consensus.cc:2393] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:44.684787 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:44.685366 27584 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.687621 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:44.689481 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.663208 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.690075 27659 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.690152 27657 raft_consensus.cc:3060] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.663167 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a60e8e2194989a741cc7cc098f122" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:44.694669 27733 raft_consensus.cc:2468] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:44.667165 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.667687 28023 consensus_queue.cc:1048] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.669077 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041555667e44a71a863bc5e56bc1745" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.696869 27584 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:44.673705 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d6cd1381e9461a906ad5194102295e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.697062 27656 raft_consensus.cc:2393] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
W20260709 13:09:44.704368 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 48087.2us
I20260709 13:09:44.706840 27806 raft_consensus.cc:2468] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:44.704491 27585 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:44.708482 27700 leader_election.cc:304] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.710500 27857 raft_consensus.cc:385] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.712523 27857 raft_consensus.cc:740] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.718161 27857 consensus_queue.cc:260] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.720918 28023 raft_consensus.cc:2804] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:44.721457 28023 raft_consensus.cc:697] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:44.722254 28023 consensus_queue.cc:237] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.717211 27657 raft_consensus.cc:2468] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:44.724565 27771 leader_election.cc:304] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:44.725337 27957 raft_consensus.cc:2804] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.713896 27853 tablet_bootstrap.cc:654] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.725926 27957 raft_consensus.cc:697] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
W20260709 13:09:44.726670 27697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 52928.3us
I20260709 13:09:44.726994 27957 consensus_queue.cc:237] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.732128 27774 leader_election.cc:304] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:44.732466 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad26bb1b44b8483385cd6155100e6fb3" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:44.733033 27911 raft_consensus.cc:2804] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.733582 27911 raft_consensus.cc:697] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:44.734431 27911 consensus_queue.cc:237] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:44.737247 27479 catalog_manager.cc:5697] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.676458 27867 leader_election.cc:290] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:44.732153 27857 ts_tablet_manager.cc:1434] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:09:44.749280 27857 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.733263 27657 raft_consensus.cc:3060] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.774279 27623 leader_election.cc:304] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:44.789983 27857 tablet_bootstrap.cc:654] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.792629 27659 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:44.794291 27697 leader_election.cc:304] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.797801 27856 tablet_bootstrap.cc:654] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.821414 27854 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:44.822116 27854 ts_tablet_manager.cc:1403] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.348s	user 0.021s	sys 0.026s
I20260709 13:09:44.816277 27891 raft_consensus.cc:2804] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.817600 27867 raft_consensus.cc:2804] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.826741 27891 raft_consensus.cc:493] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.830725 27867 raft_consensus.cc:697] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:44.833761 27891 raft_consensus.cc:3060] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.834575 27867 consensus_queue.cc:237] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.839901 27697 leader_election.cc:304] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:44.840543 27657 raft_consensus.cc:2468] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
W20260709 13:09:44.841202 27697 leader_election.cc:343] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.841274 28010 raft_consensus.cc:2749] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.841768 27697 leader_election.cc:304] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.842578 28097 raft_consensus.cc:2749] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.843587 27623 leader_election.cc:304] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:44.845431 28013 raft_consensus.cc:2749] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.846714 27891 raft_consensus.cc:515] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.832177 27483 catalog_manager.cc:5697] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.847201 27479 catalog_manager.cc:5697] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.852377 27483 catalog_manager.cc:5697] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.854276 27479 catalog_manager.cc:5697] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.860930 28013 raft_consensus.cc:493] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.907750 27894 consensus_queue.cc:1048] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:44.910411 28019 consensus_queue.cc:1048] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.912006 27853 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:44.912467 27853 ts_tablet_manager.cc:1403] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.410s	user 0.012s	sys 0.019s
I20260709 13:09:44.913218 27856 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:44.913676 27856 ts_tablet_manager.cc:1403] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.275s	user 0.016s	sys 0.000s
W20260709 13:09:44.906355 28117 log.cc:927] Time spent T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:44.906625 28013 raft_consensus.cc:515] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.920722 28013 leader_election.cc:290] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.922890 27891 leader_election.cc:290] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:44.926178 27856 raft_consensus.cc:359] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.933056 27853 raft_consensus.cc:359] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.933997 27853 raft_consensus.cc:385] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.934365 27853 raft_consensus.cc:740] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.937335 27854 raft_consensus.cc:359] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.938017 27854 raft_consensus.cc:385] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.938277 27854 raft_consensus.cc:740] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.927160 27856 raft_consensus.cc:385] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.941010 27856 raft_consensus.cc:740] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.941635 27856 consensus_queue.cc:260] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.935150 27853 consensus_queue.cc:260] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:44.938858 27854 consensus_queue.cc:260] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:44.949127 27853 ts_tablet_manager.cc:1434] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:44.949992 27853 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:44.951377 27856 ts_tablet_manager.cc:1434] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:09:44.955547 27854 ts_tablet_manager.cc:1434] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.000s
I20260709 13:09:44.957487 27854 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:44.957510 27856 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
W20260709 13:09:44.960495 27623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 53975.9us
I20260709 13:09:44.963694 27857 tablet_bootstrap.cc:492] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:44.972419 27857 ts_tablet_manager.cc:1403] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.018s
I20260709 13:09:44.975112 27857 raft_consensus.cc:359] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.975970 27857 raft_consensus.cc:385] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.976228 27857 raft_consensus.cc:740] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.976872 27857 consensus_queue.cc:260] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:44.978605 27857 ts_tablet_manager.cc:1434] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:09:44.981216 27857 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:44.983659 27856 tablet_bootstrap.cc:654] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.986428 27854 tablet_bootstrap.cc:654] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.996207 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a60e8e2194989a741cc7cc098f122" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:44.996800 27733 raft_consensus.cc:3060] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.004400 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a60e8e2194989a741cc7cc098f122" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:45.005221 27806 raft_consensus.cc:3060] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.008551 27857 tablet_bootstrap.cc:654] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.009080 27481 catalog_manager.cc:5697] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.014570 27853 tablet_bootstrap.cc:654] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.014400 27902 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.014794 27481 catalog_manager.cc:5697] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.016839 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.016566 27481 catalog_manager.cc:5697] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:45.018462 27623 leader_election.cc:343] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.007390 28124 consensus_queue.cc:1048] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:45.011442 27894 consensus_queue.cc:1048] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.049353 27853 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:45.037108 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.054059 27853 ts_tablet_manager.cc:1403] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.000s
I20260709 13:09:45.062831 27733 raft_consensus.cc:2468] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:45.050217 28109 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.063629 27854 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:45.064244 27854 ts_tablet_manager.cc:1403] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.013s
I20260709 13:09:45.064039 28109 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.069094 27734 raft_consensus.cc:2468] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:45.073614 27853 raft_consensus.cc:359] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.074581 27853 raft_consensus.cc:385] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.074916 27853 raft_consensus.cc:740] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.077422 27853 consensus_queue.cc:260] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.068471 27623 leader_election.cc:304] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:45.086814 27806 raft_consensus.cc:2468] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:45.088222 28124 raft_consensus.cc:2804] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.088757 28124 raft_consensus.cc:697] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:45.089078 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.088239 27854 raft_consensus.cc:359] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.090444 27854 raft_consensus.cc:385] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.090731 27854 raft_consensus.cc:740] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.089553 28124 consensus_queue.cc:237] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.068970 28109 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:45.084020 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:45.093310 27856 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:45.093791 27856 ts_tablet_manager.cc:1403] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.012s
I20260709 13:09:45.093710 27659 raft_consensus.cc:2468] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:45.070559 28019 raft_consensus.cc:493] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.095400 27774 leader_election.cc:343] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.095580 28019 raft_consensus.cc:515] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.096400 27856 raft_consensus.cc:359] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.097069 27856 raft_consensus.cc:385] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.097196 27771 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:45.098378 28109 raft_consensus.cc:2804] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.098088 27854 consensus_queue.cc:260] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.098779 28109 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.099171 28109 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.100905 27894 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.103085 27854 ts_tablet_manager.cc:1434] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:09:45.104068 27854 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:45.106518 27867 consensus_queue.cc:1048] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.097357 27856 raft_consensus.cc:740] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.108995 27623 leader_election.cc:304] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:45.113319 27857 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:45.114096 27857 ts_tablet_manager.cc:1403] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.004s
I20260709 13:09:45.110177 27856 consensus_queue.cc:260] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.118753 27853 ts_tablet_manager.cc:1434] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:09:45.120198 27853 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:45.126142 28019 leader_election.cc:290] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:45.112135 28013 raft_consensus.cc:2804] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.129279 28013 raft_consensus.cc:493] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.123523 28023 consensus_queue.cc:1048] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:45.129896 28013 raft_consensus.cc:3060] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.130694 27853 tablet_bootstrap.cc:654] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.132390 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02f1c4f105748ee996718a3440d2691" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.133044 27733 raft_consensus.cc:2468] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:45.137404 28094 consensus_queue.cc:1048] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:45.153283 27623 leader_election.cc:304] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:45.154696 27891 raft_consensus.cc:2804] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.157130 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02f1c4f105748ee996718a3440d2691" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.162161 27854 tablet_bootstrap.cc:654] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.165328 27856 ts_tablet_manager.cc:1434] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:09:45.166662 27856 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:45.155076 27891 raft_consensus.cc:493] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.178068 27857 raft_consensus.cc:359] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.178896 27857 raft_consensus.cc:385] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.179183 27857 raft_consensus.cc:740] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.185667 27857 consensus_queue.cc:260] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.178375 27891 raft_consensus.cc:3060] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.184088 28019 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.144446 28109 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.209960 27857 ts_tablet_manager.cc:1434] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
W20260709 13:09:45.192018 27626 leader_election.cc:343] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.216682 27479 catalog_manager.cc:5697] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.218930 27857 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:45.223425 27584 raft_consensus.cc:1275] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:45.223409 28109 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:45.213263 28019 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.277197 28019 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:45.251289 27626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 66639.5us
I20260709 13:09:45.281663 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.282119 28013 raft_consensus.cc:515] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.287372 27853 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
W20260709 13:09:45.287575 28134 log.cc:927] Time spent T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:09:45.287909 27853 ts_tablet_manager.cc:1403] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.023s
I20260709 13:09:45.268729 28010 consensus_queue.cc:1048] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:45.290693 27853 raft_consensus.cc:359] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.293969 27853 raft_consensus.cc:385] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.294198 27853 raft_consensus.cc:740] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.296696 28097 consensus_queue.cc:1048] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.297219 27856 tablet_bootstrap.cc:654] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.298156 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:45.299546 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.300643 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:45.301261 27659 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:45.302307 27626 leader_election.cc:343] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.308848 27857 tablet_bootstrap.cc:654] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.322253 27853 consensus_queue.cc:260] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.313220 28120 consensus_queue.cc:1048] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:45.326195 27623 leader_election.cc:343] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.329107 27623 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:45.335608 28019 raft_consensus.cc:2749] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.338304 27658 raft_consensus.cc:1275] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:45.306525 27891 raft_consensus.cc:515] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.360062 27891 leader_election.cc:290] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:45.347429 28143 consensus_queue.cc:1048] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:45.362447 27853 ts_tablet_manager.cc:1434] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.001s
I20260709 13:09:45.363392 28143 raft_consensus.cc:493] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.363914 28143 raft_consensus.cc:515] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.348254 28010 consensus_queue.cc:1048] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:45.366034 28143 leader_election.cc:290] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:45.366689 27853 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:45.367157 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.367810 27730 raft_consensus.cc:2468] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:45.369400 27771 leader_election.cc:304] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:45.369882 27894 raft_consensus.cc:493] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.370421 27894 raft_consensus.cc:515] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.400102 28013 leader_election.cc:290] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:45.400779 27894 leader_election.cc:290] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:45.392059 28120 raft_consensus.cc:2804] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.402288 28120 raft_consensus.cc:493] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.402617 28120 raft_consensus.cc:3060] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.403414 27853 tablet_bootstrap.cc:654] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.421527 27732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:45.422318 27732 raft_consensus.cc:3060] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.421415 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02f1c4f105748ee996718a3440d2691" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:45.429013 27659 raft_consensus.cc:2468] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:45.433315 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:45.436476 27856 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:45.436962 27856 ts_tablet_manager.cc:1403] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.271s	user 0.014s	sys 0.025s
I20260709 13:09:45.440255 27854 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:45.440798 27854 ts_tablet_manager.cc:1403] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.337s	user 0.018s	sys 0.016s
I20260709 13:09:45.440253 27857 tablet_bootstrap.cc:492] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:45.442215 27857 ts_tablet_manager.cc:1403] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.012s
I20260709 13:09:45.429719 27731 raft_consensus.cc:3060] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.456248 27771 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:45.469830 27986 raft_consensus.cc:493] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.470364 27986 raft_consensus.cc:515] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.472502 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.473167 27986 leader_election.cc:290] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:45.475891 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.476653 27729 raft_consensus.cc:2468] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:45.478703 27911 raft_consensus.cc:2804] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.479246 27911 raft_consensus.cc:697] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:45.463145 27856 raft_consensus.cc:359] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:45.463858 27623 leader_election.cc:343] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.482899 27856 raft_consensus.cc:385] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.489346 27856 raft_consensus.cc:740] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.485826 27854 raft_consensus.cc:359] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.489761 27854 raft_consensus.cc:385] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.489986 27856 consensus_queue.cc:260] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.490041 27854 raft_consensus.cc:740] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.500478 27856 ts_tablet_manager.cc:1434] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:09:45.501817 27856 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:45.508955 27854 consensus_queue.cc:260] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
W20260709 13:09:45.503060 27774 leader_election.cc:343] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.525851 27853 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:45.527230 27854 ts_tablet_manager.cc:1434] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:09:45.528371 27854 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
W20260709 13:09:45.515249 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 80759.2us
I20260709 13:09:45.526382 27853 ts_tablet_manager.cc:1403] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.003s
I20260709 13:09:45.525118 27891 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.524892 28094 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 387a99f68cd34b7c9e89550715e17135)
I20260709 13:09:45.536312 28120 raft_consensus.cc:515] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.536492 27857 raft_consensus.cc:359] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:45.527293 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:45.544353 27857 raft_consensus.cc:385] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.546247 27857 raft_consensus.cc:740] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.548869 27857 consensus_queue.cc:260] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:45.557210 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 86408.2us
I20260709 13:09:45.558408 27582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02f1c4f105748ee996718a3440d2691" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:45.545440 27891 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.559778 28120 leader_election.cc:290] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:45.560963 27806 raft_consensus.cc:2393] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:45.560745 27853 raft_consensus.cc:359] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.561275 27891 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:45.561524 27853 raft_consensus.cc:385] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.519901 27911 consensus_queue.cc:237] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.561849 27853 raft_consensus.cc:740] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.562587 27853 consensus_queue.cc:260] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.564278 27854 tablet_bootstrap.cc:654] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.565523 27857 ts_tablet_manager.cc:1434] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.001s
I20260709 13:09:45.559043 27582 raft_consensus.cc:3060] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:45.600260 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 144071us
W20260709 13:09:45.616053 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:35273, user_credentials={real_user=slave}} blocked reactor thread for 51194.9us
I20260709 13:09:45.632195 27853 ts_tablet_manager.cc:1434] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 13:09:45.545380 28094 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.636278 28158 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.639763 27548 leader_election.cc:304] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:45.640576 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.642544 28145 raft_consensus.cc:493] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.643500 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3c90f12dc244b3b4d51189f757ae4f" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.673609 27808 raft_consensus.cc:2393] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:45.674599 27583 raft_consensus.cc:3060] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.645144 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:45.675231 27733 raft_consensus.cc:3060] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.670027 28158 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.677510 28158 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:45.653964 27585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.660148 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.679641 28023 consensus_queue.cc:1048] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.681053 27856 tablet_bootstrap.cc:654] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.664294 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:45.682539 27581 raft_consensus.cc:3060] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.683957 27582 raft_consensus.cc:2468] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:45.672513 28145 raft_consensus.cc:515] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.687731 28145 leader_election.cc:290] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:45.689249 28124 consensus_queue.cc:1048] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.679709 27857 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:45.694890 28094 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
W20260709 13:09:45.697340 27626 leader_election.cc:343] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.698567 27623 leader_election.cc:343] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.699079 27623 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:45.700608 28150 raft_consensus.cc:2749] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.701412 27731 raft_consensus.cc:2468] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:45.701735 27626 leader_election.cc:304] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:45.705209 28150 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.706918 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.712551 27732 raft_consensus.cc:2468] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:45.708052 27733 raft_consensus.cc:2468] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:45.734493 27807 raft_consensus.cc:2393] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 2: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:45.730818 28124 raft_consensus.cc:2804] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.724311 28145 consensus_queue.cc:1048] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:45.738966 28124 raft_consensus.cc:697] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:45.743589 27857 tablet_bootstrap.cc:654] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.725853 28150 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.739905 28124 consensus_queue.cc:237] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.749890 28150 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:45.751814 27856 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:45.752426 27856 ts_tablet_manager.cc:1403] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.251s	user 0.013s	sys 0.015s
I20260709 13:09:45.794317 27581 raft_consensus.cc:2468] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:45.803617 27857 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:45.803877 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:45.804960 27857 ts_tablet_manager.cc:1403] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.002s
I20260709 13:09:45.806015 27659 raft_consensus.cc:2393] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:45.804147 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:45.807934 27654 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 2.
I20260709 13:09:45.811395 27857 raft_consensus.cc:359] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.812853 27857 raft_consensus.cc:385] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.813334 27857 raft_consensus.cc:740] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.814276 27856 raft_consensus.cc:359] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.815554 27856 raft_consensus.cc:385] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.815943 27856 raft_consensus.cc:740] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.821007 27867 consensus_queue.cc:1048] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.821310 27774 leader_election.cc:304] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:45.830487 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edbc1b203b2b4f0db422b3547ae75eb6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.832005 27729 raft_consensus.cc:2393] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:45.835211 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.836666 27733 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:45.847733 28097 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.848677 28097 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:45.850664 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 181189us
I20260709 13:09:45.814489 27857 consensus_queue.cc:260] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.857182 27894 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.858151 27894 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.861140 27894 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:45.861725 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:45.862639 27658 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:45.860769 27857 ts_tablet_manager.cc:1434] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.010s
I20260709 13:09:45.864259 28145 raft_consensus.cc:2804] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.839802 28162 raft_consensus.cc:2764] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:45.865042 28145 raft_consensus.cc:697] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:45.865867 27857 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:45.877987 27857 tablet_bootstrap.cc:654] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.882019 28097 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:45.885746 27854 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:45.886855 27854 ts_tablet_manager.cc:1403] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.359s	user 0.014s	sys 0.003s
I20260709 13:09:45.891458 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:45.894178 28164 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.894625 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:45.894985 28164 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.896085 27658 raft_consensus.cc:2393] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:45.866794 28145 consensus_queue.cc:237] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:45.906136 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.915549 27584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f4c3345b74fdbad7101785ed79efb" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.915150 27854 raft_consensus.cc:359] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.916322 27854 raft_consensus.cc:385] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.916371 27584 raft_consensus.cc:2376] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1. Re-sending same reply.
I20260709 13:09:45.916857 27854 raft_consensus.cc:740] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.917706 27853 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:45.917963 27854 consensus_queue.cc:260] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:45.921622 28150 consensus_queue.cc:1048] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.903393 28164 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:45.930235 27774 leader_election.cc:343] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.932066 27856 consensus_queue.cc:260] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.933620 27623 leader_election.cc:304] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:45.930751 28109 consensus_queue.cc:1048] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:45.935734 28124 raft_consensus.cc:2804] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.942898 28124 raft_consensus.cc:697] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:45.943554 27697 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:45.945376 28124 consensus_queue.cc:237] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:45.946058 28157 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.952109 27856 ts_tablet_manager.cc:1434] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.199s	user 0.014s	sys 0.000s
I20260709 13:09:45.952172 28157 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 387a99f68cd34b7c9e89550715e17135)
I20260709 13:09:45.953159 28157 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.949074 28177 raft_consensus.cc:493] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.954103 28177 raft_consensus.cc:515] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:45.957150 27548 leader_election.cc:304] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:45.957551 28177 leader_election.cc:290] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:09:45.961052 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 70379.3us
I20260709 13:09:45.969822 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.973587 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:45.987291 27771 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:45.988919 27854 ts_tablet_manager.cc:1434] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.100s	user 0.012s	sys 0.002s
I20260709 13:09:45.989251 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.990779 27854 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:45.980219 27894 raft_consensus.cc:2749] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.990509 27483 catalog_manager.cc:5697] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.994004 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:45.994902 27729 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:45.997742 27853 tablet_bootstrap.cc:654] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.004025 27911 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:46.004660 27911 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.005131 27911 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:46.010890 27700 leader_election.cc:343] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.020774 27579 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.025563 27856 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
W20260709 13:09:46.027237 27548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.4:35273, user_credentials={real_user=slave}} blocked reactor thread for 70247.7us
I20260709 13:09:46.029259 27548 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:46.031483 27771 leader_election.cc:304] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:46.042605 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.043576 27806 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
W20260709 13:09:46.052083 27700 leader_election.cc:343] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.053195 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:46.056732 27857 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:46.057338 27857 ts_tablet_manager.cc:1403] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.192s	user 0.039s	sys 0.039s
I20260709 13:09:46.057987 27854 tablet_bootstrap.cc:654] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.075981 27771 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.082615 28164 raft_consensus.cc:2804] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.082875 27853 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:46.083086 28164 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.083519 27853 ts_tablet_manager.cc:1403] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.003s
I20260709 13:09:46.083572 28164 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.101188 27857 raft_consensus.cc:359] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.102231 27857 raft_consensus.cc:385] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.102586 27857 raft_consensus.cc:740] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.106359 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.107048 28124 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.107617 28124 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.109989 28124 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:46.111326 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:46.113246 27626 leader_election.cc:343] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.118727 27697 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.120014 28177 raft_consensus.cc:2804] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.122038 27853 raft_consensus.cc:359] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.069265 28145 raft_consensus.cc:3060] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.122145 28177 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.138021 28177 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.123054 27853 raft_consensus.cc:385] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.143342 27853 raft_consensus.cc:740] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.145289 27857 consensus_queue.cc:260] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
W20260709 13:09:46.156100 27697 leader_election.cc:343] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.156483 27697 leader_election.cc:304] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.154567 27853 consensus_queue.cc:260] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.103682 28157 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.165539 27989 raft_consensus.cc:2749] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.176075 27734 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
W20260709 13:09:46.149284 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 43689us
I20260709 13:09:46.180759 28158 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.181273 28158 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.182832 27857 ts_tablet_manager.cc:1434] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260709 13:09:46.184433 28158 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:46.185094 27857 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:46.163313 28177 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.179378 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.192657 27623 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:46.159026 28164 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.197603 28124 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:46.201871 27986 raft_consensus.cc:2749] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.210764 28164 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:46.200059 28157 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.202448 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.207695 28124 raft_consensus.cc:493] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.208266 28120 consensus_queue.cc:1048] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.211807 28124 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.213187 28150 consensus_queue.cc:1048] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.209427 27854 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:46.187444 27911 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.217160 27808 raft_consensus.cc:2393] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 3: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:46.218420 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:46.215369 27854 ts_tablet_manager.cc:1403] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.225s	user 0.022s	sys 0.024s
I20260709 13:09:46.209281 27856 tablet_bootstrap.cc:654] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:46.224110 27623 leader_election.cc:343] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.224534 27623 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.225405 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:46.226616 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.227211 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:46.228013 27729 raft_consensus.cc:2393] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
W20260709 13:09:46.231177 27774 leader_election.cc:343] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.231633 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
W20260709 13:09:46.231961 27774 leader_election.cc:343] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.232327 27658 raft_consensus.cc:2468] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:46.233556 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:46.234364 27807 raft_consensus.cc:2393] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:46.231633 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:46.235296 27771 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.238032 28164 raft_consensus.cc:2749] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.238072 27854 raft_consensus.cc:359] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.238860 28164 consensus_queue.cc:1048] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.239665 27853 ts_tablet_manager.cc:1434] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.000s
I20260709 13:09:46.241688 27771 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.214553 28177 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:46.244716 28155 raft_consensus.cc:2804] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.238898 27854 raft_consensus.cc:385] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.245110 28155 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.245232 27854 raft_consensus.cc:740] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.245613 28155 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.246838 27854 consensus_queue.cc:260] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.248476 27854 ts_tablet_manager.cc:1434] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:09:46.249516 27854 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
W20260709 13:09:46.249724 27700 leader_election.cc:343] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.256246 27697 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.259742 28157 raft_consensus.cc:2749] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.255162 28013 raft_consensus.cc:2749] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.273098 27854 tablet_bootstrap.cc:654] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.274959 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:46.275828 27729 raft_consensus.cc:3060] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.257613 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:46.281082 27806 raft_consensus.cc:2368] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 for earlier term 2. Current term is 3.
I20260709 13:09:46.282622 28140 consensus_queue.cc:1048] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.284071 27853 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:46.282394 27697 leader_election.cc:400] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Vote denied by peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273) with higher term. Message: Invalid argument: T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 for earlier term 2. Current term is 3.
I20260709 13:09:46.284925 27697 leader_election.cc:403] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.255146 27911 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:46.294694 27729 raft_consensus.cc:2468] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 3.
I20260709 13:09:46.302336 28155 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.304337 28124 raft_consensus.cc:515] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.306048 28145 raft_consensus.cc:2749] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.307577 27992 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.309957 27857 tablet_bootstrap.cc:654] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.323913 28159 raft_consensus.cc:2749] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273) with higher term. Message: Invalid argument: T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 for earlier term 2. Current term is 3.
I20260709 13:09:46.324572 27992 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.329164 27853 tablet_bootstrap.cc:654] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.332003 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:46.332749 27654 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:46.332798 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:46.326996 27992 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:46.335006 27548 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
W20260709 13:09:46.339903 27548 leader_election.cc:343] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.340798 27992 raft_consensus.cc:2804] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.341233 27992 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.349647 27659 raft_consensus.cc:2368] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 for earlier term 2. Current term is 3.
I20260709 13:09:46.353053 27697 leader_election.cc:400] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Vote denied by peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745) with higher term. Message: Invalid argument: T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 for earlier term 2. Current term is 3.
I20260709 13:09:46.341558 27992 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:46.360062 28190 log.cc:927] Time spent T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:46.362684 27771 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:46.363968 27482 catalog_manager.cc:5697] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.367015 28145 raft_consensus.cc:2804] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:46.384016 28145 raft_consensus.cc:697] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:46.385000 28145 consensus_queue.cc:237] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.380054 27992 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.395828 27911 consensus_queue.cc:1048] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.400699 27854 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:46.401212 27854 ts_tablet_manager.cc:1403] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.152s	user 0.031s	sys 0.011s
I20260709 13:09:46.404052 27854 raft_consensus.cc:359] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.404549 27992 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:46.404716 27854 raft_consensus.cc:385] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.405158 27854 raft_consensus.cc:740] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.405838 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.405857 27854 consensus_queue.cc:260] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.406641 27657 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.408262 27854 ts_tablet_manager.cc:1434] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:09:46.409245 27854 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:46.410475 27479 catalog_manager.cc:5697] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.411424 28140 consensus_queue.cc:1048] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.418792 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
W20260709 13:09:46.420219 27774 leader_election.cc:343] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.421728 27854 tablet_bootstrap.cc:654] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.422490 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.423064 27659 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.423219 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:46.435508 28155 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:09:46.435822 27548 leader_election.cc:343] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.457273 27856 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:46.457821 27856 ts_tablet_manager.cc:1403] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.481s	user 0.017s	sys 0.013s
I20260709 13:09:46.459899 28124 leader_election.cc:290] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 3 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.460918 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:46.462508 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f070317853944f7a8c691ed18b301df" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:46.463472 27729 raft_consensus.cc:2393] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 3: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:46.468199 27659 raft_consensus.cc:2468] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:46.470263 27657 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:46.470305 27856 raft_consensus.cc:359] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.476521 27856 raft_consensus.cc:385] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.473722 27623 leader_election.cc:304] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:46.477759 27771 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.476795 27856 raft_consensus.cc:740] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.490860 27857 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:46.491626 27857 ts_tablet_manager.cc:1403] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.307s	user 0.010s	sys 0.014s
I20260709 13:09:46.482992 28150 raft_consensus.cc:2749] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:46.489679 28164 raft_consensus.cc:2804] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.501214 28164 raft_consensus.cc:697] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:46.505298 27856 consensus_queue.cc:260] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.502391 28164 consensus_queue.cc:237] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.506397 27548 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:46.512658 27856 ts_tablet_manager.cc:1434] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:09:46.511071 27986 raft_consensus.cc:2804] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.514340 27986 raft_consensus.cc:697] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:46.515211 27986 consensus_queue.cc:237] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.528437 27483 catalog_manager.cc:5697] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } }
I20260709 13:09:46.527078 28150 consensus_queue.cc:1048] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:46.554286 28158 consensus_queue.cc:1048] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.558878 28013 raft_consensus.cc:493] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.559480 28013 raft_consensus.cc:515] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.561537 28013 leader_election.cc:290] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:46.565490 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:46.569022 27626 leader_election.cc:343] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.572402 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:46.577809 27623 leader_election.cc:343] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.578351 27623 leader_election.cc:304] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
W20260709 13:09:46.621874 27623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 44107.5us
I20260709 13:09:46.641665 28124 raft_consensus.cc:493] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.642447 28124 raft_consensus.cc:515] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.645226 28124 leader_election.cc:290] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.653234 27853 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:46.653698 27853 ts_tablet_manager.cc:1403] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.370s	user 0.023s	sys 0.019s
I20260709 13:09:46.635601 28013 raft_consensus.cc:2749] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.658074 27857 raft_consensus.cc:359] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.660126 27857 raft_consensus.cc:385] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.661175 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:46.660346 27857 raft_consensus.cc:740] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.666986 27857 consensus_queue.cc:260] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.667487 27856 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:46.667780 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.669094 27854 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:46.669572 27854 ts_tablet_manager.cc:1403] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.261s	user 0.020s	sys 0.001s
W20260709 13:09:46.685690 27623 leader_election.cc:343] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.687314 27623 leader_election.cc:343] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.687691 27623 leader_election.cc:304] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:46.689538 28150 raft_consensus.cc:2749] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.693295 27853 raft_consensus.cc:359] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.694080 27853 raft_consensus.cc:385] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.694391 27853 raft_consensus.cc:740] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.695726 27854 raft_consensus.cc:359] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.696475 27854 raft_consensus.cc:385] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.696775 27854 raft_consensus.cc:740] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.697499 27854 consensus_queue.cc:260] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.699030 27854 ts_tablet_manager.cc:1434] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.001s
I20260709 13:09:46.703356 27482 catalog_manager.cc:5697] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.695104 27853 consensus_queue.cc:260] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.708165 27857 ts_tablet_manager.cc:1434] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.216s	user 0.005s	sys 0.002s
I20260709 13:09:46.726078 27854 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:46.720871 27853 ts_tablet_manager.cc:1434] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.002s
I20260709 13:09:46.722615 27483 catalog_manager.cc:5697] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 1 to 3, leader changed from 387a99f68cd34b7c9e89550715e17135 (127.19.145.2) to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.742904 27853 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:46.721855 27856 tablet_bootstrap.cc:654] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.722724 27857 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:46.747881 27854 tablet_bootstrap.cc:654] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.751904 27857 tablet_bootstrap.cc:654] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.753322 27853 tablet_bootstrap.cc:654] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.763092 27986 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.763732 27986 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.766230 27986 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:46.767567 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.768292 27805 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:46.770296 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:46.770591 27548 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:46.770886 27659 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
I20260709 13:09:46.773659 27894 raft_consensus.cc:2804] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.774122 27894 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.774502 27894 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.788141 27854 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:46.788667 27854 ts_tablet_manager.cc:1403] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.005s
I20260709 13:09:46.789798 27857 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:46.790222 27857 ts_tablet_manager.cc:1403] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.012s
I20260709 13:09:46.795446 27894 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.798697 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:46.798981 27856 tablet_bootstrap.cc:492] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:46.799422 27805 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.799682 27856 ts_tablet_manager.cc:1403] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.011s
W20260709 13:09:46.802918 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:46.801479 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.804672 27659 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.805727 27856 raft_consensus.cc:359] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.806466 27856 raft_consensus.cc:385] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.806764 27856 raft_consensus.cc:740] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.806818 27805 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:46.807457 27894 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:46.808300 27856 consensus_queue.cc:260] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.809448 27854 raft_consensus.cc:359] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.809836 27654 raft_consensus.cc:1275] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:46.810182 27854 raft_consensus.cc:385] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.810997 27659 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:46.811582 27911 consensus_queue.cc:1048] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.813329 27548 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:46.814945 27853 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:46.818115 27853 ts_tablet_manager.cc:1403] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.010s
I20260709 13:09:46.810516 27854 raft_consensus.cc:740] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.820052 27854 consensus_queue.cc:260] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.822777 27894 raft_consensus.cc:2804] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.823505 27894 raft_consensus.cc:697] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:46.801059 27857 raft_consensus.cc:359] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.826730 27857 raft_consensus.cc:385] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.828502 27894 consensus_queue.cc:237] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.829310 27853 raft_consensus.cc:359] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.830240 27853 raft_consensus.cc:385] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.830580 27853 raft_consensus.cc:740] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.831399 27853 consensus_queue.cc:260] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.827099 27857 raft_consensus.cc:740] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.834877 27857 consensus_queue.cc:260] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.835522 27483 catalog_manager.cc:5697] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.841214 27856 ts_tablet_manager.cc:1434] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.001s
I20260709 13:09:46.822765 27854 ts_tablet_manager.cc:1434] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.002s
I20260709 13:09:46.845654 27856 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:46.846374 27854 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:46.850340 27733 raft_consensus.cc:1275] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:46.851814 27857 ts_tablet_manager.cc:1434] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:09:46.853017 27857 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:46.858211 27482 catalog_manager.cc:5697] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.864153 27911 consensus_queue.cc:1048] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.866394 27854 tablet_bootstrap.cc:654] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.868171 27853 ts_tablet_manager.cc:1434] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:09:46.869560 27853 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:46.871425 27867 raft_consensus.cc:493] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.871898 27867 raft_consensus.cc:515] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.873790 27867 leader_election.cc:290] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.876287 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.876925 27805 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:46.878093 27697 leader_election.cc:304] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:46.881053 28159 raft_consensus.cc:2804] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.881424 28159 raft_consensus.cc:493] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.881779 28159 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.884662 27857 tablet_bootstrap.cc:654] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.885033 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:46.885694 27654 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:46.891346 27853 tablet_bootstrap.cc:654] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.893035 28159 raft_consensus.cc:515] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.896118 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:46.896685 27654 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.897715 27857 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:46.898324 27857 ts_tablet_manager.cc:1403] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:09:46.908594 27857 raft_consensus.cc:359] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.909468 27857 raft_consensus.cc:385] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.909796 27857 raft_consensus.cc:740] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.910606 27857 consensus_queue.cc:260] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.917116 27857 ts_tablet_manager.cc:1434] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:09:46.918208 27857 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:46.920672 28159 leader_election.cc:290] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.921037 27853 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:46.921530 27853 ts_tablet_manager.cc:1403] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.005s
I20260709 13:09:46.925746 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:46.926329 27805 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.926991 27854 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:46.927495 27854 ts_tablet_manager.cc:1403] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260709 13:09:46.927768 27857 tablet_bootstrap.cc:654] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.930088 27854 raft_consensus.cc:359] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.930747 27854 raft_consensus.cc:385] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.925084 27853 raft_consensus.cc:359] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.932461 27853 raft_consensus.cc:385] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.932925 27853 raft_consensus.cc:740] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.937664 28097 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.933893 27853 consensus_queue.cc:260] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:46.938143 28097 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:46.941025 27853 ts_tablet_manager.cc:1434] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:09:46.931031 27854 raft_consensus.cc:740] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.945465 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:46.946573 27659 raft_consensus.cc:2393] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:46.950831 27854 consensus_queue.cc:260] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:46.954125 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:46.955179 28150 raft_consensus.cc:493] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.955732 28150 raft_consensus.cc:515] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:46.944741 28097 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:46.957259 27853 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:46.959342 27700 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:46.961140 28150 leader_election.cc:290] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:46.961632 27854 ts_tablet_manager.cc:1434] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:09:46.963081 27854 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:46.970117 28097 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.972642 27856 tablet_bootstrap.cc:654] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.977317 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:46.978871 27623 leader_election.cc:343] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.980667 27774 consensus_peers.cc:597] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.981604 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:46.980580 27654 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:46.988623 27697 leader_election.cc:304] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:46.998471 27867 raft_consensus.cc:2804] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.999022 27867 raft_consensus.cc:697] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
W20260709 13:09:46.994354 27623 leader_election.cc:343] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.004694 27623 leader_election.cc:304] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.000409 27867 consensus_queue.cc:237] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.010581 28124 raft_consensus.cc:2749] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.031399 28162 consensus_queue.cc:1048] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.038722 28097 raft_consensus.cc:2749] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.039323 28124 raft_consensus.cc:493] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.040894 28124 raft_consensus.cc:515] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.010764 27805 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:47.046427 28124 leader_election.cc:290] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.047871 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.048949 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
W20260709 13:09:47.050987 27626 leader_election.cc:343] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.051786 27853 tablet_bootstrap.cc:654] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:47.053683 27623 leader_election.cc:343] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.054109 27623 leader_election.cc:304] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.055137 27854 tablet_bootstrap.cc:654] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.055044 28124 raft_consensus.cc:2749] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.055799 27894 consensus_queue.cc:1048] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.061801 27857 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:47.062408 27857 ts_tablet_manager.cc:1403] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.144s	user 0.043s	sys 0.059s
I20260709 13:09:47.073652 27856 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.075886 27856 ts_tablet_manager.cc:1403] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.230s	user 0.020s	sys 0.006s
I20260709 13:09:47.080974 27856 raft_consensus.cc:359] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.076689 27857 raft_consensus.cc:359] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.106431 27857 raft_consensus.cc:385] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.075147 27483 catalog_manager.cc:5697] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.091094 27911 raft_consensus.cc:493] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.103024 27854 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.106822 27857 raft_consensus.cc:740] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.108007 28164 consensus_queue.cc:1048] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.108443 27857 consensus_queue.cc:260] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.110723 27857 ts_tablet_manager.cc:1434] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:09:47.107146 27911 raft_consensus.cc:515] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.113158 27853 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.113787 27911 leader_election.cc:290] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.113765 27853 ts_tablet_manager.cc:1403] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.017s
I20260709 13:09:47.107546 27854 ts_tablet_manager.cc:1403] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.145s	user 0.020s	sys 0.000s
I20260709 13:09:47.115320 27857 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:47.116609 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.117690 27578 raft_consensus.cc:2468] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:47.119133 27774 leader_election.cc:304] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:47.117648 27853 raft_consensus.cc:359] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.120779 27853 raft_consensus.cc:385] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.121124 27853 raft_consensus.cc:740] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.106786 27856 raft_consensus.cc:385] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.124944 27853 consensus_queue.cc:260] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.128475 27854 raft_consensus.cc:359] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.129264 27854 raft_consensus.cc:385] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.128518 27856 raft_consensus.cc:740] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.129544 27854 raft_consensus.cc:740] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.131178 27853 ts_tablet_manager.cc:1434] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:47.125453 27911 raft_consensus.cc:2804] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.136159 27911 raft_consensus.cc:493] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.131858 27856 consensus_queue.cc:260] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.132905 28124 raft_consensus.cc:493] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.136324 27854 consensus_queue.cc:260] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.136940 28124 raft_consensus.cc:515] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.139132 28124 leader_election.cc:290] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:47.136596 27911 raft_consensus.cc:3060] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.139165 27854 ts_tablet_manager.cc:1434] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:09:47.141484 27854 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:47.142652 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:47.144070 27626 leader_election.cc:343] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.140249 27857 tablet_bootstrap.cc:654] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.144848 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.145534 27734 raft_consensus.cc:2468] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:47.145977 27856 ts_tablet_manager.cc:1434] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260709 13:09:47.146625 27623 leader_election.cc:304] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.147013 27856 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:47.148054 27853 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.148015 28124 raft_consensus.cc:2804] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.155506 28124 raft_consensus.cc:493] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.155897 28124 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.159653 27854 tablet_bootstrap.cc:654] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.168574 27911 raft_consensus.cc:515] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.178107 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.192529 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
W20260709 13:09:47.192783 27771 leader_election.cc:343] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.193858 27911 leader_election.cc:290] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:47.196919 27771 leader_election.cc:343] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.198704 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:47.199608 27578 raft_consensus.cc:3060] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.224246 27856 tablet_bootstrap.cc:654] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.233217 27854 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.233695 27854 ts_tablet_manager.cc:1403] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.022s
I20260709 13:09:47.237218 27857 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:47.237707 27857 ts_tablet_manager.cc:1403] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.013s
I20260709 13:09:47.240622 27857 raft_consensus.cc:359] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.241446 27857 raft_consensus.cc:385] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.241772 27857 raft_consensus.cc:740] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.241925 27854 raft_consensus.cc:359] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.242821 27854 raft_consensus.cc:385] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.243883 27853 tablet_bootstrap.cc:654] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.243523 27857 consensus_queue.cc:260] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.246486 27854 raft_consensus.cc:740] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.247246 27854 consensus_queue.cc:260] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.253171 27854 ts_tablet_manager.cc:1434] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:47.254211 27854 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:47.259577 27854 tablet_bootstrap.cc:654] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.265372 27857 ts_tablet_manager.cc:1434] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:09:47.252553 28124 raft_consensus.cc:515] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.269605 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:47.269976 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:47.270555 27733 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:47.271474 27626 leader_election.cc:343] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.272167 27856 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.272758 27856 ts_tablet_manager.cc:1403] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.024s
I20260709 13:09:47.283027 28097 raft_consensus.cc:493] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.283540 28097 raft_consensus.cc:515] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.285473 28097 leader_election.cc:290] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.285660 27856 raft_consensus.cc:359] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.286546 27856 raft_consensus.cc:385] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.286864 27856 raft_consensus.cc:740] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.287153 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.287959 27856 consensus_queue.cc:260] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
W20260709 13:09:47.288547 27697 leader_election.cc:343] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.289304 27857 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:47.292745 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.293618 27654 raft_consensus.cc:2468] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:47.294973 27697 leader_election.cc:304] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.297189 27733 raft_consensus.cc:2468] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:47.298554 27623 leader_election.cc:304] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.300442 28150 raft_consensus.cc:2804] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.296994 28097 raft_consensus.cc:2804] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.308995 28097 raft_consensus.cc:493] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.309387 28097 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.310431 27857 tablet_bootstrap.cc:654] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.302053 27856 ts_tablet_manager.cc:1434] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:09:47.312228 27856 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:47.314188 27853 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.314679 27853 ts_tablet_manager.cc:1403] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.167s	user 0.023s	sys 0.006s
I20260709 13:09:47.268956 28124 leader_election.cc:290] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:47.317250 27853 raft_consensus.cc:359] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.317857 27853 raft_consensus.cc:385] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.318099 27853 raft_consensus.cc:740] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.318686 27853 consensus_queue.cc:260] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.322283 27853 ts_tablet_manager.cc:1434] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:47.323211 27853 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.328764 27853 tablet_bootstrap.cc:654] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.308342 28162 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.320665 27854 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.330775 27854 ts_tablet_manager.cc:1403] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.003s
I20260709 13:09:47.333422 27894 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.334002 28124 raft_consensus.cc:493] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.334077 27894 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.335637 28150 raft_consensus.cc:697] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:47.336619 28150 consensus_queue.cc:237] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.334808 28124 raft_consensus.cc:515] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.348659 28124 leader_election.cc:290] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.338883 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.333506 27854 raft_consensus.cc:359] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.340080 27986 consensus_queue.cc:1048] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.350008 27854 raft_consensus.cc:385] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.350387 27894 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.350468 27854 raft_consensus.cc:740] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.351332 27854 consensus_queue.cc:260] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.353675 27854 ts_tablet_manager.cc:1434] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:09:47.355012 27854 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:47.303799 27578 raft_consensus.cc:2468] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:47.357983 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.359360 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.362869 27806 raft_consensus.cc:2468] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 0.
I20260709 13:09:47.340190 27856 tablet_bootstrap.cc:654] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.360925 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.361817 27774 leader_election.cc:304] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:47.365330 28109 raft_consensus.cc:2804] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.365805 28109 raft_consensus.cc:697] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:47.366984 27854 tablet_bootstrap.cc:654] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.334019 28162 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.366600 28109 consensus_queue.cc:237] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.369350 27548 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.370383 27986 raft_consensus.cc:2749] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.358801 28097 raft_consensus.cc:515] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.375077 27583 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.371212 27623 leader_election.cc:304] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
W20260709 13:09:47.379714 27623 leader_election.cc:343] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.380190 27483 catalog_manager.cc:5697] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.388042 28162 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.389145 28097 leader_election.cc:290] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.392900 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:47.393651 27857 tablet_bootstrap.cc:492] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:47.394130 27857 ts_tablet_manager.cc:1403] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.004s
I20260709 13:09:47.380267 28228 raft_consensus.cc:2804] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:47.396860 27697 leader_election.cc:343] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.399549 27856 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.400169 27856 ts_tablet_manager.cc:1403] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.001s
I20260709 13:09:47.404206 27857 raft_consensus.cc:359] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.405771 27857 raft_consensus.cc:385] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.406199 27857 raft_consensus.cc:740] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.411581 27857 consensus_queue.cc:260] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.412601 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.413319 27733 raft_consensus.cc:2393] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:47.396334 28228 raft_consensus.cc:493] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.415470 28228 raft_consensus.cc:3060] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.421088 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:47.421810 27654 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.432029 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.433096 27806 raft_consensus.cc:2393] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:47.442349 28228 raft_consensus.cc:515] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.470438 27853 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.471017 27853 ts_tablet_manager.cc:1403] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.148s	user 0.040s	sys 0.037s
I20260709 13:09:47.446341 27856 raft_consensus.cc:359] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.448961 27548 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.471719 28162 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.473867 28228 leader_election.cc:290] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.474231 27894 consensus_queue.cc:1048] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.455579 28150 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.476024 28150 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.476540 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:47.467890 27857 ts_tablet_manager.cc:1434] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:09:47.478386 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:47.480015 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.480317 27807 raft_consensus.cc:3060] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.481693 27857 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:47.477968 28150 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.485924 28164 raft_consensus.cc:493] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.486397 28164 raft_consensus.cc:515] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.487507 28162 raft_consensus.cc:2749] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.477288 27483 catalog_manager.cc:5697] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.488364 27857 tablet_bootstrap.cc:654] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.489374 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.490269 27856 raft_consensus.cc:385] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.490566 27856 raft_consensus.cc:740] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
W20260709 13:09:47.478472 27623 leader_election.cc:343] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:47.490927 27774 leader_election.cc:343] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.491204 27856 consensus_queue.cc:260] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.493325 27856 ts_tablet_manager.cc:1434] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.093s	user 0.000s	sys 0.006s
W20260709 13:09:47.493743 27623 leader_election.cc:343] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.497964 27807 raft_consensus.cc:2468] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:47.501296 27623 leader_election.cc:304] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:47.496979 28164 leader_election.cc:290] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.502275 28150 raft_consensus.cc:2804] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.508689 28150 raft_consensus.cc:697] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:47.509526 28150 consensus_queue.cc:237] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.515491 27856 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:47.469369 27654 raft_consensus.cc:2468] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:47.502604 27853 raft_consensus.cc:359] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.520597 27853 raft_consensus.cc:385] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.520965 27853 raft_consensus.cc:740] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
W20260709 13:09:47.521546 27626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 62339.4us
I20260709 13:09:47.521885 27853 consensus_queue.cc:260] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.525388 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.527834 27853 ts_tablet_manager.cc:1434] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:09:47.528084 28159 raft_consensus.cc:493] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.528579 28159 raft_consensus.cc:515] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.529294 27853 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.530593 28159 leader_election.cc:290] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.506415 27854 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.532716 27854 ts_tablet_manager.cc:1403] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.026s
I20260709 13:09:47.537122 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.537869 27578 raft_consensus.cc:2393] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:47.540201 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64de87ddc64f488fb55c8bccc3999da4" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.540846 28097 raft_consensus.cc:493] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.541359 28097 raft_consensus.cc:515] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.545568 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.547580 27658 raft_consensus.cc:2468] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
W20260709 13:09:47.547726 27626 leader_election.cc:343] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.548277 27626 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.546118 27697 leader_election.cc:304] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.553402 27854 raft_consensus.cc:359] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.558583 27854 raft_consensus.cc:385] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.558970 27854 raft_consensus.cc:740] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.563678 27867 raft_consensus.cc:3060] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.566973 27856 tablet_bootstrap.cc:654] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.557034 27771 leader_election.cc:304] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.566952 27697 leader_election.cc:304] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.559923 27854 consensus_queue.cc:260] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.571188 27911 raft_consensus.cc:2804] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.571558 27911 raft_consensus.cc:493] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.571796 27911 raft_consensus.cc:3060] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.573210 27853 tablet_bootstrap.cc:654] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.574237 28159 raft_consensus.cc:2804] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.553453 28228 raft_consensus.cc:2749] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.574807 28157 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.578758 28097 leader_election.cc:290] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.579046 27854 ts_tablet_manager.cc:1434] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.003s
I20260709 13:09:47.580322 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.581202 28150 raft_consensus.cc:493] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.581714 28150 raft_consensus.cc:515] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
W20260709 13:09:47.582744 27700 leader_election.cc:343] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.584530 28150 leader_election.cc:290] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:47.584919 28162 raft_consensus.cc:493] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.584854 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.585559 28162 raft_consensus.cc:515] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
W20260709 13:09:47.586581 27626 leader_election.cc:343] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.597391 27911 raft_consensus.cc:515] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.611862 27911 leader_election.cc:290] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.616815 27482 catalog_manager.cc:5697] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.619899 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:47.605865 28159 raft_consensus.cc:697] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:47.620471 27658 raft_consensus.cc:3060] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.621017 28159 consensus_queue.cc:237] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.623970 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.624785 27807 raft_consensus.cc:2393] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:47.629102 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:47.629669 27583 raft_consensus.cc:3060] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.631629 28162 leader_election.cc:290] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.632146 28162 raft_consensus.cc:493] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.632530 28162 raft_consensus.cc:515] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.634457 28162 leader_election.cc:290] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:47.639153 27867 raft_consensus.cc:2749] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.647694 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.653156 27867 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.650883 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:47.655954 27623 leader_election.cc:343] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.656481 27731 raft_consensus.cc:2393] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:47.656399 27623 leader_election.cc:304] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.657655 28150 raft_consensus.cc:2749] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.658388 27856 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.658730 27857 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:47.658944 27856 ts_tablet_manager.cc:1403] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.042s
I20260709 13:09:47.659173 27857 ts_tablet_manager.cc:1403] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.023s
I20260709 13:09:47.664686 27856 raft_consensus.cc:359] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.665820 27856 raft_consensus.cc:385] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.666103 27856 raft_consensus.cc:740] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.668023 27856 consensus_queue.cc:260] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.670361 27856 ts_tablet_manager.cc:1434] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:47.671327 27856 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:47.673450 27658 raft_consensus.cc:2468] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:47.675608 27771 leader_election.cc:304] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:47.676370 28109 raft_consensus.cc:2804] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.676882 28109 raft_consensus.cc:697] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:47.678164 27856 tablet_bootstrap.cc:654] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.677747 28109 consensus_queue.cc:237] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.681106 27853 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.681686 27853 ts_tablet_manager.cc:1403] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.153s	user 0.004s	sys 0.009s
I20260709 13:09:47.689633 27857 raft_consensus.cc:359] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.690335 27857 raft_consensus.cc:385] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.690625 27857 raft_consensus.cc:740] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.692759 27853 raft_consensus.cc:359] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.693466 27853 raft_consensus.cc:385] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.693714 27853 raft_consensus.cc:740] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.694267 27857 consensus_queue.cc:260] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.695663 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f0319ebab41859ce19c8c53606ca5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.696388 27654 raft_consensus.cc:2393] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:47.697134 27583 raft_consensus.cc:2468] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:47.699663 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.699823 27548 leader_election.cc:304] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.700297 27659 raft_consensus.cc:2468] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:47.701047 28238 raft_consensus.cc:2749] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.702035 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.708622 27697 leader_election.cc:304] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.710481 27857 ts_tablet_manager.cc:1434] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:09:47.704857 27854 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:47.711158 27867 raft_consensus.cc:2804] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.711627 27867 raft_consensus.cc:493] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.712018 27867 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.709596 27853 consensus_queue.cc:260] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.706789 27548 leader_election.cc:304] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:47.724129 28238 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.723019 27867 raft_consensus.cc:515] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.708683 27482 catalog_manager.cc:5697] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.730233 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:47.730701 28109 raft_consensus.cc:493] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.731161 28109 raft_consensus.cc:515] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.734508 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.735140 27731 raft_consensus.cc:2468] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:47.736349 28238 raft_consensus.cc:2749] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.737010 27771 leader_election.cc:304] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:47.738199 28109 leader_election.cc:290] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.738678 28109 raft_consensus.cc:2804] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.739005 28109 raft_consensus.cc:493] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.739355 28109 raft_consensus.cc:3060] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.739665 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:47.741178 27774 leader_election.cc:343] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.740888 27483 catalog_manager.cc:5697] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.743564 27867 leader_election.cc:290] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:47.723306 27854 tablet_bootstrap.cc:654] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.742460 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:47.747066 27660 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.722092 27857 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:47.743050 27579 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.757292 27660 raft_consensus.cc:2468] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:47.761425 27579 raft_consensus.cc:2468] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:47.764344 27853 ts_tablet_manager.cc:1434] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.001s
I20260709 13:09:47.765153 27853 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.768119 27697 leader_election.cc:304] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:47.769582 28159 raft_consensus.cc:2804] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.770680 27853 tablet_bootstrap.cc:654] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.771028 28159 raft_consensus.cc:697] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:47.771929 28159 consensus_queue.cc:237] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.774964 27857 tablet_bootstrap.cc:654] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.781930 27854 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.782318 27854 ts_tablet_manager.cc:1403] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.005s
I20260709 13:09:47.786772 27856 tablet_bootstrap.cc:492] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.787223 27856 ts_tablet_manager.cc:1403] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.011s
I20260709 13:09:47.787659 27854 raft_consensus.cc:359] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.788497 27854 raft_consensus.cc:385] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.789004 27854 raft_consensus.cc:740] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.788549 28109 raft_consensus.cc:515] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.789676 27854 consensus_queue.cc:260] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.790688 27856 raft_consensus.cc:359] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.791428 27856 raft_consensus.cc:385] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.791752 27856 raft_consensus.cc:740] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.792369 27853 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.792807 27853 ts_tablet_manager.cc:1403] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:09:47.792523 27856 consensus_queue.cc:260] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.794683 27856 ts_tablet_manager.cc:1434] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:47.795425 27853 raft_consensus.cc:359] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.796063 27853 raft_consensus.cc:385] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.796355 27853 raft_consensus.cc:740] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.797279 27856 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:47.797001 27853 consensus_queue.cc:260] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.797467 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:47.798111 27731 raft_consensus.cc:3060] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.799561 28124 consensus_queue.cc:1048] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.802030 27854 ts_tablet_manager.cc:1434] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:09:47.802979 27854 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: Bootstrap starting.
I20260709 13:09:47.804682 27857 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:47.805188 27857 ts_tablet_manager.cc:1403] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.000s
I20260709 13:09:47.807879 27856 tablet_bootstrap.cc:654] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.808877 27853 ts_tablet_manager.cc:1434] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:47.809880 27853 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.807201 27731 raft_consensus.cc:2468] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:47.817942 28164 raft_consensus.cc:493] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.818272 27854 tablet_bootstrap.cc:654] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.818565 28164 raft_consensus.cc:515] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.819712 27857 raft_consensus.cc:359] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.820371 27857 raft_consensus.cc:385] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.820622 27857 raft_consensus.cc:740] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.820737 28164 leader_election.cc:290] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:47.821619 27853 tablet_bootstrap.cc:654] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.822983 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.826011 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.827044 27655 raft_consensus.cc:2393] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:47.828171 27771 leader_election.cc:304] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:47.821470 27857 consensus_queue.cc:260] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.830646 27911 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.837514 28109 leader_election.cc:290] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.838816 27583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:47.839061 27986 raft_consensus.cc:493] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.839792 27853 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.839579 27986 raft_consensus.cc:515] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.840237 27853 ts_tablet_manager.cc:1403] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:09:47.840971 27583 raft_consensus.cc:3060] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.845482 27771 leader_election.cc:304] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:47.846056 27853 raft_consensus.cc:359] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.846688 27853 raft_consensus.cc:385] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.847124 27853 raft_consensus.cc:740] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.847810 28109 raft_consensus.cc:2804] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.848839 27867 raft_consensus.cc:493] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.849392 27867 raft_consensus.cc:515] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.850078 27853 consensus_queue.cc:260] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.848275 28109 raft_consensus.cc:697] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:47.851744 28150 raft_consensus.cc:493] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.851959 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:47.852232 28150 raft_consensus.cc:515] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:47.852898 27734 raft_consensus.cc:2393] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:47.851997 28109 consensus_queue.cc:237] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:47.854351 28150 leader_election.cc:290] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:47.855621 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164e20e1bf464255aacb3064f916feed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.856307 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:47.856473 27867 leader_election.cc:290] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.846633 27986 leader_election.cc:290] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.838667 27911 raft_consensus.cc:2749] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.857721 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:47.858119 27583 raft_consensus.cc:2468] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
W20260709 13:09:47.857748 27623 leader_election.cc:343] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.860308 27853 ts_tablet_manager.cc:1434] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:09:47.860821 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
W20260709 13:09:47.860937 27626 leader_election.cc:343] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.861300 27853 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:47.861019 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc7114823164fdf8ec82d57bfb6a56c" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:47.861613 27805 raft_consensus.cc:2393] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:47.861534 27626 leader_election.cc:304] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:47.862819 28124 raft_consensus.cc:2749] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.876263 27548 leader_election.cc:304] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.892122 27697 leader_election.cc:304] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:47.894789 27867 raft_consensus.cc:3060] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.884519 28238 raft_consensus.cc:2749] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:47.907116 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:47.909642 27857 ts_tablet_manager.cc:1434] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:09:47.914489 27853 tablet_bootstrap.cc:654] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:47.946517 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 54916.3us
I20260709 13:09:47.949107 27853 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:47.949600 27853 ts_tablet_manager.cc:1403] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.008s
I20260709 13:09:47.955971 27857 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:47.965911 28013 raft_consensus.cc:493] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.968138 28013 raft_consensus.cc:515] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:47.970172 28013 leader_election.cc:290] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:47.971987 27854 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: No bootstrap required, opened a new log
I20260709 13:09:47.972509 27854 ts_tablet_manager.cc:1403] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.033s
I20260709 13:09:47.961886 27483 catalog_manager.cc:5697] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.981899 27856 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:47.982411 27856 ts_tablet_manager.cc:1403] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.027s
I20260709 13:09:47.985186 27856 raft_consensus.cc:359] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.985841 27856 raft_consensus.cc:385] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.986084 27856 raft_consensus.cc:740] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.986433 27482 catalog_manager.cc:5697] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.991345 27856 consensus_queue.cc:260] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:47.994599 27867 raft_consensus.cc:2749] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.000026 27854 raft_consensus.cc:359] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.000686 27854 raft_consensus.cc:385] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.000936 27854 raft_consensus.cc:740] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.009620 27854 consensus_queue.cc:260] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.016451 27853 raft_consensus.cc:359] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.017148 27853 raft_consensus.cc:385] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.017179 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.017684 27853 raft_consensus.cc:740] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.018347 27853 consensus_queue.cc:260] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.020212 27854 ts_tablet_manager.cc:1434] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:09:48.021376 28263 raft_consensus.cc:493] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.021889 28263 raft_consensus.cc:515] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.023896 28263 leader_election.cc:290] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:48.026474 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b4a78f3069431e8967dd06c5afb21c" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.027043 27578 raft_consensus.cc:2468] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:48.028340 28263 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.028894 28263 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.030799 28263 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:48.032582 27774 leader_election.cc:304] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:48.034636 28164 raft_consensus.cc:2804] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.035041 28164 raft_consensus.cc:493] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.035485 28164 raft_consensus.cc:3060] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.034195 28109 consensus_queue.cc:1048] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:48.036262 28265 consensus_queue.cc:1048] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:48.037088 27623 leader_election.cc:343] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.039364 28265 consensus_queue.cc:1048] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:48.034279 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 45562.1us
I20260709 13:09:48.043969 27856 ts_tablet_manager.cc:1434] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.001s
I20260709 13:09:48.045365 27856 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:48.050292 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b4a78f3069431e8967dd06c5afb21c" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.050369 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.050992 27730 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:48.051931 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:48.054081 27894 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.054569 27894 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.056690 27894 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:09:48.057789 27623 leader_election.cc:343] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.058202 27623 leader_election.cc:304] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:48.059692 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.059887 28158 consensus_queue.cc:1048] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.060323 27660 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
W20260709 13:09:48.061075 27771 leader_election.cc:343] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.061945 27771 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:48.058933 28265 raft_consensus.cc:2749] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.063912 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:48.064438 27548 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:48.065315 27894 raft_consensus.cc:2804] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.065730 27894 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.066109 27894 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.066541 27857 tablet_bootstrap.cc:654] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.044611 28164 raft_consensus.cc:515] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.069131 27911 raft_consensus.cc:2804] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.069336 28164 leader_election.cc:290] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:48.069583 27911 raft_consensus.cc:493] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.069977 27911 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.070433 27548 leader_election.cc:343] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.070487 28266 consensus_queue.cc:1048] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.079419 27911 raft_consensus.cc:515] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.081115 27911 leader_election.cc:290] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:48.083506 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b4a78f3069431e8967dd06c5afb21c" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:48.085686 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:48.086207 27731 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.093057 27731 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 2.
W20260709 13:09:48.094636 27771 leader_election.cc:343] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.095337 27771 leader_election.cc:304] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:48.096190 28164 raft_consensus.cc:2804] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.096764 28164 raft_consensus.cc:697] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:48.097512 28164 consensus_queue.cc:237] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.118157 28159 raft_consensus.cc:493] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.118788 28159 raft_consensus.cc:515] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.122648 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.122838 28159 leader_election.cc:290] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.123937 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.124567 27660 raft_consensus.cc:2468] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
W20260709 13:09:48.127162 27700 leader_election.cc:343] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.127933 27697 leader_election.cc:304] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.128940 28159 raft_consensus.cc:2804] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.129257 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.130129 27578 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:48.129312 28159 raft_consensus.cc:493] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.142575 28159 raft_consensus.cc:3060] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.144448 27853 ts_tablet_manager.cc:1434] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.194s	user 0.006s	sys 0.000s
I20260709 13:09:48.145902 27853 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:48.152360 27894 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.156533 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b4a78f3069431e8967dd06c5afb21c" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:48.156730 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:48.157335 27579 raft_consensus.cc:3060] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.158345 27548 leader_election.cc:343] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.184144 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16478e1d305d4e6db2c2882fe655d75e" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:48.184847 27578 raft_consensus.cc:3060] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.182520 28269 log.cc:927] Time spent T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:48.208117 28157 consensus_queue.cc:1048] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.216864 27857 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:48.217381 27857 ts_tablet_manager.cc:1403] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.275s	user 0.044s	sys 0.043s
I20260709 13:09:48.221014 27578 raft_consensus.cc:2468] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 2.
I20260709 13:09:48.225760 27857 raft_consensus.cc:359] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.226439 27857 raft_consensus.cc:385] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.226699 27857 raft_consensus.cc:740] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.227353 27857 consensus_queue.cc:260] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.229715 27857 ts_tablet_manager.cc:1434] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:09:48.230695 27857 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:48.236644 27857 tablet_bootstrap.cc:654] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.239573 28265 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.240238 28265 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.244800 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.245631 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:48.248134 27626 leader_election.cc:343] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.249248 27857 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:48.250172 27857 ts_tablet_manager.cc:1403] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
W20260709 13:09:48.250612 27623 leader_election.cc:343] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.251065 27623 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.243173 28265 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:48.251860 28266 raft_consensus.cc:2749] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.254397 27857 raft_consensus.cc:359] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.255074 27857 raft_consensus.cc:385] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.255352 27857 raft_consensus.cc:740] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.256050 27857 consensus_queue.cc:260] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.258548 27857 ts_tablet_manager.cc:1434] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:48.259589 27857 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:48.265514 27857 tablet_bootstrap.cc:654] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.274904 27867 consensus_queue.cc:1048] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.282788 27579 raft_consensus.cc:2468] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:48.283650 27481 catalog_manager.cc:5697] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 2 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.297796 27857 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:48.298362 27857 ts_tablet_manager.cc:1403] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:09:48.297552 28267 consensus_queue.cc:1048] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:48.301103 27856 tablet_bootstrap.cc:654] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.301347 27857 raft_consensus.cc:359] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.302104 27857 raft_consensus.cc:385] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.302368 27857 raft_consensus.cc:740] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.303153 27857 consensus_queue.cc:260] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.291842 27894 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.307335 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:48.319814 27857 ts_tablet_manager.cc:1434] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:48.323478 27853 tablet_bootstrap.cc:654] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.326558 27774 leader_election.cc:304] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:48.331084 27857 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: Bootstrap starting.
I20260709 13:09:48.324167 27660 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.325917 28158 raft_consensus.cc:493] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.338241 28109 raft_consensus.cc:2804] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.340135 28158 raft_consensus.cc:515] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.353176 28158 leader_election.cc:290] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:48.354292 27857 tablet_bootstrap.cc:654] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.377027 28109 raft_consensus.cc:697] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:48.393836 27856 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:48.394382 27856 ts_tablet_manager.cc:1403] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.349s	user 0.021s	sys 0.001s
W20260709 13:09:48.394826 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 53523us
I20260709 13:09:48.395336 27911 consensus_queue.cc:1048] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.396538 28109 consensus_queue.cc:237] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.402403 27659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.403060 27659 raft_consensus.cc:2468] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:48.403414 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.414626 27856 raft_consensus.cc:359] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.415338 27856 raft_consensus.cc:385] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.415601 27856 raft_consensus.cc:740] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.416260 27856 consensus_queue.cc:260] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.419575 28157 consensus_queue.cc:1048] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.428010 27660 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:48.430171 28159 raft_consensus.cc:515] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.434842 27548 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:48.441052 27853 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:48.441545 27853 ts_tablet_manager.cc:1403] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.296s	user 0.008s	sys 0.006s
I20260709 13:09:48.442606 27857 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: No bootstrap required, opened a new log
I20260709 13:09:48.443135 27857 ts_tablet_manager.cc:1403] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.014s
I20260709 13:09:48.445187 27856 ts_tablet_manager.cc:1434] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:09:48.444150 27853 raft_consensus.cc:359] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.446316 27853 raft_consensus.cc:385] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.446573 27853 raft_consensus.cc:740] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.447175 27853 consensus_queue.cc:260] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.452365 27856 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:48.453089 28159 leader_election.cc:290] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.453739 28285 raft_consensus.cc:493] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.460870 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:48.461422 28285 raft_consensus.cc:515] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.455391 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5dcae52b444f76b89d1e20125f2a89" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:48.455765 28263 consensus_queue.cc:1048] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.462296 28159 consensus_queue.cc:1048] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:48.456648 27771 leader_election.cc:343] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.455174 27857 raft_consensus.cc:359] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.462951 27655 raft_consensus.cc:3060] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.464258 27857 raft_consensus.cc:385] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.464671 27857 raft_consensus.cc:740] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.465489 27857 consensus_queue.cc:260] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.466284 27771 leader_election.cc:304] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:48.467322 28267 raft_consensus.cc:2804] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.467705 28267 raft_consensus.cc:493] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.468029 28267 raft_consensus.cc:3060] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.472344 27857 ts_tablet_manager.cc:1434] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:09:48.439545 27986 raft_consensus.cc:2804] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.474193 27986 raft_consensus.cc:697] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:48.475010 27986 consensus_queue.cc:237] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.478058 27853 ts_tablet_manager.cc:1434] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:48.487843 28267 raft_consensus.cc:515] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.489780 28267 leader_election.cc:290] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:48.490322 27658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:48.491351 27658 raft_consensus.cc:3060] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.500715 27700 leader_election.cc:343] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.510751 27853 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:48.516791 28285 leader_election.cc:290] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.526430 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.522665 28109 consensus_queue.cc:1048] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:48.537817 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:48.542090 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.545895 27657 raft_consensus.cc:2468] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 0.
I20260709 13:09:48.548575 27853 tablet_bootstrap.cc:654] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.550473 27856 tablet_bootstrap.cc:654] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.527796 27658 raft_consensus.cc:2468] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
W20260709 13:09:48.557130 27771 leader_election.cc:343] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:48.554550 27774 leader_election.cc:343] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.561307 27771 leader_election.cc:304] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.565533 27771 leader_election.cc:304] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:48.567533 28267 raft_consensus.cc:2804] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.568593 28263 raft_consensus.cc:2804] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.574893 28267 raft_consensus.cc:493] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.585813 28267 raft_consensus.cc:3060] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.579183 28263 raft_consensus.cc:697] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:48.586905 28263 consensus_queue.cc:237] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.611913 27481 catalog_manager.cc:5697] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.621009 28261 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.621654 28261 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.622287 27655 raft_consensus.cc:2468] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:48.624187 28261 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.625036 27697 leader_election.cc:304] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.626112 28157 raft_consensus.cc:2804] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.626590 28157 raft_consensus.cc:697] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:48.627396 28157 consensus_queue.cc:237] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.631626 28278 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.632084 28278 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.634087 28278 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:48.635681 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.635808 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.635993 28267 raft_consensus.cc:515] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.636386 27654 raft_consensus.cc:2468] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 0.
W20260709 13:09:48.637228 27548 leader_election.cc:343] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.638125 27548 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:48.639635 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.640157 28278 raft_consensus.cc:2804] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.640539 28278 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.639616 28267 leader_election.cc:290] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:48.640844 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:48.642700 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
W20260709 13:09:48.643031 27774 leader_election.cc:343] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.643831 27654 raft_consensus.cc:2393] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:48.640859 28278 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.645313 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:48.646157 27655 raft_consensus.cc:3060] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.648417 27771 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.649266 28261 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.617302 28294 log.cc:927] Time spent T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:48.656374 27655 raft_consensus.cc:2468] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:48.669147 27856 tablet_bootstrap.cc:492] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:48.669260 27581 raft_consensus.cc:1275] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:48.669612 27856 ts_tablet_manager.cc:1403] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.005s
I20260709 13:09:48.672508 27771 leader_election.cc:304] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.673823 28287 raft_consensus.cc:2804] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.674631 28287 raft_consensus.cc:697] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:48.675488 28287 consensus_queue.cc:237] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.680524 28278 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.684073 28267 consensus_queue.cc:1048] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.694356 27482 catalog_manager.cc:5697] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.699674 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:48.700446 27655 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.702874 28261 raft_consensus.cc:2749] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.707670 27856 raft_consensus.cc:359] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.708614 27856 raft_consensus.cc:385] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.708958 27856 raft_consensus.cc:740] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.710659 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
W20260709 13:09:48.712124 27548 leader_election.cc:343] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.722343 27734 raft_consensus.cc:1275] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:48.724691 28278 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:48.733645 27853 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:48.734189 27853 ts_tablet_manager.cc:1403] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.226s	user 0.056s	sys 0.075s
I20260709 13:09:48.727476 27655 raft_consensus.cc:2468] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 1.
I20260709 13:09:48.736804 27853 raft_consensus.cc:359] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.737457 27853 raft_consensus.cc:385] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.737720 27853 raft_consensus.cc:740] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.738344 27853 consensus_queue.cc:260] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.740069 27853 ts_tablet_manager.cc:1434] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:48.741009 27853 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:48.744416 27548 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 2685f76105504ec2ab35ae2893841d01
I20260709 13:09:48.745198 28278 raft_consensus.cc:2804] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.745695 28278 raft_consensus.cc:697] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:09:48.746551 28278 consensus_queue.cc:237] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.747247 27853 tablet_bootstrap.cc:654] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.751503 27479 catalog_manager.cc:5697] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.753013 28287 raft_consensus.cc:493] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.753461 28287 raft_consensus.cc:515] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.753954 27479 catalog_manager.cc:5697] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 1 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.756737 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:48.757292 27856 consensus_queue.cc:260] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
W20260709 13:09:48.758105 27774 leader_election.cc:343] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.758302 28287 leader_election.cc:290] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:48.758751 27853 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:48.759352 27853 ts_tablet_manager.cc:1403] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:09:48.762313 27853 raft_consensus.cc:359] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.762977 27853 raft_consensus.cc:385] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.763250 27853 raft_consensus.cc:740] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.764055 27853 consensus_queue.cc:260] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:48.764662 27856 ts_tablet_manager.cc:1434] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:09:48.765631 27856 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:48.766016 27853 ts_tablet_manager.cc:1434] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:48.766934 27853 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:48.767122 28267 consensus_queue.cc:1048] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.771576 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:48.772636 27853 tablet_bootstrap.cc:654] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.779897 27853 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: No bootstrap required, opened a new log
I20260709 13:09:48.780301 27853 ts_tablet_manager.cc:1403] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
W20260709 13:09:48.783409 27771 leader_election.cc:343] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.783833 27771 leader_election.cc:304] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:48.784492 28263 raft_consensus.cc:2749] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.782697 27853 raft_consensus.cc:359] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.788679 27853 raft_consensus.cc:385] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.788947 27853 raft_consensus.cc:740] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.789642 27853 consensus_queue.cc:260] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.791846 27853 ts_tablet_manager.cc:1434] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:48.781682 27481 catalog_manager.cc:5697] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.801704 27856 tablet_bootstrap.cc:654] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.809676 27856 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:48.810046 27856 ts_tablet_manager.cc:1403] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:09:48.812598 27856 raft_consensus.cc:359] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.812179 27482 catalog_manager.cc:5697] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.813251 27856 raft_consensus.cc:385] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.813608 27856 raft_consensus.cc:740] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.814339 27856 consensus_queue.cc:260] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:48.818742 27856 ts_tablet_manager.cc:1434] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:09:48.819747 27856 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: Bootstrap starting.
I20260709 13:09:48.833328 27856 tablet_bootstrap.cc:654] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.839624 27856 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: No bootstrap required, opened a new log
I20260709 13:09:48.840093 27856 ts_tablet_manager.cc:1403] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:09:48.842679 27856 raft_consensus.cc:359] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.843245 27856 raft_consensus.cc:385] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.843531 27856 raft_consensus.cc:740] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.844000 28287 consensus_queue.cc:1048] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.844206 27856 consensus_queue.cc:260] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:48.846328 27856 ts_tablet_manager.cc:1434] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:48.861465 27734 raft_consensus.cc:3060] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.868889 28287 consensus_queue.cc:1048] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.927973 27894 consensus_queue.cc:1048] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.939823 27894 consensus_queue.cc:1048] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:48.951382 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:48.956431 28159 raft_consensus.cc:493] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.957037 28159 raft_consensus.cc:515] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:09:48.960556 28159 leader_election.cc:290] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:09:48.961431 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:48.961431 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671844b3f7454ba090d35213702fd9bf" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:48.962422 27655 raft_consensus.cc:2393] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:48.963426 27697 leader_election.cc:304] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:48.963967 28159 raft_consensus.cc:3060] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.968868 28159 raft_consensus.cc:2749] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.022080 28159 consensus_queue.cc:1048] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.030809 27581 raft_consensus.cc:3060] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.039151 28157 consensus_queue.cc:1048] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.065728 28287 consensus_queue.cc:1048] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.078519 28263 consensus_queue.cc:1048] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.105999 28157 raft_consensus.cc:493] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.106415 28157 raft_consensus.cc:515] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:49.108124 28157 leader_election.cc:290] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:49.108709 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:49.109277 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:49.109380 27805 raft_consensus.cc:2468] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:49.110020 27581 raft_consensus.cc:2468] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 0.
I20260709 13:09:49.110599 27697 leader_election.cc:304] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:49.111384 28157 raft_consensus.cc:2804] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.111747 28157 raft_consensus.cc:493] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.112028 28157 raft_consensus.cc:3060] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.117838 28157 raft_consensus.cc:515] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:49.120050 28157 leader_election.cc:290] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:49.120442 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:49.121093 27805 raft_consensus.cc:3060] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.121091 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2197e7fe7d9d495e94faf67b9540e800" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:49.123325 27578 raft_consensus.cc:3060] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.134234 27578 raft_consensus.cc:2468] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:49.135227 27700 leader_election.cc:304] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:49.136008 28159 raft_consensus.cc:2804] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.136430 28159 raft_consensus.cc:697] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:49.137250 27805 raft_consensus.cc:2468] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:49.137122 28159 consensus_queue.cc:237] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:49.146903 27481 catalog_manager.cc:5697] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.154174 27986 raft_consensus.cc:493] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.154762 27986 raft_consensus.cc:515] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:49.156531 27986 leader_election.cc:290] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:49.157219 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:49.157358 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9207861786984e7bb6b269ce94521002" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:49.158083 27654 raft_consensus.cc:2393] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in current term 1: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:49.159013 27548 leader_election.cc:304] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:49.159660 27986 raft_consensus.cc:3060] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.165705 27986 raft_consensus.cc:2749] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.167953 28263 consensus_queue.cc:1048] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.187204 28164 consensus_queue.cc:1048] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.248829 28157 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.249246 28157 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:49.250917 28157 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:49.251565 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:49.251945 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:49.253631 27654 raft_consensus.cc:2393] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 1: Already voted for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in this term.
I20260709 13:09:49.254532 27697 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:49.255123 28157 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.259791 28157 raft_consensus.cc:2749] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.298053 27986 consensus_queue.cc:1048] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.310452 27986 consensus_queue.cc:1048] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:49.593020 28323 consensus_queue.cc:1048] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.606176 28323 consensus_queue.cc:1048] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.673672 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:09:49.712128 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:49.713083 20036 tablet_replica.cc:333] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.714092 20036 raft_consensus.cc:2243] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.714548 20036 raft_consensus.cc:2272] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.716802 20036 tablet_replica.cc:333] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.717377 20036 raft_consensus.cc:2243] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.717775 20036 raft_consensus.cc:2272] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.719780 20036 tablet_replica.cc:333] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.720412 20036 raft_consensus.cc:2243] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.720811 20036 raft_consensus.cc:2272] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.722323 20036 tablet_replica.cc:333] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.723044 20036 raft_consensus.cc:2243] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.723477 20036 raft_consensus.cc:2272] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.724421 27700 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:49.725045 20036 tablet_replica.cc:333] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.725701 20036 raft_consensus.cc:2243] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.726163 20036 raft_consensus.cc:2272] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.727399 27700 consensus_peers.cc:597] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.728072 20036 tablet_replica.cc:333] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.728914 20036 raft_consensus.cc:2243] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.729311 20036 raft_consensus.cc:2272] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.732013 20036 tablet_replica.cc:333] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.732782 20036 raft_consensus.cc:2243] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.733745 20036 raft_consensus.cc:2272] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.735841 20036 tablet_replica.cc:333] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.736392 20036 raft_consensus.cc:2243] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.736809 20036 raft_consensus.cc:2272] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.738615 20036 tablet_replica.cc:333] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.739171 20036 raft_consensus.cc:2243] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.739612 20036 raft_consensus.cc:2272] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.741552 20036 tablet_replica.cc:333] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.742057 20036 raft_consensus.cc:2243] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.742887 20036 raft_consensus.cc:2272] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.744626 20036 tablet_replica.cc:333] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.745362 20036 raft_consensus.cc:2243] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.745836 20036 raft_consensus.cc:2272] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.748173 20036 tablet_replica.cc:333] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.749176 20036 raft_consensus.cc:2243] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.749629 20036 raft_consensus.cc:2272] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.751343 27700 consensus_peers.cc:597] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.752494 20036 tablet_replica.cc:333] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.753276 20036 raft_consensus.cc:2243] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.753640 20036 raft_consensus.cc:2272] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.754508 27700 consensus_peers.cc:597] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.755692 20036 tablet_replica.cc:333] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.756634 20036 raft_consensus.cc:2243] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.757117 20036 raft_consensus.cc:2272] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.759773 20036 tablet_replica.cc:333] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.760424 20036 raft_consensus.cc:2243] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.760903 20036 raft_consensus.cc:2272] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.760946 27700 consensus_peers.cc:597] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.764122 20036 tablet_replica.cc:333] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.764943 20036 raft_consensus.cc:2243] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:49.765296 27774 consensus_peers.cc:597] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.765437 20036 raft_consensus.cc:2272] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.767818 20036 tablet_replica.cc:333] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
W20260709 13:09:49.768499 27700 consensus_peers.cc:597] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.768546 20036 raft_consensus.cc:2243] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.769964 20036 raft_consensus.cc:2272] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.772830 20036 tablet_replica.cc:333] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.773615 20036 raft_consensus.cc:2243] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.774083 20036 raft_consensus.cc:2272] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.776459 27626 consensus_peers.cc:597] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.776733 20036 tablet_replica.cc:333] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.778541 20036 raft_consensus.cc:2243] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.779471 20036 raft_consensus.cc:2272] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.781526 20036 tablet_replica.cc:333] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.781992 20036 raft_consensus.cc:2243] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.782316 20036 raft_consensus.cc:2272] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.784255 20036 tablet_replica.cc:333] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.784741 20036 raft_consensus.cc:2243] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.785398 20036 raft_consensus.cc:2272] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.787173 20036 tablet_replica.cc:333] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.787703 20036 raft_consensus.cc:2243] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.788079 20036 raft_consensus.cc:2272] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.789764 20036 tablet_replica.cc:333] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.790223 20036 raft_consensus.cc:2243] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.790560 20036 raft_consensus.cc:2272] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.792297 20036 tablet_replica.cc:333] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.792722 20036 raft_consensus.cc:2243] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.793028 20036 raft_consensus.cc:2272] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.794700 20036 tablet_replica.cc:333] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.795138 20036 raft_consensus.cc:2243] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.795549 20036 raft_consensus.cc:2272] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.797202 20036 tablet_replica.cc:333] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.797658 20036 raft_consensus.cc:2243] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.797991 20036 raft_consensus.cc:2272] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.799650 20036 tablet_replica.cc:333] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.800104 20036 raft_consensus.cc:2243] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.800439 20036 raft_consensus.cc:2272] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.802204 20036 tablet_replica.cc:333] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.802874 20036 raft_consensus.cc:2243] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.803874 20036 raft_consensus.cc:2272] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.806071 27774 consensus_peers.cc:597] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.806406 20036 tablet_replica.cc:333] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.806978 20036 raft_consensus.cc:2243] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.807435 20036 raft_consensus.cc:2272] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.809056 20036 tablet_replica.cc:333] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.809599 20036 raft_consensus.cc:2243] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.810094 20036 raft_consensus.cc:2272] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.812290 20036 tablet_replica.cc:333] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.812866 20036 raft_consensus.cc:2243] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:49.812924 27700 consensus_peers.cc:597] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.813522 20036 raft_consensus.cc:2272] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.815127 20036 tablet_replica.cc:333] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.815789 20036 raft_consensus.cc:2243] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.816273 20036 raft_consensus.cc:2272] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.818499 20036 tablet_replica.cc:333] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.819070 20036 raft_consensus.cc:2243] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.819885 20036 raft_consensus.cc:2272] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.821841 20036 tablet_replica.cc:333] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
W20260709 13:09:49.822110 27774 consensus_peers.cc:597] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.822547 20036 raft_consensus.cc:2243] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.823084 20036 raft_consensus.cc:2272] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.823378 27774 consensus_peers.cc:597] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.825103 20036 tablet_replica.cc:333] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.825668 20036 raft_consensus.cc:2243] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.826062 20036 raft_consensus.cc:2272] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.828128 20036 tablet_replica.cc:333] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.828801 20036 raft_consensus.cc:2243] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.829586 20036 raft_consensus.cc:2272] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.831889 20036 tablet_replica.cc:333] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.832588 20036 raft_consensus.cc:2243] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.833026 20036 raft_consensus.cc:2272] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.835651 20036 tablet_replica.cc:333] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.836267 20036 raft_consensus.cc:2243] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.836733 20036 raft_consensus.cc:2272] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.839171 20036 tablet_replica.cc:333] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.839854 20036 raft_consensus.cc:2243] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:49.840538 27774 consensus_peers.cc:597] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.840902 20036 raft_consensus.cc:2272] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.843528 20036 tablet_replica.cc:333] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
W20260709 13:09:49.844082 27774 consensus_peers.cc:597] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.844192 20036 raft_consensus.cc:2243] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.845057 20036 raft_consensus.cc:2272] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.846127 27626 consensus_peers.cc:597] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.846961 20036 tablet_replica.cc:333] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.847517 20036 raft_consensus.cc:2243] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.848176 20036 raft_consensus.cc:2272] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.850283 20036 tablet_replica.cc:333] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.850957 20036 raft_consensus.cc:2243] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.851495 20036 raft_consensus.cc:2272] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.854233 20036 tablet_replica.cc:333] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.854861 20036 raft_consensus.cc:2243] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.855674 20036 raft_consensus.cc:2272] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.858323 20036 tablet_replica.cc:333] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.858783 20036 raft_consensus.cc:2243] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.859201 20036 raft_consensus.cc:2272] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.861148 20036 tablet_replica.cc:333] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: stopping tablet replica
I20260709 13:09:49.861759 20036 raft_consensus.cc:2243] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.862283 20036 raft_consensus.cc:2272] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.865005 27774 consensus_peers.cc:597] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.889745 27700 consensus_peers.cc:597] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.903574 27626 consensus_peers.cc:597] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.922930 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
W20260709 13:09:49.962759 27774 consensus_peers.cc:597] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.983742 27774 consensus_peers.cc:597] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.997494 27700 consensus_peers.cc:597] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.000926 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:50.001240 27774 consensus_peers.cc:597] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.007941 28331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.016549 27774 consensus_peers.cc:597] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.021376 28332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.019999 27700 consensus_peers.cc:597] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.024528 28334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.027557 27700 consensus_peers.cc:597] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.039520 27774 consensus_peers.cc:597] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.060163 20036 server_base.cc:1061] running on GCE node
I20260709 13:09:50.065371 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:50.065686 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:50.065913 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602590065895 us; error 0 us; skew 500 ppm
I20260709 13:09:50.066728 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:09:50.066931 27626 consensus_peers.cc:597] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.069363 20036 webserver.cc:533] Webserver started at http://127.19.145.1:37611/ using document root <none> and password file <none>
I20260709 13:09:50.069873 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:50.070025 20036 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:50.073391 20036 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:50.081612 28340 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.082346 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:50.082597 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-cd6k"
I20260709 13:09:50.082913 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:09:50.091774 27626 consensus_peers.cc:597] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.098619 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 13:09:50.100174 27700 consensus_peers.cc:597] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.100359 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:50.104387 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:50.108664 28347 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:09:50.118331 27626 consensus_peers.cc:597] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.119567 27774 consensus_peers.cc:597] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.128507 27700 consensus_peers.cc:597] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.133412 27774 consensus_peers.cc:597] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:50.150134 27700 consensus_peers.cc:597] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.344372 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:50.344731 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.237s	user 0.008s	sys 0.000s
I20260709 13:09:50.345088 20036 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:50.350862 28347 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.364880 28347 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.365753 28347 tablet_bootstrap.cc:492] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.366350 28347 ts_tablet_manager.cc:1403] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:09:50.368899 28347 raft_consensus.cc:359] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.369563 28347 raft_consensus.cc:740] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.370219 28347 consensus_queue.cc:260] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.372462 28347 ts_tablet_manager.cc:1434] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:09:50.373173 28347 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.400902 28347 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.401786 28347 tablet_bootstrap.cc:492] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.402415 28347 ts_tablet_manager.cc:1403] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 13:09:50.404469 28347 raft_consensus.cc:359] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.405124 28347 raft_consensus.cc:740] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.405755 28347 consensus_queue.cc:260] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.407615 28347 ts_tablet_manager.cc:1434] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:50.408324 28347 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.422698 28347 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.423579 28347 tablet_bootstrap.cc:492] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.424147 28347 ts_tablet_manager.cc:1403] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 13:09:50.426399 28347 raft_consensus.cc:359] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.427014 28347 raft_consensus.cc:740] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.427723 28347 consensus_queue.cc:260] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.429404 28347 ts_tablet_manager.cc:1434] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:09:50.430091 28347 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.456132 28347 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.457051 28347 tablet_bootstrap.cc:492] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.457609 28347 ts_tablet_manager.cc:1403] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.006s
I20260709 13:09:50.459991 28347 raft_consensus.cc:359] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.460616 28347 raft_consensus.cc:740] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.461362 28347 consensus_queue.cc:260] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.463349 28347 ts_tablet_manager.cc:1434] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:09:50.464067 28347 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.488827 28347 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.489964 28347 tablet_bootstrap.cc:492] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.490554 28347 ts_tablet_manager.cc:1403] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:09:50.492904 28347 raft_consensus.cc:359] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.493551 28347 raft_consensus.cc:740] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.494268 28347 consensus_queue.cc:260] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.496274 28347 ts_tablet_manager.cc:1434] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:50.496985 28347 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.534194 28347 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.535137 28347 tablet_bootstrap.cc:492] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.536221 28347 ts_tablet_manager.cc:1403] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.008s
I20260709 13:09:50.538872 28347 raft_consensus.cc:359] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.539387 28347 raft_consensus.cc:740] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.539963 28347 consensus_queue.cc:260] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.541433 28347 ts_tablet_manager.cc:1434] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:09:50.542186 28347 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.560074 28347 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.560997 28347 tablet_bootstrap.cc:492] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.561611 28347 ts_tablet_manager.cc:1403] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:09:50.564051 28347 raft_consensus.cc:359] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.564703 28347 raft_consensus.cc:740] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.565472 28347 consensus_queue.cc:260] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.567317 28347 ts_tablet_manager.cc:1434] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:50.568038 28347 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.585063 28347 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.585927 28347 tablet_bootstrap.cc:492] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.586508 28347 ts_tablet_manager.cc:1403] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:09:50.588791 28347 raft_consensus.cc:359] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.589443 28347 raft_consensus.cc:740] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.590052 28347 consensus_queue.cc:260] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.591940 28347 ts_tablet_manager.cc:1434] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:50.592641 28347 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.606144 28347 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.607034 28347 tablet_bootstrap.cc:492] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.607620 28347 ts_tablet_manager.cc:1403] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:09:50.609916 28347 raft_consensus.cc:359] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.610586 28347 raft_consensus.cc:740] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.611225 28347 consensus_queue.cc:260] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.613125 28347 ts_tablet_manager.cc:1434] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:50.613857 28347 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.648445 20036 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:50.648824 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.304s	user 0.255s	sys 0.000s
I20260709 13:09:50.662665 28347 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.663547 28347 tablet_bootstrap.cc:492] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.664106 28347 ts_tablet_manager.cc:1403] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.014s
I20260709 13:09:50.666164 28347 raft_consensus.cc:359] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.666736 28347 raft_consensus.cc:740] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.667382 28347 consensus_queue.cc:260] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.669404 28347 ts_tablet_manager.cc:1434] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:09:50.670187 28347 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.685436 28347 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.686309 28347 tablet_bootstrap.cc:492] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.686950 28347 ts_tablet_manager.cc:1403] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:09:50.689270 28347 raft_consensus.cc:359] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.689949 28347 raft_consensus.cc:740] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.690739 28347 consensus_queue.cc:260] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.692811 28347 ts_tablet_manager.cc:1434] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:50.693609 28347 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.698661 28124 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.699208 28124 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.701279 28124 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:50.702593 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
W20260709 13:09:50.713038 27626 leader_election.cc:336] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:09:50.713598 27626 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:50.714497 28124 raft_consensus.cc:2749] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.716486 28347 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.717382 28347 tablet_bootstrap.cc:492] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.718070 28347 ts_tablet_manager.cc:1403] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 13:09:50.720464 28347 raft_consensus.cc:359] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.720952 28347 raft_consensus.cc:740] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.721554 28347 consensus_queue.cc:260] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.723024 28347 ts_tablet_manager.cc:1434] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:50.723752 28347 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.737239 28347 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.737957 28347 tablet_bootstrap.cc:492] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.738453 28347 ts_tablet_manager.cc:1403] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:09:50.740212 28347 raft_consensus.cc:359] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.740813 28347 raft_consensus.cc:740] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.741386 28347 consensus_queue.cc:260] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.742830 28347 ts_tablet_manager.cc:1434] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:50.743497 28347 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.748903 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:36015
I20260709 13:09:50.749064 28422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:36015 every 8 connection(s)
I20260709 13:09:50.755661 28347 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.756633 28347 tablet_bootstrap.cc:492] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.757251 28347 ts_tablet_manager.cc:1403] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:09:50.759526 28347 raft_consensus.cc:359] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.760208 28347 raft_consensus.cc:740] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.760864 28347 consensus_queue.cc:260] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.762542 28347 ts_tablet_manager.cc:1434] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:50.763556 28347 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.779772 28347 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.780603 28347 tablet_bootstrap.cc:492] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.781463 28347 ts_tablet_manager.cc:1403] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:09:50.782421 28424 heartbeater.cc:344] Connected to a master server at 127.19.145.62:41169
I20260709 13:09:50.782860 28424 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.783752 28424 heartbeater.cc:507] Master 127.19.145.62:41169 requested a full tablet report, sending...
I20260709 13:09:50.783927 28347 raft_consensus.cc:359] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.784633 28347 raft_consensus.cc:740] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.785267 28347 consensus_queue.cc:260] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.787210 28347 ts_tablet_manager.cc:1434] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:09:50.787963 28347 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.804860 28358 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.805405 27479 ts_manager.cc:194] Re-registered known tserver with Master: a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.805363 28358 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.806836 28267 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.807394 28267 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.809494 28267 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.810843 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:50.812935 28358 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.814894 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:50.810889 28347 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.815563 27655 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:50.816535 28347 tablet_bootstrap.cc:492] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.817229 28347 ts_tablet_manager.cc:1403] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.005s
I20260709 13:09:50.819240 27697 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:50.819976 28358 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.820022 28347 raft_consensus.cc:359] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.820485 28348 raft_consensus.cc:2804] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.820794 28347 raft_consensus.cc:740] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.820575 28358 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.823220 28358 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.825917 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:50.827201 27774 leader_election.cc:343] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.827674 27774 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:50.828701 28267 raft_consensus.cc:2749] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.820983 28348 raft_consensus.cc:493] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.831143 28348 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.821920 28347 consensus_queue.cc:260] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.835762 28347 ts_tablet_manager.cc:1434] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:50.836526 28347 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.836943 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:50.839910 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.840581 28396 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:50.841368 28267 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.841956 28267 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.843978 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.844661 28396 raft_consensus.cc:2468] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:50.844653 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.845853 28267 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:09:50.846575 27774 leader_election.cc:343] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.847488 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:50.849261 27771 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:50.851166 28261 raft_consensus.cc:2749] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.852650 28348 raft_consensus.cc:515] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.855528 28348 leader_election.cc:290] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.856132 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:50.856734 27655 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.858886 27479 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54986
I20260709 13:09:50.859190 27700 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:50.860257 28348 raft_consensus.cc:2804] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.860491 28347 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.860646 28348 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.861136 28348 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.861640 28347 tablet_bootstrap.cc:492] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.862337 28347 ts_tablet_manager.cc:1403] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:09:50.864470 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e34416a06254755bef0d2066e8e3416" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:50.865339 28397 raft_consensus.cc:3060] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.865971 28424 heartbeater.cc:499] Master 127.19.145.62:41169 was elected leader, sending a full tablet report...
I20260709 13:09:50.867295 28347 raft_consensus.cc:359] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.867997 28347 raft_consensus.cc:740] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.868845 27655 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:50.868804 28347 consensus_queue.cc:260] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.870792 27697 leader_election.cc:304] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:50.871662 28358 raft_consensus.cc:2804] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.871999 28347 ts_tablet_manager.cc:1434] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:50.872145 28358 raft_consensus.cc:697] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:50.873350 28358 consensus_queue.cc:237] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.875842 28397 raft_consensus.cc:2468] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:50.876658 28261 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.877174 28261 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.878684 28347 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:50.879189 28261 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.880246 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:50.879966 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.882246 28267 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.882077 28397 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:50.882771 28267 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.884066 27774 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 387a99f68cd34b7c9e89550715e17135
I20260709 13:09:50.884902 28267 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.886547 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.887089 28267 raft_consensus.cc:2804] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.887181 28396 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:50.888032 28124 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.890198 28124 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.890493 27774 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:50.888209 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:50.891572 27655 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:50.893750 28267 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.895246 28267 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.893654 28124 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.903980 28267 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.893379 28261 raft_consensus.cc:2804] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.906186 28261 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.906584 28261 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.908496 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:50.893584 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.911590 28396 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:50.917140 27626 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:50.917920 28265 raft_consensus.cc:2804] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.918270 28265 raft_consensus.cc:493] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.918606 28265 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.924362 28124 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.924906 28124 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.928156 28164 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.928682 28164 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.928985 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:50.882004 28348 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.930212 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.930689 28164 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.930823 28396 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:50.931605 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:50.931824 28395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:50.932189 28397 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.903774 27481 catalog_manager.cc:5697] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:50.933179 27774 leader_election.cc:343] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.933900 27626 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:50.934770 28351 raft_consensus.cc:2804] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.935122 28351 raft_consensus.cc:493] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.935566 28351 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.939888 28265 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.933225 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:50.929190 28124 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.942631 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:50.943819 28397 raft_consensus.cc:2468] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:50.944568 27771 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:50.944898 27700 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:50.945362 28164 raft_consensus.cc:2749] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.945396 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:50.945708 28358 raft_consensus.cc:2804] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.946305 28358 raft_consensus.cc:697] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:50.947146 28358 consensus_queue.cc:237] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:50.947710 28395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:50.948290 28395 raft_consensus.cc:3060] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.972885 28348 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:50.943615 28261 raft_consensus.cc:515] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.982667 27804 raft_consensus.cc:2393] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 2: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:50.984021 28347 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.985394 28347 tablet_bootstrap.cc:492] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:50.986908 28347 ts_tablet_manager.cc:1403] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.019s
I20260709 13:09:50.948063 28351 raft_consensus.cc:515] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:50.994434 28323 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.994575 28351 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.995083 28323 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:50.997248 28323 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:50.998245 28279 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:50.999249 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:50.999666 28279 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.002015 27805 raft_consensus.cc:2393] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 2: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:51.003494 28396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.003598 28267 leader_election.cc:290] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:51.003696 28279 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.004173 28396 raft_consensus.cc:3060] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.998338 28394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.004647 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.005125 28394 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:51.005337 28397 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:51.007166 27700 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:51.007632 28261 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:51.008239 28261 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.008303 27700 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:51.008773 28261 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.009076 28159 raft_consensus.cc:2804] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.009233 28323 raft_consensus.cc:2804] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.009594 28159 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.009684 28323 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.010016 28159 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.010346 28323 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.017453 28159 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.018795 28323 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.021122 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.021780 28397 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.021958 28394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.022708 28394 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.028709 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:51.029573 27657 raft_consensus.cc:2393] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:51.032459 28394 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:51.032974 28279 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.033550 28279 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.048380 27700 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:51.049610 28358 raft_consensus.cc:2804] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.989894 28347 raft_consensus.cc:359] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.050114 28279 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.054450 28395 raft_consensus.cc:2468] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.055549 28279 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.059844 28393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.061494 28392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.050168 28358 raft_consensus.cc:697] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:51.072988 28392 raft_consensus.cc:2393] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:51.073273 28358 consensus_queue.cc:237] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.073856 28279 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.076327 28279 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:51.051512 28347 raft_consensus.cc:740] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.076633 28390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.077371 28347 consensus_queue.cc:260] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
W20260709 13:09:51.078341 27700 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.052203 28265 leader_election.cc:290] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.065929 28394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.055568 28396 raft_consensus.cc:2468] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.051745 28323 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.079401 28347 ts_tablet_manager.cc:1434] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:09:51.090744 28347 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.055051 28397 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:51.071415 28261 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.068456 28159 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:51.112771 27700 leader_election.cc:343] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.178407 28443 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.343732 28443 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.345765 28443 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:51.197573 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073b9352b144716a65159d5c779fde6" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:09:51.145030 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.348440 27804 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.146497 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.169137 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f027427f56542cbacf08cba476c2e90" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.144668 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:51.119006 28124 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.358269 28124 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.150290 27807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:51.360219 27807 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:51.215474 28323 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.361939 28323 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.363926 28323 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.149571 28279 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.152042 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.365094 28279 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.365427 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:51.365871 28397 raft_consensus.cc:2393] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:51.197950 27771 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.167301 28347 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.373309 28347 tablet_bootstrap.cc:492] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.373966 28347 ts_tablet_manager.cc:1403] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.283s	user 0.021s	sys 0.003s
I20260709 13:09:51.200448 28435 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.375825 28435 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.376302 27697 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.377852 28435 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.247996 28447 raft_consensus.cc:493] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.378511 28447 raft_consensus.cc:515] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.378938 28358 raft_consensus.cc:2804] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.379364 28358 raft_consensus.cc:493] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.379745 28358 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.380555 28447 leader_election.cc:290] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:51.260396 28265 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.382126 28265 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.384171 28265 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:51.265980 28449 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.384819 28449 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.386847 28449 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:51.287111 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:51.387725 27733 raft_consensus.cc:2393] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:51.200661 27626 leader_election.cc:304] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
W20260709 13:09:51.391934 27626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 191345us
I20260709 13:09:51.392580 27626 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 6352477d8f544921a79fe2a8a4b84c91
I20260709 13:09:51.394614 27482 catalog_manager.cc:5697] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.391407 28358 raft_consensus.cc:515] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.396476 27482 catalog_manager.cc:5697] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.397421 28358 leader_election.cc:290] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:09:51.343109 27700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.1:36015, user_credentials={real_user=slave}} blocked reactor thread for 261642us
I20260709 13:09:51.346607 27654 raft_consensus.cc:2393] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:51.351245 27806 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.402992 28395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.404026 28395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.407900 28387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.353564 27808 raft_consensus.cc:2393] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 387a99f68cd34b7c9e89550715e17135 in current term 2: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:51.408644 28449 raft_consensus.cc:2804] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.355360 27804 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:51.409154 28449 raft_consensus.cc:697] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.409380 28389 raft_consensus.cc:1275] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.410012 28449 consensus_queue.cc:237] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.411428 28265 raft_consensus.cc:2804] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.411466 28444 raft_consensus.cc:2749] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.411790 27806 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:51.413478 28265 raft_consensus.cc:697] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.414307 28265 consensus_queue.cc:237] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.367122 28279 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:09:51.368216 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
W20260709 13:09:51.371075 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 173177us
W20260709 13:09:51.418766 27774 leader_election.cc:343] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.371963 28124 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.419929 27700 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:51.420653 28159 raft_consensus.cc:2804] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.356700 28355 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.421015 28159 raft_consensus.cc:697] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:51.421101 28355 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.421801 28159 consensus_queue.cc:237] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.422730 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:51.423116 28355 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.424377 28393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.424422 27805 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:51.423345 27654 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
W20260709 13:09:51.425709 27774 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.421036 27700 leader_election.cc:343] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.427451 27700 leader_election.cc:343] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.429381 27700 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.430743 28279 consensus_queue.cc:1048] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.434185 27804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:51.434794 27804 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:51.437295 28347 raft_consensus.cc:359] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.437961 28347 raft_consensus.cc:740] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.438642 28347 consensus_queue.cc:260] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.439710 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e5831f4db34d93ace2689b7db99cd1" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.440481 27805 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.445441 27808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91" is_pre_election: true
I20260709 13:09:51.446082 27808 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:51.446971 27771 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.448625 28443 raft_consensus.cc:2749] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.449466 27697 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.450258 28397 raft_consensus.cc:1275] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.452474 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:51.453293 27660 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 1.
I20260709 13:09:51.455157 27660 raft_consensus.cc:3060] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.469326 27623 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:51.469731 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:51.470271 27623 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:51.470383 27729 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:51.472457 28347 ts_tablet_manager.cc:1434] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:09:51.474768 28435 raft_consensus.cc:2804] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.475174 28435 raft_consensus.cc:493] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.475556 28435 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.480479 28447 raft_consensus.cc:2804] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.480872 28447 raft_consensus.cc:493] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.481238 28447 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.483811 27771 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.484611 28444 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.485018 28444 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.485357 28444 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.487540 27805 raft_consensus.cc:2468] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:09:51.489452 28447 raft_consensus.cc:515] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.492429 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.493204 27805 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.493599 28444 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.495348 28279 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.495762 28279 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.496112 28279 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.497112 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
W20260709 13:09:51.498113 27697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.4:35273, user_credentials={real_user=slave}} blocked reactor thread for 47471.9us
W20260709 13:09:51.499861 27774 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.501186 28452 consensus_queue.cc:1048] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.504798 27805 raft_consensus.cc:2468] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.503113 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:51.506390 27623 leader_election.cc:304] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:51.508024 28265 raft_consensus.cc:2804] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.509120 28265 raft_consensus.cc:697] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.510317 28265 consensus_queue.cc:237] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.511722 27697 leader_election.cc:304] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.512533 28348 raft_consensus.cc:2804] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.512979 28348 raft_consensus.cc:697] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:09:51.513798 28348 consensus_queue.cc:237] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.516202 28444 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.518326 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:51.520749 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:51.521348 27734 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:51.522222 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:51.522876 27729 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 1.
I20260709 13:09:51.527892 28279 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.529785 27733 raft_consensus.cc:2393] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 2685f76105504ec2ab35ae2893841d01 in this term.
I20260709 13:09:51.532231 27771 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.533247 28279 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.531826 28347 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.534363 28164 raft_consensus.cc:2749] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.539426 27654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "387a99f68cd34b7c9e89550715e17135" is_pre_election: true
I20260709 13:09:51.546681 28435 raft_consensus.cc:515] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.548218 27654 raft_consensus.cc:2393] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6352477d8f544921a79fe2a8a4b84c91 in current term 2: Already voted for candidate 387a99f68cd34b7c9e89550715e17135 in this term.
I20260709 13:09:51.554364 27482 catalog_manager.cc:5697] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.556443 27482 catalog_manager.cc:5697] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.559078 27479 catalog_manager.cc:5697] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.574898 28389 raft_consensus.cc:1275] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.580590 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.580597 27660 raft_consensus.cc:1275] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.584230 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.584465 27623 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:51.584957 27805 raft_consensus.cc:2393] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2685f76105504ec2ab35ae2893841d01 in current term 2: Already voted for candidate 6352477d8f544921a79fe2a8a4b84c91 in this term.
I20260709 13:09:51.585287 27623 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:51.584983 28348 consensus_queue.cc:1048] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.586315 28449 raft_consensus.cc:2804] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.586674 28448 raft_consensus.cc:2804] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:51.585229 27700 leader_election.cc:343] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.587090 28448 raft_consensus.cc:493] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.587936 28448 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.589778 27479 catalog_manager.cc:5697] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.593190 28449 raft_consensus.cc:493] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:09:51.593993 28449 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.595742 28448 raft_consensus.cc:515] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.598708 28387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.601977 28391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bba38370f374fe1b14351e6a8564476" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.604772 28391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.605427 28387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.606928 28391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:51.611654 27805 raft_consensus.cc:1275] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.612844 28448 leader_election.cc:290] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:51.613888 27805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:09:51.614558 27805 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.615877 28449 raft_consensus.cc:515] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.619323 28449 leader_election.cc:290] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:09:51.621704 27805 raft_consensus.cc:2468] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.622630 28435 leader_election.cc:290] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.622824 27623 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:51.624308 28449 raft_consensus.cc:2804] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.624823 28449 raft_consensus.cc:697] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.625728 28449 consensus_queue.cc:237] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.627728 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:51.628352 27729 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.628922 28447 leader_election.cc:290] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:51.631579 27734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:51.632138 27734 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.638818 27697 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.639822 27771 leader_election.cc:304] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.644037 28443 raft_consensus.cc:2749] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.643899 28452 consensus_queue.cc:1048] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.646291 27771 leader_election.cc:304] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.639984 28358 raft_consensus.cc:2749] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.648427 28444 raft_consensus.cc:2749] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.639330 27729 raft_consensus.cc:2468] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.643229 27734 raft_consensus.cc:2468] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:09:51.654270 27697 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.658389 28323 raft_consensus.cc:2764] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:51.664687 27697 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.665620 28452 raft_consensus.cc:2764] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:51.675472 27623 leader_election.cc:304] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:51.675591 28323 consensus_queue.cc:1048] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.676623 28448 raft_consensus.cc:2804] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.677196 28448 raft_consensus.cc:697] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.678059 28448 consensus_queue.cc:237] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.678580 27623 leader_election.cc:304] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:09:51.685422 28449 raft_consensus.cc:2804] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.686352 28449 raft_consensus.cc:697] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:09:51.686051 27479 catalog_manager.cc:5697] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.687491 27481 catalog_manager.cc:5697] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.688619 28449 consensus_queue.cc:237] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.692667 27658 raft_consensus.cc:1275] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.695533 28347 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.708176 28347 tablet_bootstrap.cc:492] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.708912 28347 ts_tablet_manager.cc:1403] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.000s
I20260709 13:09:51.711632 28347 raft_consensus.cc:359] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.712618 28347 raft_consensus.cc:740] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.713446 28347 consensus_queue.cc:260] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.716451 28347 ts_tablet_manager.cc:1434] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:51.717288 28347 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.721534 28393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe679a9b272470a9ca60d206c005339" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.722679 28397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1479a6d10c54f62a309817459bcc2ac" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
W20260709 13:09:51.728441 27626 leader_election.cc:343] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.728708 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86957a4582b64f46b02b50bf5f5d4db0" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:51.726701 28452 consensus_queue.cc:1048] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.729426 27626 leader_election.cc:304] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:09:51.729848 28391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca597f9d49f4059aaa18be216089f24" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
W20260709 13:09:51.730623 27626 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.731539 27626 leader_election.cc:343] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.732254 27626 leader_election.cc:343] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.733212 27626 leader_election.cc:343] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.739320 27626 leader_election.cc:343] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.740229 27626 leader_election.cc:343] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.741312 27626 leader_election.cc:343] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.750912 28449 raft_consensus.cc:2749] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.764695 27482 catalog_manager.cc:5697] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.766273 27482 catalog_manager.cc:5697] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.768823 28347 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.769797 28347 tablet_bootstrap.cc:492] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.770413 28347 ts_tablet_manager.cc:1403] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.011s
I20260709 13:09:51.772921 28347 raft_consensus.cc:359] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.773555 28347 raft_consensus.cc:740] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.774252 28347 consensus_queue.cc:260] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.779343 28347 ts_tablet_manager.cc:1434] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:09:51.780150 28347 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.803478 28347 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.804389 28347 tablet_bootstrap.cc:492] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.805017 28347 ts_tablet_manager.cc:1403] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:09:51.807184 28347 raft_consensus.cc:359] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.807708 28347 raft_consensus.cc:740] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.808295 28347 consensus_queue.cc:260] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:51.810336 28347 ts_tablet_manager.cc:1434] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:51.821686 28347 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.832139 28393 raft_consensus.cc:1275] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.833900 28440 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.839942 27805 raft_consensus.cc:1275] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.841147 28448 consensus_queue.cc:1048] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.854557 28387 raft_consensus.cc:1275] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.856165 28447 consensus_queue.cc:1048] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.871971 27806 raft_consensus.cc:1275] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.875823 28452 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.893599 28347 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.894665 28347 tablet_bootstrap.cc:492] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.895401 28347 ts_tablet_manager.cc:1403] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.007s
I20260709 13:09:51.897946 28347 raft_consensus.cc:359] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.898624 28347 raft_consensus.cc:740] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.899374 28347 consensus_queue.cc:260] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:51.901554 28347 ts_tablet_manager.cc:1434] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:51.902348 28347 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.932302 28347 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.933279 28347 tablet_bootstrap.cc:492] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.933977 28347 ts_tablet_manager.cc:1403] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.011s
I20260709 13:09:51.936378 28347 raft_consensus.cc:359] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.937041 28347 raft_consensus.cc:740] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.937677 28347 consensus_queue.cc:260] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:51.939563 28347 ts_tablet_manager.cc:1434] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:51.940827 28347 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:51.943816 27806 raft_consensus.cc:1275] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.945418 28323 consensus_queue.cc:1048] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:51.979218 27700 consensus_peers.cc:597] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.987883 28387 raft_consensus.cc:1275] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.990964 28447 consensus_queue.cc:1048] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.992321 27806 raft_consensus.cc:1275] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.990867 28347 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.999161 28347 tablet_bootstrap.cc:492] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:51.999814 28347 ts_tablet_manager.cc:1403] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.019s
I20260709 13:09:52.001191 28447 consensus_queue.cc:1048] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.002154 28347 raft_consensus.cc:359] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.002836 28347 raft_consensus.cc:740] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.009189 28347 consensus_queue.cc:260] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.011111 28347 ts_tablet_manager.cc:1434] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:52.011860 28347 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.020233 27805 raft_consensus.cc:1275] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.025188 28448 consensus_queue.cc:1048] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:52.044328 27774 consensus_peers.cc:597] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:52.081481 27626 consensus_peers.cc:597] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.099967 28347 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.100931 28347 tablet_bootstrap.cc:492] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.101559 28347 ts_tablet_manager.cc:1403] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.090s	user 0.026s	sys 0.023s
I20260709 13:09:52.103994 28347 raft_consensus.cc:359] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.104564 28347 raft_consensus.cc:740] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.105182 28347 consensus_queue.cc:260] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.107234 28347 ts_tablet_manager.cc:1434] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:52.108001 28347 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.121524 28347 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.122424 28347 tablet_bootstrap.cc:492] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.123095 28347 ts_tablet_manager.cc:1403] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:09:52.125474 28347 raft_consensus.cc:359] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.126008 28347 raft_consensus.cc:740] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.126762 28347 consensus_queue.cc:260] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.128728 28347 ts_tablet_manager.cc:1434] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:52.129792 28347 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.138475 27805 raft_consensus.cc:1275] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.139801 28448 consensus_queue.cc:1048] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:52.141060 27626 consensus_peers.cc:597] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.148669 28347 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.149696 28347 tablet_bootstrap.cc:492] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.150270 28347 ts_tablet_manager.cc:1403] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:09:52.151108 28387 raft_consensus.cc:3060] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.153064 28347 raft_consensus.cc:359] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.153831 28347 raft_consensus.cc:740] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.154377 28347 consensus_queue.cc:260] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.156306 28347 ts_tablet_manager.cc:1434] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:52.157022 28347 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.166013 28389 raft_consensus.cc:3060] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.171610 28387 raft_consensus.cc:1275] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.172480 28347 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:52.174451 27700 consensus_peers.cc:597] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.177560 28389 raft_consensus.cc:1275] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.182879 28449 consensus_queue.cc:1048] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:52.183827 28347 tablet_bootstrap.cc:492] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.184499 28347 ts_tablet_manager.cc:1403] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.008s
I20260709 13:09:52.186743 28347 raft_consensus.cc:359] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.187625 28347 raft_consensus.cc:740] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.188288 28347 consensus_queue.cc:260] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.189348 28448 consensus_queue.cc:1048] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.190773 28347 ts_tablet_manager.cc:1434] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:09:52.191618 28347 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.194267 27729 raft_consensus.cc:1275] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.196668 28449 consensus_queue.cc:1048] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.222903 27734 raft_consensus.cc:1275] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:52.225075 27700 consensus_peers.cc:597] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.225075 28265 consensus_queue.cc:1048] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:52.238897 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7980 after lost signal to thread 20039
W20260709 13:09:52.240377 27755 debug-util.cc:398] Leaking SignalData structure 0x7b0800269ae0 after lost signal to thread 27517
W20260709 13:09:52.242022 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3a60 after lost signal to thread 27684
W20260709 13:09:52.243438 27755 debug-util.cc:398] Leaking SignalData structure 0x7b0800363360 after lost signal to thread 27758
W20260709 13:09:52.245221 27774 consensus_peers.cc:597] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:52.252072 27755 debug-util.cc:398] Leaking SignalData structure 0x7b080034f580 after lost signal to thread 27832
W20260709 13:09:52.253754 27755 debug-util.cc:398] Leaking SignalData structure 0x7b080004f660 after lost signal to thread 28422
I20260709 13:09:52.261549 28347 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.262523 28347 tablet_bootstrap.cc:492] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.263208 28347 ts_tablet_manager.cc:1403] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.027s
I20260709 13:09:52.265489 28347 raft_consensus.cc:359] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.266178 28347 raft_consensus.cc:740] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
W20260709 13:09:52.273556 27700 consensus_peers.cc:597] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.274911 28347 consensus_queue.cc:260] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.278993 28347 ts_tablet_manager.cc:1434] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:52.287873 28347 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.316016 28347 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.317080 28347 tablet_bootstrap.cc:492] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.317610 28347 ts_tablet_manager.cc:1403] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260709 13:09:52.319717 28347 raft_consensus.cc:359] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.320188 28347 raft_consensus.cc:740] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.320739 28347 consensus_queue.cc:260] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.322599 28347 ts_tablet_manager.cc:1434] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:52.324100 28347 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
W20260709 13:09:52.336269 27700 consensus_peers.cc:597] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.341661 28347 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.342698 28347 tablet_bootstrap.cc:492] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.343401 28347 ts_tablet_manager.cc:1403] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:52.346095 28347 raft_consensus.cc:359] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.346916 28347 raft_consensus.cc:740] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.347648 28347 consensus_queue.cc:260] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.349646 28347 ts_tablet_manager.cc:1434] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:09:52.351136 28347 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.374409 28347 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.375355 28347 tablet_bootstrap.cc:492] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.376012 28347 ts_tablet_manager.cc:1403] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:09:52.378810 28347 raft_consensus.cc:359] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.379544 28347 raft_consensus.cc:740] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.380226 28347 consensus_queue.cc:260] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.382495 28347 ts_tablet_manager.cc:1434] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:52.383350 28347 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.399941 28347 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.400841 28347 tablet_bootstrap.cc:492] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.403419 28347 ts_tablet_manager.cc:1403] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:09:52.406528 28347 raft_consensus.cc:359] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.407215 28347 raft_consensus.cc:740] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.407960 28347 consensus_queue.cc:260] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.410343 28347 ts_tablet_manager.cc:1434] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:52.411491 28347 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
W20260709 13:09:52.428512 27700 consensus_peers.cc:597] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.429153 28347 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.430094 28347 tablet_bootstrap.cc:492] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.430768 28347 ts_tablet_manager.cc:1403] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:09:52.433476 28347 raft_consensus.cc:359] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.434165 28347 raft_consensus.cc:740] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.434834 28347 consensus_queue.cc:260] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.437044 28347 ts_tablet_manager.cc:1434] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:52.437804 28347 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.475972 28347 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.476907 28347 tablet_bootstrap.cc:492] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.477581 28347 ts_tablet_manager.cc:1403] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.018s
I20260709 13:09:52.480057 28347 raft_consensus.cc:359] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.480733 28347 raft_consensus.cc:740] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.481415 28347 consensus_queue.cc:260] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.483623 28347 ts_tablet_manager.cc:1434] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:52.487774 28347 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.509405 28347 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.510329 28347 tablet_bootstrap.cc:492] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.511000 28347 ts_tablet_manager.cc:1403] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:09:52.513849 28347 raft_consensus.cc:359] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.514542 28347 raft_consensus.cc:740] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.515362 28347 consensus_queue.cc:260] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.517607 28347 ts_tablet_manager.cc:1434] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:52.520865 28347 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
W20260709 13:09:52.563512 27700 consensus_peers.cc:597] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.570500 28387 raft_consensus.cc:3060] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.596057 28347 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.597014 28347 tablet_bootstrap.cc:492] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.597903 28347 ts_tablet_manager.cc:1403] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.019s
I20260709 13:09:52.600343 28347 raft_consensus.cc:359] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.601727 28347 raft_consensus.cc:740] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.602557 28347 consensus_queue.cc:260] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.608943 28347 ts_tablet_manager.cc:1434] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:52.609906 28347 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.638334 28347 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.639317 28347 tablet_bootstrap.cc:492] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.639963 28347 ts_tablet_manager.cc:1403] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.004s
I20260709 13:09:52.643057 28347 raft_consensus.cc:359] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.643774 28347 raft_consensus.cc:740] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.644603 28347 consensus_queue.cc:260] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.646579 28347 ts_tablet_manager.cc:1434] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:52.647418 28347 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
W20260709 13:09:52.658159 27774 consensus_peers.cc:597] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:52.674062 28347 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.675534 28347 tablet_bootstrap.cc:492] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.676411 28347 ts_tablet_manager.cc:1403] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:09:52.678925 28347 raft_consensus.cc:359] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.679662 28347 raft_consensus.cc:740] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.680377 28347 consensus_queue.cc:260] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.682595 28347 ts_tablet_manager.cc:1434] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:52.683749 28347 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.696791 28347 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.697708 28347 tablet_bootstrap.cc:492] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.698417 28347 ts_tablet_manager.cc:1403] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:09:52.700690 28347 raft_consensus.cc:359] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.701361 28347 raft_consensus.cc:740] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.701985 28347 consensus_queue.cc:260] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.763211 28347 ts_tablet_manager.cc:1434] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.065s	user 0.026s	sys 0.030s
I20260709 13:09:52.764097 28347 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.777626 28347 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.778556 28347 tablet_bootstrap.cc:492] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.779102 28347 ts_tablet_manager.cc:1403] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:09:52.781272 28347 raft_consensus.cc:359] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.781937 28347 raft_consensus.cc:740] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.782513 28347 consensus_queue.cc:260] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:09:52.788779 28347 ts_tablet_manager.cc:1434] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 13:09:52.789567 28347 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.836177 28387 raft_consensus.cc:3060] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.883955 28347 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.885041 28347 tablet_bootstrap.cc:492] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.885692 28347 ts_tablet_manager.cc:1403] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.025s
I20260709 13:09:52.888165 28347 raft_consensus.cc:359] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.888878 28347 raft_consensus.cc:740] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.890542 28347 consensus_queue.cc:260] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.894647 28347 ts_tablet_manager.cc:1434] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:52.895455 28347 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.920423 28347 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.921391 28347 tablet_bootstrap.cc:492] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.921988 28347 ts_tablet_manager.cc:1403] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 13:09:52.924867 28347 raft_consensus.cc:359] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.925616 28347 raft_consensus.cc:740] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.926326 28347 consensus_queue.cc:260] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:52.928287 28347 ts_tablet_manager.cc:1434] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:09:52.929134 28347 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap starting.
I20260709 13:09:52.955441 28347 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.956843 28347 tablet_bootstrap.cc:492] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Bootstrap complete.
I20260709 13:09:52.957491 28347 ts_tablet_manager.cc:1403] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:09:52.959749 28347 raft_consensus.cc:359] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.960244 28347 raft_consensus.cc:740] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.960801 28347 consensus_queue.cc:260] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:09:52.963394 28347 ts_tablet_manager.cc:1434] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:53.020218 28387 raft_consensus.cc:3060] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.154402 28442 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.154966 28442 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:53.157720 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01" is_pre_election: true
I20260709 13:09:53.158064 28442 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:53.158246 28387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" is_pre_election: true
I20260709 13:09:53.159332 28387 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 1.
I20260709 13:09:53.158407 27729 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 2.
I20260709 13:09:53.160614 27771 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:09:53.161270 28355 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:53.161628 28355 raft_consensus.cc:493] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.161892 28355 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.172082 28355 raft_consensus.cc:515] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:53.175364 28355 leader_election.cc:290] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:09:53.179005 28387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
I20260709 13:09:53.179594 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce1e8262b44f7d9d12d08e0c3fe1b5" candidate_uuid: "6352477d8f544921a79fe2a8a4b84c91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:09:53.180182 27729 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.179639 28387 raft_consensus.cc:3060] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.203771 28387 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 3.
I20260709 13:09:53.205107 27774 leader_election.cc:304] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:09:53.206759 28444 raft_consensus.cc:2804] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.207311 28444 raft_consensus.cc:697] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 LEADER]: Becoming Leader. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:09:53.208110 28444 consensus_queue.cc:237] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:09:53.217235 27729 raft_consensus.cc:2468] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6352477d8f544921a79fe2a8a4b84c91 in term 3.
I20260709 13:09:53.227797 27479 catalog_manager.cc:5697] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 reported cstate change: term changed from 1 to 3, leader changed from a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1) to 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4). New cstate: current_term: 3 leader_uuid: "6352477d8f544921a79fe2a8a4b84c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.595644 28391 raft_consensus.cc:1275] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.596807 28444 consensus_queue.cc:1048] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.619961 27734 raft_consensus.cc:1275] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Refusing update from remote peer 6352477d8f544921a79fe2a8a4b84c91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.624549 28444 consensus_queue.cc:1048] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:00.825044 27755 debug-util.cc:398] Leaking SignalData structure 0x7b080004f820 after lost signal to thread 20039
W20260709 13:10:00.826241 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6100 after lost signal to thread 27517
W20260709 13:10:00.827495 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4fe0 after lost signal to thread 27684
W20260709 13:10:00.828593 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08002401e0 after lost signal to thread 27758
W20260709 13:10:00.829543 27755 debug-util.cc:398] Leaking SignalData structure 0x7b0800302f80 after lost signal to thread 27832
W20260709 13:10:00.830400 27755 debug-util.cc:398] Leaking SignalData structure 0x7b08003617a0 after lost signal to thread 28422
I20260709 13:10:01.139308 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.203948 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:01.204849 27733 raft_consensus.cc:606] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:01.208156 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:01.208645 27733 raft_consensus.cc:606] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:01.212983 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "387a99f68cd34b7c9e89550715e17135"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:01.214313 27733 raft_consensus.cc:606] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS 387a99f68cd34b7c9e89550715e17135
I20260709 13:10:01.228674 27806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d4fec365128419699378d6468f59415"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:01.229076 27806 raft_consensus.cc:606] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:01.231050 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "387a99f68cd34b7c9e89550715e17135"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:01.231498 27733 raft_consensus.cc:606] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS 387a99f68cd34b7c9e89550715e17135
I20260709 13:10:01.242856 27655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9"
dest_uuid: "387a99f68cd34b7c9e89550715e17135"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:38456
I20260709 13:10:01.244402 27655 raft_consensus.cc:606] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:01.247112 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:01.247653 27733 raft_consensus.cc:606] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:01.248710 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:10:01.250281 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:01.268568 28550 raft_consensus.cc:993] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower 387a99f68cd34b7c9e89550715e17135 to start an election
I20260709 13:10:01.269130 28561 raft_consensus.cc:1081] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer 387a99f68cd34b7c9e89550715e17135 to start an election
I20260709 13:10:01.270486 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889"
dest_uuid: "387a99f68cd34b7c9e89550715e17135"
 from {username='slave'} at 127.0.0.1:36288
I20260709 13:10:01.271168 27655 raft_consensus.cc:493] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.271647 27655 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.278306 27655 raft_consensus.cc:515] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.280686 27655 leader_election.cc:290] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:01.281533 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:01.281462 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8977a3bcc74a06b26475b593096889" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:01.282182 27806 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.282239 27733 raft_consensus.cc:3055] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.282639 27733 raft_consensus.cc:740] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:01.283425 27733 consensus_queue.cc:260] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.284439 27733 raft_consensus.cc:3060] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.287662 27806 raft_consensus.cc:2468] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:10:01.288956 27623 leader_election.cc:304] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:10:01.289857 28533 raft_consensus.cc:2804] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.290246 28533 raft_consensus.cc:697] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:10:01.291014 28533 consensus_queue.cc:237] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.295437 27733 raft_consensus.cc:2468] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:10:01.322188 27479 catalog_manager.cc:5697] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.341250 28554 raft_consensus.cc:993] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.341740 28554 raft_consensus.cc:1081] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.343091 28391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:01.343554 28391 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.343807 28391 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.348681 28391 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:01.352681 28391 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 3 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:01.362484 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:01.363080 27733 raft_consensus.cc:3055] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.363124 28561 raft_consensus.cc:993] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.363453 27733 raft_consensus.cc:740] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:01.363834 28550 raft_consensus.cc:1081] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.364338 27733 consensus_queue.cc:260] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:01.365320 28391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:01.365499 27733 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.365885 28391 raft_consensus.cc:493] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.366209 28391 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.369606 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be10201ecf4e49fdb34aa543e5dcf264" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:01.370170 27806 raft_consensus.cc:3060] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.374395 28391 raft_consensus.cc:515] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.375092 27806 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 3.
I20260709 13:10:01.376354 28391 leader_election.cc:290] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:10:01.376363 28341 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:01.379376 27733 raft_consensus.cc:2468] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 3.
I20260709 13:10:01.381155 28575 raft_consensus.cc:2804] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.382529 28575 raft_consensus.cc:697] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:01.384028 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:01.383893 28575 consensus_queue.cc:237] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:01.384471 27733 raft_consensus.cc:3055] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.384796 27733 raft_consensus.cc:740] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:01.385587 27733 consensus_queue.cc:260] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.386847 27733 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.394044 27733 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.399425 28341 leader_election.cc:304] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:01.400095 28575 raft_consensus.cc:2804] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.400838 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffdc09edd634205ab7d40c675eee062" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:01.401328 27655 raft_consensus.cc:3060] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.400588 28575 raft_consensus.cc:697] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:01.402971 28575 consensus_queue.cc:237] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.407137 27655 raft_consensus.cc:2468] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.444554 27479 catalog_manager.cc:5697] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 2 to 3, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.477557 27479 catalog_manager.cc:5697] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.487936 28550 raft_consensus.cc:993] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower 387a99f68cd34b7c9e89550715e17135 to start an election
I20260709 13:10:01.488497 28579 raft_consensus.cc:1081] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer 387a99f68cd34b7c9e89550715e17135 to start an election
I20260709 13:10:01.489755 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9"
dest_uuid: "387a99f68cd34b7c9e89550715e17135"
 from {username='slave'} at 127.0.0.1:36288
I20260709 13:10:01.490121 27655 raft_consensus.cc:493] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.490330 27655 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.496361 27655 raft_consensus.cc:515] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.498135 27655 leader_election.cc:290] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:01.498715 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:01.499352 27733 raft_consensus.cc:3055] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.499648 27733 raft_consensus.cc:740] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:01.500379 27733 consensus_queue.cc:260] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.501217 27733 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.505256 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "387a99f68cd34b7c9e89550715e17135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:01.505944 27802 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.508937 27733 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:10:01.510063 27623 leader_election.cc:304] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:10:01.510922 28567 raft_consensus.cc:2804] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.511343 28567 raft_consensus.cc:697] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Leader. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:10:01.512046 28567 consensus_queue.cc:237] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:01.512809 27802 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 387a99f68cd34b7c9e89550715e17135 in term 2.
I20260709 13:10:01.521888 27479 catalog_manager.cc:5697] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to 387a99f68cd34b7c9e89550715e17135 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "387a99f68cd34b7c9e89550715e17135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.631031 28533 raft_consensus.cc:993] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.631575 28567 raft_consensus.cc:1081] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.633049 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44126
I20260709 13:10:01.633566 28393 raft_consensus.cc:493] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.633852 28393 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.639070 28393 raft_consensus.cc:515] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.640949 28393 leader_election.cc:290] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:01.641593 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:01.641805 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d5ebd76b7743ee96caafce6e15dca9" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:01.642268 27802 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.642452 27655 raft_consensus.cc:3055] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.642838 27655 raft_consensus.cc:740] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:10:01.643651 27655 consensus_queue.cc:260] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.644565 27655 raft_consensus.cc:3060] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.647543 27802 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.648484 28341 leader_election.cc:304] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:01.648940 27655 raft_consensus.cc:2468] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.649346 28575 raft_consensus.cc:2804] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.649932 28575 raft_consensus.cc:697] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:01.650789 28575 consensus_queue.cc:237] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.660457 27479 catalog_manager.cc:5697] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 387a99f68cd34b7c9e89550715e17135 (127.19.145.2) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.694324 27802 raft_consensus.cc:1275] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.695379 28567 consensus_queue.cc:1048] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.707909 27733 raft_consensus.cc:1275] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.709939 28555 consensus_queue.cc:1048] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.756527 28579 raft_consensus.cc:993] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.756950 28550 raft_consensus.cc:1081] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.758272 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:01.758730 28393 raft_consensus.cc:493] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.759032 28393 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.764497 28393 raft_consensus.cc:515] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.765142 27733 raft_consensus.cc:1275] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.766290 28393 leader_election.cc:290] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:10:01.766835 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:01.766644 28575 consensus_queue.cc:1048] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.767393 27655 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.767903 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9686e9b98e4e07b6f193bb7b36a785" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:01.768656 27733 raft_consensus.cc:3055] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.768950 27733 raft_consensus.cc:740] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:01.770605 27733 consensus_queue.cc:260] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.771917 27733 raft_consensus.cc:3060] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.775741 27655 raft_consensus.cc:2468] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.776922 27733 raft_consensus.cc:2468] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.777192 28341 leader_election.cc:304] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:01.778007 28575 raft_consensus.cc:2804] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.778466 28575 raft_consensus.cc:697] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:01.779474 28575 consensus_queue.cc:237] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:01.794520 27802 raft_consensus.cc:1275] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.796797 28589 consensus_queue.cc:1048] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:01.806007 27479 catalog_manager.cc:5697] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.821722 28547 raft_consensus.cc:993] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.822392 28564 raft_consensus.cc:1081] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:01.826762 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d4fec365128419699378d6468f59415"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44122
I20260709 13:10:01.827312 28393 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.827714 28393 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.840634 28393 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.842849 28393 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:01.843451 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:01.843735 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4fec365128419699378d6468f59415" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:01.844172 27802 raft_consensus.cc:3055] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.844321 27655 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.844555 27802 raft_consensus.cc:740] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:01.845386 27802 consensus_queue.cc:260] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.846444 27802 raft_consensus.cc:3060] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.850893 27655 raft_consensus.cc:2468] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.851917 28341 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:01.852679 28589 raft_consensus.cc:2804] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.853152 28589 raft_consensus.cc:697] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:01.854022 28589 consensus_queue.cc:237] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:01.855561 27802 raft_consensus.cc:2468] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:01.864596 27479 catalog_manager.cc:5697] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.944871 27733 raft_consensus.cc:1275] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.946157 28555 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.954995 27806 raft_consensus.cc:1275] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 387a99f68cd34b7c9e89550715e17135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.959331 28533 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.991387 27655 raft_consensus.cc:1275] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.993144 28589 consensus_queue.cc:1048] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:02.002650 27733 raft_consensus.cc:1275] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.004912 28576 consensus_queue.cc:1048] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.043972 27802 raft_consensus.cc:1275] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.045902 28575 consensus_queue.cc:1048] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.056275 27660 raft_consensus.cc:1275] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.057482 28575 consensus_queue.cc:1048] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.240815 27655 raft_consensus.cc:1275] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.242074 28589 consensus_queue.cc:1048] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.251199 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.264238 27733 raft_consensus.cc:1275] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.266577 28589 consensus_queue.cc:1048] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.305815 27660 raft_consensus.cc:1275] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.307598 28589 consensus_queue.cc:1048] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.320314 27802 raft_consensus.cc:1275] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.325762 28576 consensus_queue.cc:1048] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.333484 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.402644 27655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9"
dest_uuid: "387a99f68cd34b7c9e89550715e17135"
mode: GRACEFUL
new_leader_uuid: "2685f76105504ec2ab35ae2893841d01"
 from {username='slave'} at 127.0.0.1:38456
I20260709 13:10:02.403220 27655 raft_consensus.cc:606] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Received request to transfer leadership to TS 2685f76105504ec2ab35ae2893841d01
I20260709 13:10:02.406114 27731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:02.406716 27731 raft_consensus.cc:606] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:02.409042 27660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b73701f47449cd96689924bfef1787"
dest_uuid: "387a99f68cd34b7c9e89550715e17135"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:38456
I20260709 13:10:02.409471 27660 raft_consensus.cc:606] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:02.411903 27806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:02.412406 27806 raft_consensus.cc:606] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:02.415004 27731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:02.415583 27731 raft_consensus.cc:606] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:02.417066 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:02.418627 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.470114 28567 raft_consensus.cc:993] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: : Instructing follower 2685f76105504ec2ab35ae2893841d01 to start an election
I20260709 13:10:02.470641 28555 raft_consensus.cc:1081] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Signalling peer 2685f76105504ec2ab35ae2893841d01 to start an election
I20260709 13:10:02.471966 27731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:10:02.472441 27731 raft_consensus.cc:493] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.472750 27731 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.478981 27731 raft_consensus.cc:515] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:02.481089 27731 leader_election.cc:290] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:02.481630 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:02.481912 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97b2b6ae80408999e7abedfeb241a9" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:02.482252 27660 raft_consensus.cc:3055] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.482470 27806 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.482617 27660 raft_consensus.cc:740] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:10:02.483665 27660 consensus_queue.cc:260] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:02.484670 27660 raft_consensus.cc:3060] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.488981 27806 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 3.
I20260709 13:10:02.490432 27697 leader_election.cc:304] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 6352477d8f544921a79fe2a8a4b84c91; no voters: 
I20260709 13:10:02.490996 27660 raft_consensus.cc:2468] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 3.
I20260709 13:10:02.491173 28550 raft_consensus.cc:2804] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.491802 28550 raft_consensus.cc:697] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 3 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:02.492533 28550 consensus_queue.cc:237] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:02.500116 27479 catalog_manager.cc:5697] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 2 to 3, leader changed from 387a99f68cd34b7c9e89550715e17135 (127.19.145.2) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.816316 28580 raft_consensus.cc:993] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.816869 28547 raft_consensus.cc:1081] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.818171 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44122
I20260709 13:10:02.818593 28393 raft_consensus.cc:493] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.818857 28393 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.823161 28550 raft_consensus.cc:993] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.823724 28606 raft_consensus.cc:1081] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.825131 28392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:02.825598 28392 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.825282 28393 raft_consensus.cc:515] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.825956 28392 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.827189 28393 leader_election.cc:290] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:02.827927 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:02.828510 27733 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.828909 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b6a26fb8b24f0eb7d1a0c904eb6280" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:02.829557 27802 raft_consensus.cc:3055] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.829859 27802 raft_consensus.cc:740] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:02.830663 27802 consensus_queue.cc:260] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.831970 27802 raft_consensus.cc:3060] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.833164 28392 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.835487 27733 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:02.837522 28341 leader_election.cc:304] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:02.838102 27731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:02.838320 28589 raft_consensus.cc:2804] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.838786 27731 raft_consensus.cc:3055] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.838872 28589 raft_consensus.cc:697] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:02.839210 27731 raft_consensus.cc:740] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:02.839916 28589 consensus_queue.cc:237] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.840569 28392 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:02.840734 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e15fde3df7459bbee42a28a244ef86" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:02.841358 27806 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.838835 27802 raft_consensus.cc:2468] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:02.840067 27731 consensus_queue.cc:260] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.844692 27731 raft_consensus.cc:3060] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.848829 27806 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:02.850092 28341 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:02.850958 28576 raft_consensus.cc:2804] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.851429 28576 raft_consensus.cc:697] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:02.852178 28576 consensus_queue.cc:237] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.855180 27731 raft_consensus.cc:2468] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:02.859066 27479 catalog_manager.cc:5697] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.887437 27479 catalog_manager.cc:5697] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.901763 28533 raft_consensus.cc:993] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.902380 28533 raft_consensus.cc:1081] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.903935 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b73701f47449cd96689924bfef1787"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44126
I20260709 13:10:02.904942 28393 raft_consensus.cc:493] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.905290 28393 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.918956 27660 raft_consensus.cc:1275] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.921228 28550 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.946823 27806 raft_consensus.cc:1275] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.948611 28612 consensus_queue.cc:1048] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.954125 28393 raft_consensus.cc:515] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:02.955169 28612 raft_consensus.cc:993] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.955688 28613 raft_consensus.cc:1081] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:02.957185 28392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:02.957701 28392 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.958073 28392 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.958285 28393 leader_election.cc:290] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:10:02.961017 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:02.961511 27729 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.965219 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b73701f47449cd96689924bfef1787" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:02.965783 27657 raft_consensus.cc:3055] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.966044 27657 raft_consensus.cc:740] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 387a99f68cd34b7c9e89550715e17135, State: Running, Role: LEADER
I20260709 13:10:02.966418 28392 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.968444 28392 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 3 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:02.971390 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:02.971927 27733 raft_consensus.cc:3055] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.972213 27733 raft_consensus.cc:740] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:02.972847 27733 consensus_queue.cc:260] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.974035 27733 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.966743 27657 consensus_queue.cc:260] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:02.977713 27657 raft_consensus.cc:3060] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.979182 27806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1eca5604bf471a859dd26aba03fc9d" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:02.979765 27806 raft_consensus.cc:3060] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.984123 27729 raft_consensus.cc:2468] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:02.985339 28341 leader_election.cc:304] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:02.986527 28597 raft_consensus.cc:2804] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.987040 28597 raft_consensus.cc:697] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:02.987356 27733 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 3.
I20260709 13:10:02.988386 28341 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:02.989279 28614 raft_consensus.cc:2804] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.989920 28614 raft_consensus.cc:697] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:02.988525 28597 consensus_queue.cc:237] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:02.990703 28614 consensus_queue.cc:237] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:02.991812 27657 raft_consensus.cc:2468] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.003947 27806 raft_consensus.cc:2468] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 3.
I20260709 13:10:03.015364 27482 catalog_manager.cc:5697] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 387a99f68cd34b7c9e89550715e17135 (127.19.145.2) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.029788 27482 catalog_manager.cc:5697] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 2 to 3, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 3 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.306571 27731 raft_consensus.cc:1275] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.307698 28597 consensus_queue.cc:1048] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.317277 27806 raft_consensus.cc:1275] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.321085 28614 consensus_queue.cc:1048] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.363104 27731 raft_consensus.cc:1275] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.365377 28614 consensus_queue.cc:1048] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.377784 27806 raft_consensus.cc:1275] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.378981 28589 consensus_queue.cc:1048] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.419509 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.447156 27657 raft_consensus.cc:1275] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.448885 28576 consensus_queue.cc:1048] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.466321 27731 raft_consensus.cc:1275] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.467922 28597 consensus_queue.cc:1048] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.482353 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.507411 27802 raft_consensus.cc:1275] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.512930 28597 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.532092 27731 raft_consensus.cc:1275] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.533738 28614 consensus_queue.cc:1048] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.554818 27802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eab03f165164c039475da5b90d445ed"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:03.555517 27802 raft_consensus.cc:606] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:03.558231 27802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:03.558805 27802 raft_consensus.cc:606] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:03.561090 27802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:03.561493 27802 raft_consensus.cc:606] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:03.564045 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:03.564519 27733 raft_consensus.cc:606] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:03.566888 27802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81"
dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
mode: GRACEFUL
new_leader_uuid: "2685f76105504ec2ab35ae2893841d01"
 from {username='slave'} at 127.0.0.1:43164
I20260709 13:10:03.567430 27802 raft_consensus.cc:606] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Received request to transfer leadership to TS 2685f76105504ec2ab35ae2893841d01
I20260709 13:10:03.568576 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:03.569797 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:03.584524 28547 raft_consensus.cc:993] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.585012 28580 raft_consensus.cc:1081] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.586361 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44122
I20260709 13:10:03.586850 28393 raft_consensus.cc:493] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.587134 28393 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.593488 28393 raft_consensus.cc:515] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:03.595157 28393 leader_election.cc:290] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:03.596014 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:03.596591 27657 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.596537 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b4fe2dd2ab4ecfa2cafe055c364838" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:03.597313 27802 raft_consensus.cc:3055] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.597656 27802 raft_consensus.cc:740] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:03.598313 27802 consensus_queue.cc:260] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:03.599329 27802 raft_consensus.cc:3060] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.601677 27657 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.602629 28341 leader_election.cc:304] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:03.603389 28614 raft_consensus.cc:2804] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.603845 28614 raft_consensus.cc:697] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:03.604770 27802 raft_consensus.cc:2468] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.604707 28614 consensus_queue.cc:237] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:03.614717 27479 catalog_manager.cc:5697] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.729820 28606 raft_consensus.cc:993] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.730211 28628 raft_consensus.cc:1081] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.731458 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:03.731846 28393 raft_consensus.cc:493] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.732062 28393 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.736173 28393 raft_consensus.cc:515] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:03.737893 28393 leader_election.cc:290] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:10:03.738467 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:03.738976 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b451f9357d24103a777c6e4c9a434b5" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:03.739024 27657 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.739635 27733 raft_consensus.cc:3055] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.739930 27733 raft_consensus.cc:740] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:03.740736 27733 consensus_queue.cc:260] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:03.741814 27733 raft_consensus.cc:3060] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.744608 27657 raft_consensus.cc:2468] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.745505 28341 leader_election.cc:304] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:03.746122 28589 raft_consensus.cc:2804] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.746506 28589 raft_consensus.cc:697] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:03.746434 27733 raft_consensus.cc:2468] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.747615 28589 consensus_queue.cc:237] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:03.757419 27479 catalog_manager.cc:5697] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.803539 28580 raft_consensus.cc:993] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower 2685f76105504ec2ab35ae2893841d01 to start an election
I20260709 13:10:03.804047 28547 raft_consensus.cc:1081] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer 2685f76105504ec2ab35ae2893841d01 to start an election
I20260709 13:10:03.805583 27733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
 from {username='slave'} at 127.0.0.1:43540
I20260709 13:10:03.806042 27733 raft_consensus.cc:493] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.806396 27733 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.811538 27733 raft_consensus.cc:515] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:03.812733 27733 leader_election.cc:290] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:03.813395 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:03.813669 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31eb77bd604406be314032a8b76a81" candidate_uuid: "2685f76105504ec2ab35ae2893841d01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:03.814014 27657 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.814296 27802 raft_consensus.cc:3055] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.814649 27802 raft_consensus.cc:740] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:03.815410 27802 consensus_queue.cc:260] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:03.816444 27802 raft_consensus.cc:3060] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.819321 27657 raft_consensus.cc:2468] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:10:03.820225 27697 leader_election.cc:304] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, 387a99f68cd34b7c9e89550715e17135; no voters: 
I20260709 13:10:03.820842 28628 raft_consensus.cc:2804] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.821297 28628 raft_consensus.cc:697] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Becoming Leader. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:03.821662 27802 raft_consensus.cc:2468] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2685f76105504ec2ab35ae2893841d01 in term 2.
I20260709 13:10:03.822171 28628 consensus_queue.cc:237] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } }
I20260709 13:10:03.832839 27479 catalog_manager.cc:5697] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to 2685f76105504ec2ab35ae2893841d01 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "2685f76105504ec2ab35ae2893841d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.932900 28580 raft_consensus.cc:993] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.933414 28547 raft_consensus.cc:1081] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.934645 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eab03f165164c039475da5b90d445ed"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44122
I20260709 13:10:03.935037 28393 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.935300 28393 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.940604 28393 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:03.942533 28393 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273)
I20260709 13:10:03.943570 27733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:03.944203 27733 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.944706 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eab03f165164c039475da5b90d445ed" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:03.945319 27802 raft_consensus.cc:3055] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.945627 27802 raft_consensus.cc:740] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:03.946347 27802 consensus_queue.cc:260] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:03.947530 27802 raft_consensus.cc:3060] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.950498 27733 raft_consensus.cc:2468] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.951632 28341 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:03.952383 28576 raft_consensus.cc:2804] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.952817 28576 raft_consensus.cc:697] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:03.953738 27802 raft_consensus.cc:2468] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.953651 28576 consensus_queue.cc:237] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:03.968818 27479 catalog_manager.cc:5697] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.981191 28580 raft_consensus.cc:993] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.981616 28640 raft_consensus.cc:1081] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:03.983090 28393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44122
I20260709 13:10:03.983578 28393 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.983866 28393 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.988459 28393 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:03.989920 28393 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4:35273), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:03.990607 27802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6352477d8f544921a79fe2a8a4b84c91"
I20260709 13:10:03.990672 27657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0ccee8df74beb8c4eaa0ba1902c9e" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:03.991310 27802 raft_consensus.cc:3055] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.991389 27657 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.991672 27802 raft_consensus.cc:740] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6352477d8f544921a79fe2a8a4b84c91, State: Running, Role: LEADER
I20260709 13:10:03.992515 27802 consensus_queue.cc:260] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:03.993518 27802 raft_consensus.cc:3060] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.997289 27657 raft_consensus.cc:2468] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.998202 28341 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:03.998821 27802 raft_consensus.cc:2468] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:03.998899 28576 raft_consensus.cc:2804] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.999464 28576 raft_consensus.cc:697] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:04.000279 28576 consensus_queue.cc:237] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:04.009593 27479 catalog_manager.cc:5697] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 6352477d8f544921a79fe2a8a4b84c91 (127.19.145.4) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.050153 27802 raft_consensus.cc:1275] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.051126 28576 consensus_queue.cc:1048] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.062464 27657 raft_consensus.cc:1275] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.064039 28576 consensus_queue.cc:1048] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.243399 27660 raft_consensus.cc:1275] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.244481 28589 consensus_queue.cc:1048] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.253392 27731 raft_consensus.cc:1275] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.255882 28589 consensus_queue.cc:1048] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.337296 27660 raft_consensus.cc:1275] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.338367 28650 consensus_queue.cc:1048] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.347425 27806 raft_consensus.cc:1275] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer 2685f76105504ec2ab35ae2893841d01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.349884 28650 consensus_queue.cc:1048] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.405711 27733 raft_consensus.cc:1275] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.406790 28589 consensus_queue.cc:1048] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.412178 27660 raft_consensus.cc:1275] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.414403 28614 consensus_queue.cc:1048] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.422360 27806 raft_consensus.cc:1275] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.423871 28589 consensus_queue.cc:1048] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.444653 27806 raft_consensus.cc:1275] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.448670 28654 consensus_queue.cc:1048] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.570542 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.610455 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.650797 27733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9449fef1f664215b643cd9668147684"
dest_uuid: "2685f76105504ec2ab35ae2893841d01"
mode: GRACEFUL
new_leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:10:04.651332 27733 raft_consensus.cc:606] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Received request to transfer leadership to TS a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:04.652376 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:04.653478 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.092393 28606 raft_consensus.cc:993] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: : Instructing follower a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:05.092849 28650 raft_consensus.cc:1081] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Signalling peer a9a0c8d4e88f4bdbb310a7dd1e794614 to start an election
I20260709 13:10:05.094141 28392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9449fef1f664215b643cd9668147684"
dest_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614"
 from {username='slave'} at 127.0.0.1:44140
I20260709 13:10:05.094642 28392 raft_consensus.cc:493] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.095005 28392 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.100689 28392 raft_consensus.cc:515] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:05.102181 28392 leader_election.cc:290] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Requested vote from peers 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745), 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259)
I20260709 13:10:05.102811 27660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "387a99f68cd34b7c9e89550715e17135"
I20260709 13:10:05.102964 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9449fef1f664215b643cd9668147684" candidate_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2685f76105504ec2ab35ae2893841d01"
I20260709 13:10:05.103411 27660 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.103444 27729 raft_consensus.cc:3055] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:05.104868 27729 raft_consensus.cc:740] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2685f76105504ec2ab35ae2893841d01, State: Running, Role: LEADER
I20260709 13:10:05.105726 27729 consensus_queue.cc:260] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:05.107097 27729 raft_consensus.cc:3060] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.109844 27660 raft_consensus.cc:2468] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:05.111403 28341 leader_election.cc:304] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614; no voters: 
I20260709 13:10:05.112106 28589 raft_consensus.cc:2804] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:05.112545 28589 raft_consensus.cc:697] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Becoming Leader. State: Replica: a9a0c8d4e88f4bdbb310a7dd1e794614, State: Running, Role: LEADER
I20260709 13:10:05.113265 28589 consensus_queue.cc:237] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:05.113777 27729 raft_consensus.cc:2468] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a0c8d4e88f4bdbb310a7dd1e794614 in term 2.
I20260709 13:10:05.123100 27482 catalog_manager.cc:5697] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 reported cstate change: term changed from 1 to 2, leader changed from 2685f76105504ec2ab35ae2893841d01 (127.19.145.3) to a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.654314 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.689909 20036 tablet_server.cc:179] TabletServer@127.19.145.1:36015 shutting down...
W20260709 13:10:05.718037 27700 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 70 similar messages]
I20260709 13:10:05.718406 27660 raft_consensus.cc:1275] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Refusing update from remote peer a9a0c8d4e88f4bdbb310a7dd1e794614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.721225 28654 consensus_queue.cc:1048] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.721540 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:05.723362 27700 consensus_peers.cc:597] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.724578 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.725790 20036 raft_consensus.cc:2243] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.726401 20036 raft_consensus.cc:2272] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.730031 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.730980 20036 raft_consensus.cc:2243] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.731645 20036 pending_rounds.cc:70] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Trying to abort 1 pending ops.
I20260709 13:10:05.731910 20036 pending_rounds.cc:77] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636270552481792 op_type: NO_OP noop_request { }
W20260709 13:10:05.732230 27700 consensus_peers.cc:597] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.732244 20036 raft_consensus.cc:2889] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:10:05.732878 27774 consensus_peers.cc:597] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.733165 20036 raft_consensus.cc:2272] T e9449fef1f664215b643cd9668147684 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.735976 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.736776 20036 raft_consensus.cc:2243] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.737222 20036 raft_consensus.cc:2272] T 64de87ddc64f488fb55c8bccc3999da4 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.739516 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.740232 20036 raft_consensus.cc:2243] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.740948 20036 raft_consensus.cc:2272] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.743659 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.744486 20036 raft_consensus.cc:2243] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.744968 20036 raft_consensus.cc:2272] T 6ec9b17465d14db4b8a89886a3edcdbc P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.745467 27774 consensus_peers.cc:597] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.747417 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.748114 20036 raft_consensus.cc:2243] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.748543 20036 raft_consensus.cc:2272] T d1479a6d10c54f62a309817459bcc2ac P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.751212 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.752187 20036 raft_consensus.cc:2243] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.753125 20036 raft_consensus.cc:2272] T 95b73701f47449cd96689924bfef1787 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.755900 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.756526 20036 raft_consensus.cc:2243] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.757133 20036 raft_consensus.cc:2272] T 55b4a78f3069431e8967dd06c5afb21c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.759989 20036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:05.760722 27774 consensus_peers.cc:597] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.760740 20036 raft_consensus.cc:2243] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.761406 20036 raft_consensus.cc:2272] T 0041555667e44a71a863bc5e56bc1745 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.763465 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.764062 20036 raft_consensus.cc:2243] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.764799 20036 raft_consensus.cc:2272] T 79d5ebd76b7743ee96caafce6e15dca9 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.766772 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.767391 20036 raft_consensus.cc:2243] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.767812 20036 raft_consensus.cc:2272] T 164e20e1bf464255aacb3064f916feed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.770172 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.770882 20036 raft_consensus.cc:2243] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.771446 20036 raft_consensus.cc:2272] T 5c3c90f12dc244b3b4d51189f757ae4f P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.773998 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.774613 20036 raft_consensus.cc:2243] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.775226 20036 raft_consensus.cc:2272] T 9207861786984e7bb6b269ce94521002 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.777954 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.778931 20036 raft_consensus.cc:2243] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:05.779103 27700 consensus_peers.cc:597] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.779805 20036 raft_consensus.cc:2272] T 73b4fe2dd2ab4ecfa2cafe055c364838 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.781668 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.782254 20036 raft_consensus.cc:2243] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.782924 20036 raft_consensus.cc:2272] T 76d0ccee8df74beb8c4eaa0ba1902c9e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.785568 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.786339 20036 raft_consensus.cc:2243] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.786799 20036 raft_consensus.cc:2272] T 7fe679a9b272470a9ca60d206c005339 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.788866 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.789691 20036 raft_consensus.cc:2243] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.790231 20036 raft_consensus.cc:2272] T cca597f9d49f4059aaa18be216089f24 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.790380 27626 consensus_peers.cc:597] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.792564 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.793197 20036 raft_consensus.cc:2243] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.793627 20036 raft_consensus.cc:2272] T 2f7f0319ebab41859ce19c8c53606ca5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.795820 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.796563 20036 raft_consensus.cc:2243] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.797204 20036 raft_consensus.cc:2272] T 37e5831f4db34d93ace2689b7db99cd1 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.799878 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.800659 20036 raft_consensus.cc:2243] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.801155 20036 raft_consensus.cc:2272] T 3c61d995a55841e7b383d1ab3091c2e5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.802685 27774 consensus_peers.cc:597] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.803562 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.804306 20036 raft_consensus.cc:2243] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.805194 20036 raft_consensus.cc:2272] T 3d4fec365128419699378d6468f59415 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.807799 20036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:05.807960 27774 consensus_peers.cc:597] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.808630 20036 raft_consensus.cc:2243] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.809610 20036 raft_consensus.cc:2272] T be10201ecf4e49fdb34aa543e5dcf264 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.810000 27700 consensus_peers.cc:597] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.810215 27626 consensus_peers.cc:597] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.812208 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.813017 20036 raft_consensus.cc:2243] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:05.813418 27700 consensus_peers.cc:597] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.813494 20036 raft_consensus.cc:2272] T 16478e1d305d4e6db2c2882fe655d75e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.816562 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.817091 20036 raft_consensus.cc:2243] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.817512 20036 raft_consensus.cc:2272] T 2197e7fe7d9d495e94faf67b9540e800 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.820243 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.820993 20036 raft_consensus.cc:2243] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.821503 20036 raft_consensus.cc:2272] T 8bba38370f374fe1b14351e6a8564476 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.823863 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.824424 20036 raft_consensus.cc:2243] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.825205 20036 raft_consensus.cc:2272] T f3e15fde3df7459bbee42a28a244ef86 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.827443 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.827975 20036 raft_consensus.cc:2243] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.828397 20036 raft_consensus.cc:2272] T eb0273d7867b40db9dc87335d36e6f95 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.830313 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.830930 20036 raft_consensus.cc:2243] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.831290 20036 raft_consensus.cc:2272] T d02f1c4f105748ee996718a3440d2691 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.833902 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.834612 20036 raft_consensus.cc:2243] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.835147 20036 raft_consensus.cc:2272] T 9f027427f56542cbacf08cba476c2e90 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.837651 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.838408 20036 raft_consensus.cc:2243] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.838920 20036 raft_consensus.cc:2272] T fceb102b02094b29b56578adb3b10bc5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.840040 27626 consensus_peers.cc:597] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.841404 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.842147 20036 raft_consensus.cc:2243] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.842604 20036 raft_consensus.cc:2272] T de5dcae52b444f76b89d1e20125f2a89 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.843832 27626 consensus_peers.cc:597] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.844799 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.845384 20036 raft_consensus.cc:2243] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.845763 20036 raft_consensus.cc:2272] T 19c47c6d89604d2d824d3ec0afaac896 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.847656 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.848160 20036 raft_consensus.cc:2243] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.848558 20036 raft_consensus.cc:2272] T e073b9352b144716a65159d5c779fde6 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.850492 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.850996 20036 raft_consensus.cc:2243] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.851409 20036 raft_consensus.cc:2272] T 663f4c3345b74fdbad7101785ed79efb P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.853220 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.853931 20036 raft_consensus.cc:2243] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.854477 20036 raft_consensus.cc:2272] T 7e34416a06254755bef0d2066e8e3416 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.857064 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.857653 20036 raft_consensus.cc:2243] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.858289 20036 raft_consensus.cc:2272] T 1ffdc09edd634205ab7d40c675eee062 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.860154 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.860594 20036 raft_consensus.cc:2243] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.861186 20036 raft_consensus.cc:2272] T 86957a4582b64f46b02b50bf5f5d4db0 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.863219 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.863703 20036 raft_consensus.cc:2243] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.864037 20036 raft_consensus.cc:2272] T d6b4d67651944d4c82892d46b4f4948c P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.866365 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.866858 20036 raft_consensus.cc:2243] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.867343 20036 raft_consensus.cc:2272] T 0e19a56e4af742289da53021053e2e16 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.868731 27626 consensus_peers.cc:597] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.869510 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.870105 20036 raft_consensus.cc:2243] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.870956 20036 raft_consensus.cc:2272] T 8f1eca5604bf471a859dd26aba03fc9d P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.873449 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.874037 20036 raft_consensus.cc:2243] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.874773 20036 raft_consensus.cc:2272] T 4eab03f165164c039475da5b90d445ed P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.877223 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.877867 20036 raft_consensus.cc:2243] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.878666 20036 raft_consensus.cc:2272] T 7b451f9357d24103a777c6e4c9a434b5 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.880563 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.881042 20036 raft_consensus.cc:2243] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.881464 20036 raft_consensus.cc:2272] T ce64c49f3477473ba51466f3775c419e P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.883401 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.883868 20036 raft_consensus.cc:2243] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.884269 20036 raft_consensus.cc:2272] T ad26bb1b44b8483385cd6155100e6fb3 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.886258 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:05.886765 20036 raft_consensus.cc:2243] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.887492 20036 raft_consensus.cc:2272] T 2b9686e9b98e4e07b6f193bb7b36a785 P a9a0c8d4e88f4bdbb310a7dd1e794614 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:05.937443 27626 consensus_peers.cc:597] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.939687 27774 consensus_peers.cc:597] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.957480 20036 tablet_server.cc:196] TabletServer@127.19.145.1:36015 shutdown complete.
W20260709 13:10:06.007091 27774 consensus_peers.cc:597] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.040208 27700 consensus_peers.cc:597] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.051028 27626 consensus_peers.cc:597] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.097158 27700 consensus_peers.cc:597] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.113940 27700 consensus_peers.cc:597] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.117561 27774 consensus_peers.cc:597] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.125696 27774 consensus_peers.cc:597] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.125856 27626 consensus_peers.cc:597] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.143757 27626 consensus_peers.cc:597] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.161417 27774 consensus_peers.cc:597] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.164260 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
W20260709 13:10:06.189306 27697 consensus_peers.cc:597] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.204769 27697 consensus_peers.cc:597] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.257146 27697 consensus_peers.cc:597] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.257488 27771 consensus_peers.cc:597] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.260758 27771 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.2:45745, user_credentials={real_user=slave}} blocked reactor thread for 47560.8us
W20260709 13:10:06.257828 27626 consensus_peers.cc:597] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.286996 27700 consensus_peers.cc:597] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.287667 27700 consensus_peers.cc:597] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.288219 27700 consensus_peers.cc:597] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 -> Peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Couldn't send request to peer a9a0c8d4e88f4bdbb310a7dd1e794614. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.354688 27697 consensus_peers.cc:597] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.355374 27697 consensus_peers.cc:597] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.357403 27697 consensus_peers.cc:597] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.360386 27697 consensus_peers.cc:597] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.350003 27771 consensus_peers.cc:597] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.377169 27771 consensus_peers.cc:597] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.380492 27771 consensus_peers.cc:597] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.381103 27771 consensus_peers.cc:597] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.391701 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.392469 20036 tablet_replica.cc:333] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.393683 20036 raft_consensus.cc:2243] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.394531 20036 raft_consensus.cc:2272] T 8bba38370f374fe1b14351e6a8564476 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.396613 27771 consensus_peers.cc:597] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.397624 20036 tablet_replica.cc:333] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.398430 20036 raft_consensus.cc:2243] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.398976 20036 raft_consensus.cc:2272] T 9207861786984e7bb6b269ce94521002 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.402230 20036 tablet_replica.cc:333] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.402979 20036 raft_consensus.cc:2243] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.403566 20036 raft_consensus.cc:2272] T 671844b3f7454ba090d35213702fd9bf P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.405856 20036 tablet_replica.cc:333] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.406565 20036 raft_consensus.cc:2243] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.407044 20036 raft_consensus.cc:2272] T de5dcae52b444f76b89d1e20125f2a89 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.410018 20036 tablet_replica.cc:333] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.410729 20036 raft_consensus.cc:2243] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.411890 20036 raft_consensus.cc:2272] T ffc7114823164fdf8ec82d57bfb6a56c P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.414309 20036 tablet_replica.cc:333] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.414958 20036 raft_consensus.cc:2243] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.415879 20036 raft_consensus.cc:2272] T 3d8977a3bcc74a06b26475b593096889 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.418215 20036 tablet_replica.cc:333] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.418982 20036 raft_consensus.cc:2243] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.419826 20036 raft_consensus.cc:2272] T 95b73701f47449cd96689924bfef1787 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.422873 20036 tablet_replica.cc:333] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.423599 20036 raft_consensus.cc:2243] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.424199 20036 raft_consensus.cc:2272] T 3b97b2b6ae80408999e7abedfeb241a9 P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.427204 20036 tablet_replica.cc:333] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.428097 20036 raft_consensus.cc:2243] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.428814 20036 raft_consensus.cc:2272] T 3d4fec365128419699378d6468f59415 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.428948 27697 consensus_peers.cc:597] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.432453 20036 tablet_replica.cc:333] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.433346 20036 raft_consensus.cc:2243] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.434361 20036 raft_consensus.cc:2272] T edbc1b203b2b4f0db422b3547ae75eb6 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.436856 20036 tablet_replica.cc:333] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.437469 20036 raft_consensus.cc:2243] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.438035 20036 raft_consensus.cc:2272] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.440302 20036 tablet_replica.cc:333] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.440975 20036 raft_consensus.cc:2243] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.441509 20036 raft_consensus.cc:2272] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.444041 20036 tablet_replica.cc:333] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.444587 20036 raft_consensus.cc:2243] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.445137 20036 raft_consensus.cc:2272] T 0041555667e44a71a863bc5e56bc1745 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.447474 20036 tablet_replica.cc:333] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.448025 20036 raft_consensus.cc:2243] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.448488 20036 raft_consensus.cc:2272] T 70d6cd1381e9461a906ad5194102295e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.450764 20036 tablet_replica.cc:333] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.451442 20036 raft_consensus.cc:2243] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.452028 20036 raft_consensus.cc:2272] T 7b451f9357d24103a777c6e4c9a434b5 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.454874 20036 tablet_replica.cc:333] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.455716 20036 raft_consensus.cc:2243] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.456386 20036 raft_consensus.cc:2272] T 2f7f0319ebab41859ce19c8c53606ca5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.456714 27697 consensus_peers.cc:597] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.458848 20036 tablet_replica.cc:333] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.459585 20036 raft_consensus.cc:2243] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.460489 20036 raft_consensus.cc:2272] T cca597f9d49f4059aaa18be216089f24 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.463143 20036 tablet_replica.cc:333] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.463900 20036 raft_consensus.cc:2243] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:06.464656 27771 consensus_peers.cc:597] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.464990 20036 raft_consensus.cc:2272] T d02f1c4f105748ee996718a3440d2691 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.467815 20036 tablet_replica.cc:333] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.468405 20036 raft_consensus.cc:2243] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.469007 20036 raft_consensus.cc:2272] T eb0273d7867b40db9dc87335d36e6f95 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.471360 20036 tablet_replica.cc:333] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.471819 20036 raft_consensus.cc:2243] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.472227 20036 raft_consensus.cc:2272] T 2b9686e9b98e4e07b6f193bb7b36a785 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.474943 20036 tablet_replica.cc:333] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.475600 20036 raft_consensus.cc:2243] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.476004 20036 raft_consensus.cc:2272] T ad26bb1b44b8483385cd6155100e6fb3 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.477842 20036 tablet_replica.cc:333] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.478374 20036 raft_consensus.cc:2243] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.479419 20036 raft_consensus.cc:2272] T fceb102b02094b29b56578adb3b10bc5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.482081 20036 tablet_replica.cc:333] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.482632 20036 raft_consensus.cc:2243] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.483539 20036 raft_consensus.cc:2272] T 9f027427f56542cbacf08cba476c2e90 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.486351 20036 tablet_replica.cc:333] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.486894 20036 raft_consensus.cc:2243] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.487619 20036 raft_consensus.cc:2272] T 4f070317853944f7a8c691ed18b301df P 387a99f68cd34b7c9e89550715e17135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.489404 20036 tablet_replica.cc:333] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.490060 20036 raft_consensus.cc:2243] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.490752 20036 raft_consensus.cc:2272] T ce64c49f3477473ba51466f3775c419e P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.493669 20036 tablet_replica.cc:333] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.494400 20036 raft_consensus.cc:2243] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.494951 20036 raft_consensus.cc:2272] T 6ec9b17465d14db4b8a89886a3edcdbc P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.497196 20036 tablet_replica.cc:333] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.497892 20036 raft_consensus.cc:2243] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.498399 20036 pending_rounds.cc:70] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Trying to abort 1 pending ops.
I20260709 13:10:06.498601 20036 pending_rounds.cc:77] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636270552481792 op_type: NO_OP noop_request { }
I20260709 13:10:06.499378 20036 raft_consensus.cc:2889] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.499712 20036 raft_consensus.cc:2272] T e9449fef1f664215b643cd9668147684 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.502175 20036 tablet_replica.cc:333] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.502707 20036 raft_consensus.cc:2243] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.503227 20036 raft_consensus.cc:2272] T ce31eb77bd604406be314032a8b76a81 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.505256 20036 tablet_replica.cc:333] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.505749 20036 raft_consensus.cc:2243] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.506698 20036 raft_consensus.cc:2272] T 3c61d995a55841e7b383d1ab3091c2e5 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.508946 20036 tablet_replica.cc:333] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.509445 20036 raft_consensus.cc:2243] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.509902 20036 raft_consensus.cc:2272] T 79d5ebd76b7743ee96caafce6e15dca9 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.511783 20036 tablet_replica.cc:333] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.512310 20036 raft_consensus.cc:2243] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.513046 20036 raft_consensus.cc:2272] T e073b9352b144716a65159d5c779fde6 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.514883 20036 tablet_replica.cc:333] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.515429 20036 raft_consensus.cc:2243] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.516139 20036 raft_consensus.cc:2272] T 19c47c6d89604d2d824d3ec0afaac896 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.518028 20036 tablet_replica.cc:333] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.518555 20036 raft_consensus.cc:2243] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.519007 20036 raft_consensus.cc:2272] T 7e977dcac25b40f9b4451a087f94be1a P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.521495 20036 tablet_replica.cc:333] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.522217 20036 raft_consensus.cc:2243] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.523293 20036 raft_consensus.cc:2272] T 86957a4582b64f46b02b50bf5f5d4db0 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.524073 27697 consensus_peers.cc:597] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.525805 20036 tablet_replica.cc:333] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.526468 20036 raft_consensus.cc:2243] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.527398 20036 raft_consensus.cc:2272] T fd6a60e8e2194989a741cc7cc098f122 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.529366 20036 tablet_replica.cc:333] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.529850 20036 raft_consensus.cc:2243] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.530228 20036 raft_consensus.cc:2272] T 1ffdc09edd634205ab7d40c675eee062 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.532092 20036 tablet_replica.cc:333] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.532529 20036 raft_consensus.cc:2243] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.533177 20036 raft_consensus.cc:2272] T 7fe679a9b272470a9ca60d206c005339 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.534940 20036 tablet_replica.cc:333] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.535492 20036 raft_consensus.cc:2243] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.536201 20036 raft_consensus.cc:2272] T dca18e3f1a9e486095c1f06ca4168709 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.537935 20036 tablet_replica.cc:333] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.538393 20036 raft_consensus.cc:2243] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.538735 20036 raft_consensus.cc:2272] T 7e34416a06254755bef0d2066e8e3416 P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.540568 20036 tablet_replica.cc:333] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.541031 20036 raft_consensus.cc:2243] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.541389 20036 raft_consensus.cc:2272] T 1f54782de6c64f439dcec5270aad77d2 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.543270 20036 tablet_replica.cc:333] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.543807 20036 raft_consensus.cc:2243] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.544361 20036 raft_consensus.cc:2272] T dde1218f4bbf48f7987c355961adb699 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.546839 20036 tablet_replica.cc:333] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.547406 20036 raft_consensus.cc:2243] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.548236 20036 raft_consensus.cc:2272] T d1479a6d10c54f62a309817459bcc2ac P 387a99f68cd34b7c9e89550715e17135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.550602 20036 tablet_replica.cc:333] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.551335 20036 raft_consensus.cc:2243] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:06.551708 27771 consensus_peers.cc:597] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.551904 20036 raft_consensus.cc:2272] T 23452fbc71a8440fa12d2eb0075c8e15 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.554478 20036 tablet_replica.cc:333] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135: stopping tablet replica
I20260709 13:10:06.554960 20036 raft_consensus.cc:2243] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.555414 20036 raft_consensus.cc:2272] T 0e19a56e4af742289da53021053e2e16 P 387a99f68cd34b7c9e89550715e17135 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.570188 27697 consensus_peers.cc:597] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.640519 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
W20260709 13:10:06.702189 27771 consensus_peers.cc:597] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Couldn't send request to peer 387a99f68cd34b7c9e89550715e17135. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.720800 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
W20260709 13:10:06.772848 27771 consensus_peers.cc:597] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.775244 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.776197 20036 tablet_replica.cc:333] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.777066 20036 raft_consensus.cc:2243] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.777606 20036 raft_consensus.cc:2272] T 55b4a78f3069431e8967dd06c5afb21c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.783799 20036 tablet_replica.cc:333] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.784540 20036 raft_consensus.cc:2243] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.785656 20036 raft_consensus.cc:2272] T de5dcae52b444f76b89d1e20125f2a89 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.788552 20036 tablet_replica.cc:333] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.789376 20036 raft_consensus.cc:2243] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.789923 20036 raft_consensus.cc:2272] T ffc7114823164fdf8ec82d57bfb6a56c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.796689 20036 tablet_replica.cc:333] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.797474 20036 raft_consensus.cc:2243] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.797993 20036 raft_consensus.cc:2272] T 164e20e1bf464255aacb3064f916feed P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.800593 20036 tablet_replica.cc:333] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.801326 20036 raft_consensus.cc:2243] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.802059 20036 raft_consensus.cc:2272] T 64de87ddc64f488fb55c8bccc3999da4 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.803961 20036 tablet_replica.cc:333] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.804519 20036 raft_consensus.cc:2243] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.804921 20036 raft_consensus.cc:2272] T 3d8977a3bcc74a06b26475b593096889 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.806785 20036 tablet_replica.cc:333] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.808161 28674 raft_consensus.cc:493] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.808723 28674 raft_consensus.cc:515] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } } peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } }
I20260709 13:10:06.810829 20036 raft_consensus.cc:2243] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.810925 28674 leader_election.cc:290] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:06.812013 20036 raft_consensus.cc:2272] T 3b97b2b6ae80408999e7abedfeb241a9 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.814695 20036 tablet_replica.cc:333] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.815547 20036 raft_consensus.cc:2243] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.816152 20036 raft_consensus.cc:2272] T 95b73701f47449cd96689924bfef1787 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.816203 27697 leader_election.cc:336] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111)
W20260709 13:10:06.816828 27700 leader_election.cc:336] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:10:06.817246 27700 leader_election.cc:304] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2685f76105504ec2ab35ae2893841d01; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:06.818204 28674 raft_consensus.cc:2749] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:06.818885 20036 tablet_replica.cc:333] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.819579 20036 raft_consensus.cc:2243] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.820323 20036 raft_consensus.cc:2272] T 2197e7fe7d9d495e94faf67b9540e800 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.822250 20036 tablet_replica.cc:333] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.822793 20036 raft_consensus.cc:2243] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.823573 20036 raft_consensus.cc:2272] T 8bba38370f374fe1b14351e6a8564476 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.825383 20036 tablet_replica.cc:333] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.825942 20036 raft_consensus.cc:2243] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.826342 20036 raft_consensus.cc:2272] T 16478e1d305d4e6db2c2882fe655d75e P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.828235 20036 tablet_replica.cc:333] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.828732 20036 raft_consensus.cc:2243] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.829119 20036 raft_consensus.cc:2272] T edbc1b203b2b4f0db422b3547ae75eb6 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.831070 20036 tablet_replica.cc:333] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.831610 20036 raft_consensus.cc:2243] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.832342 20036 raft_consensus.cc:2272] T 0041555667e44a71a863bc5e56bc1745 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.835175 20036 tablet_replica.cc:333] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.836001 20036 raft_consensus.cc:2243] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.836742 20036 raft_consensus.cc:2272] T 70d6cd1381e9461a906ad5194102295e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.839537 20036 tablet_replica.cc:333] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.840258 20036 raft_consensus.cc:2243] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.841120 20036 raft_consensus.cc:2272] T 5c3c90f12dc244b3b4d51189f757ae4f P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.843571 20036 tablet_replica.cc:333] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.844295 20036 raft_consensus.cc:2243] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.844786 20036 raft_consensus.cc:2272] T dde1218f4bbf48f7987c355961adb699 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.847573 20036 tablet_replica.cc:333] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.848237 20036 raft_consensus.cc:2243] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.848732 20036 raft_consensus.cc:2272] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.850674 20036 tablet_replica.cc:333] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.851490 20036 raft_consensus.cc:2243] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.852082 20036 raft_consensus.cc:2272] T 7b451f9357d24103a777c6e4c9a434b5 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.854796 20036 tablet_replica.cc:333] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.855530 20036 raft_consensus.cc:2243] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.856505 20036 raft_consensus.cc:2272] T 7e977dcac25b40f9b4451a087f94be1a P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.858330 20036 tablet_replica.cc:333] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.858837 20036 raft_consensus.cc:2243] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.859323 20036 raft_consensus.cc:2272] T 2b9686e9b98e4e07b6f193bb7b36a785 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.861636 20036 tablet_replica.cc:333] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.862315 20036 raft_consensus.cc:2243] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.863157 20036 raft_consensus.cc:2272] T ad26bb1b44b8483385cd6155100e6fb3 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.866601 20036 tablet_replica.cc:333] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.867349 20036 raft_consensus.cc:2243] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.868317 20036 raft_consensus.cc:2272] T 37e5831f4db34d93ace2689b7db99cd1 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.871047 20036 tablet_replica.cc:333] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.871801 20036 raft_consensus.cc:2243] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:06.872303 27771 consensus_peers.cc:597] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.872349 20036 raft_consensus.cc:2272] T d02f1c4f105748ee996718a3440d2691 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.874876 20036 tablet_replica.cc:333] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.875523 20036 raft_consensus.cc:2243] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.875958 20036 raft_consensus.cc:2272] T f3e15fde3df7459bbee42a28a244ef86 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.877799 20036 tablet_replica.cc:333] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.878340 20036 raft_consensus.cc:2243] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.879011 20036 raft_consensus.cc:2272] T d6b4d67651944d4c82892d46b4f4948c P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.880769 20036 tablet_replica.cc:333] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.881316 20036 raft_consensus.cc:2243] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.881733 20036 raft_consensus.cc:2272] T 4f070317853944f7a8c691ed18b301df P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.883541 20036 tablet_replica.cc:333] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.884047 20036 raft_consensus.cc:2243] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.884824 20036 raft_consensus.cc:2272] T ce64c49f3477473ba51466f3775c419e P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.886972 20036 tablet_replica.cc:333] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.887576 20036 raft_consensus.cc:2243] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.888321 20036 raft_consensus.cc:2272] T 6ec9b17465d14db4b8a89886a3edcdbc P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.890512 20036 tablet_replica.cc:333] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.891177 20036 raft_consensus.cc:2243] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.891734 20036 raft_consensus.cc:2272] T fd6a60e8e2194989a741cc7cc098f122 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.892532 27771 consensus_peers.cc:597] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.893863 20036 tablet_replica.cc:333] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.894477 20036 raft_consensus.cc:2243] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.895040 20036 raft_consensus.cc:2272] T 1ffdc09edd634205ab7d40c675eee062 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.894972 28681 raft_consensus.cc:493] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:06.895757 28681 raft_consensus.cc:515] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:06.898039 28681 leader_election.cc:290] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:06.898099 20036 tablet_replica.cc:333] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.899056 20036 raft_consensus.cc:2243] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.899660 20036 raft_consensus.cc:2272] T dca18e3f1a9e486095c1f06ca4168709 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.902287 20036 tablet_replica.cc:333] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.903007 20036 raft_consensus.cc:2243] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:06.902931 27774 leader_election.cc:336] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:10:06.903657 20036 raft_consensus.cc:2272] T 7fe679a9b272470a9ca60d206c005339 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.904182 27771 leader_election.cc:336] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111)
I20260709 13:10:06.904629 27771 leader_election.cc:304] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:06.905320 28681 raft_consensus.cc:2749] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:06.906344 20036 tablet_replica.cc:333] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.906914 20036 raft_consensus.cc:2243] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.907378 20036 raft_consensus.cc:2272] T 671844b3f7454ba090d35213702fd9bf P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.909868 20036 tablet_replica.cc:333] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.910404 20036 raft_consensus.cc:2243] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.910895 20036 raft_consensus.cc:2272] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.913353 20036 tablet_replica.cc:333] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.913944 20036 raft_consensus.cc:2243] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.914803 20036 raft_consensus.cc:2272] T ce31eb77bd604406be314032a8b76a81 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.916930 20036 tablet_replica.cc:333] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.917425 20036 raft_consensus.cc:2243] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.917835 20036 raft_consensus.cc:2272] T e9449fef1f664215b643cd9668147684 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.919813 20036 tablet_replica.cc:333] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.920508 20036 raft_consensus.cc:2243] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.920991 20036 raft_consensus.cc:2272] T 8f1eca5604bf471a859dd26aba03fc9d P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.922760 20036 tablet_replica.cc:333] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.923242 20036 raft_consensus.cc:2243] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.923756 20036 raft_consensus.cc:2272] T 23452fbc71a8440fa12d2eb0075c8e15 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.925619 20036 tablet_replica.cc:333] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.926009 28681 raft_consensus.cc:493] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:06.926288 20036 raft_consensus.cc:2243] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.926442 28681 raft_consensus.cc:515] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:06.927186 20036 raft_consensus.cc:2272] T 7e34416a06254755bef0d2066e8e3416 P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.928205 28681 leader_election.cc:290] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:10:06.929967 20036 tablet_replica.cc:333] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.930682 20036 raft_consensus.cc:2243] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:06.931005 27771 leader_election.cc:336] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:06.931195 20036 raft_consensus.cc:2272] T 663f4c3345b74fdbad7101785ed79efb P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.932045 27774 leader_election.cc:336] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:10:06.932417 27774 leader_election.cc:304] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:06.932961 28681 raft_consensus.cc:2749] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:06.933382 20036 tablet_replica.cc:333] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.933993 20036 raft_consensus.cc:2243] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.934712 20036 raft_consensus.cc:2272] T 1f54782de6c64f439dcec5270aad77d2 P 2685f76105504ec2ab35ae2893841d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.936582 20036 tablet_replica.cc:333] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.937052 20036 raft_consensus.cc:2243] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.937500 20036 raft_consensus.cc:2272] T be10201ecf4e49fdb34aa543e5dcf264 P 2685f76105504ec2ab35ae2893841d01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.939324 20036 tablet_replica.cc:333] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.939862 20036 raft_consensus.cc:2243] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.940258 20036 raft_consensus.cc:2272] T d1479a6d10c54f62a309817459bcc2ac P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.942022 20036 tablet_replica.cc:333] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01: stopping tablet replica
I20260709 13:10:06.942456 20036 raft_consensus.cc:2243] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.942888 20036 raft_consensus.cc:2272] T 4eab03f165164c039475da5b90d445ed P 2685f76105504ec2ab35ae2893841d01 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.966107 27771 consensus_peers.cc:597] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.986935 27771 consensus_peers.cc:597] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.020004 28681 raft_consensus.cc:493] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.020614 28681 raft_consensus.cc:515] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:07.022727 28681 leader_election.cc:290] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:10:07.026216 28681 raft_consensus.cc:493] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
W20260709 13:10:07.026417 27771 leader_election.cc:336] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111)
I20260709 13:10:07.026679 28681 raft_consensus.cc:515] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
W20260709 13:10:07.027236 27774 leader_election.cc:336] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:10:07.027664 27774 leader_election.cc:304] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.028322 28678 raft_consensus.cc:2749] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.029388 28681 leader_election.cc:290] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:10:07.032567 27774 leader_election.cc:336] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
W20260709 13:10:07.033133 27771 leader_election.cc:336] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111)
I20260709 13:10:07.033526 27771 leader_election.cc:304] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.034148 28681 raft_consensus.cc:2749] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:07.051607 27771 consensus_peers.cc:597] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.053395 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:10:07.070107 28681 raft_consensus.cc:493] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.070751 28681 raft_consensus.cc:515] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:07.070922 28678 raft_consensus.cc:493] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.071555 28678 raft_consensus.cc:515] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } } peers { permanent_uuid: "387a99f68cd34b7c9e89550715e17135" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 45745 } }
I20260709 13:10:07.072973 28681 leader_election.cc:290] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
I20260709 13:10:07.073879 28678 leader_election.cc:290] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015), 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745)
W20260709 13:10:07.077770 27774 leader_election.cc:336] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
W20260709 13:10:07.078310 27774 leader_election.cc:336] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
W20260709 13:10:07.078528 27771 leader_election.cc:336] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111)
I20260709 13:10:07.079061 27771 leader_election.cc:304] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.079810 28678 raft_consensus.cc:2749] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:07.079952 27771 leader_election.cc:336] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 387a99f68cd34b7c9e89550715e17135 (127.19.145.2:45745): Network error: Client connection negotiation failed: client connection to 127.19.145.2:45745: connect: Connection refused (error 111)
I20260709 13:10:07.080431 27771 leader_election.cc:304] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 387a99f68cd34b7c9e89550715e17135, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.081143 28678 raft_consensus.cc:2749] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:07.093771 27771 consensus_peers.cc:597] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:07.102929 27771 consensus_peers.cc:597] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.129431 20036 tablet_server.cc:179] TabletServer@127.19.145.4:0 shutting down...
I20260709 13:10:07.136165 28678 raft_consensus.cc:493] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.136689 28678 raft_consensus.cc:515] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:07.138510 28678 leader_election.cc:290] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:10:07.143975 27774 leader_election.cc:336] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
W20260709 13:10:07.145438 27771 leader_election.cc:336] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111)
I20260709 13:10:07.145867 27771 leader_election.cc:304] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.149935 28681 raft_consensus.cc:2749] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:07.161305 28678 raft_consensus.cc:493] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.161697 28678 raft_consensus.cc:515] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:07.163509 28678 leader_election.cc:290] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
W20260709 13:10:07.169363 27774 leader_election.cc:336] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
W20260709 13:10:07.176473 27771 leader_election.cc:336] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111)
I20260709 13:10:07.176873 27771 leader_election.cc:304] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.177834 28678 raft_consensus.cc:2749] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:07.191743 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:07.192067 27771 consensus_peers.cc:597] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.192654 20036 tablet_replica.cc:333] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
W20260709 13:10:07.192589 27771 consensus_peers.cc:597] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 -> Peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Couldn't send request to peer 2685f76105504ec2ab35ae2893841d01. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.193571 20036 raft_consensus.cc:2243] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.194413 20036 raft_consensus.cc:2272] T 55b4a78f3069431e8967dd06c5afb21c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.196328 20036 tablet_replica.cc:333] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.196887 20036 raft_consensus.cc:2243] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.197328 20036 raft_consensus.cc:2272] T 3d8977a3bcc74a06b26475b593096889 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.199126 20036 tablet_replica.cc:333] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.199657 20036 raft_consensus.cc:2243] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.200066 20036 raft_consensus.cc:2272] T ffc7114823164fdf8ec82d57bfb6a56c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.201884 20036 tablet_replica.cc:333] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.202693 20036 raft_consensus.cc:2243] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.203568 20036 raft_consensus.cc:2272] T 64de87ddc64f488fb55c8bccc3999da4 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.205410 20036 tablet_replica.cc:333] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.205914 20036 raft_consensus.cc:2243] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.206326 20036 raft_consensus.cc:2272] T 3b97b2b6ae80408999e7abedfeb241a9 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.208609 20036 tablet_replica.cc:333] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.209187 20036 raft_consensus.cc:2243] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.209734 20036 raft_consensus.cc:2272] T 3d4fec365128419699378d6468f59415 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.211694 20036 tablet_replica.cc:333] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.212255 20036 raft_consensus.cc:2243] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.212666 20036 raft_consensus.cc:2272] T 2197e7fe7d9d495e94faf67b9540e800 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.214478 20036 tablet_replica.cc:333] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.214995 20036 raft_consensus.cc:2243] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.215781 20036 raft_consensus.cc:2272] T 16478e1d305d4e6db2c2882fe655d75e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.217530 20036 tablet_replica.cc:333] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.218073 20036 raft_consensus.cc:2243] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.218461 20036 raft_consensus.cc:2272] T edbc1b203b2b4f0db422b3547ae75eb6 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.220279 20036 tablet_replica.cc:333] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.220808 20036 raft_consensus.cc:2243] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.221197 20036 raft_consensus.cc:2272] T 86957a4582b64f46b02b50bf5f5d4db0 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.222854 20036 tablet_replica.cc:333] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.223465 20036 raft_consensus.cc:2243] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.223865 20036 raft_consensus.cc:2272] T fd6a60e8e2194989a741cc7cc098f122 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.226094 20036 tablet_replica.cc:333] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.226634 20036 raft_consensus.cc:2243] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.227147 20036 raft_consensus.cc:2272] T 76d0ccee8df74beb8c4eaa0ba1902c9e P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.229524 20036 tablet_replica.cc:333] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.230228 20036 raft_consensus.cc:2243] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.231130 20036 raft_consensus.cc:2272] T 70d6cd1381e9461a906ad5194102295e P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.233266 20036 tablet_replica.cc:333] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.233841 20036 raft_consensus.cc:2243] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.234578 20036 raft_consensus.cc:2272] T 9207861786984e7bb6b269ce94521002 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.236563 20036 tablet_replica.cc:333] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.237074 20036 raft_consensus.cc:2243] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.237497 20036 raft_consensus.cc:2272] T 5c3c90f12dc244b3b4d51189f757ae4f P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.239202 20036 tablet_replica.cc:333] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.239769 20036 raft_consensus.cc:2243] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.240204 20036 raft_consensus.cc:2272] T 73b4fe2dd2ab4ecfa2cafe055c364838 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.241926 20036 tablet_replica.cc:333] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.242442 20036 raft_consensus.cc:2243] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.243207 20036 raft_consensus.cc:2272] T 2f7f0319ebab41859ce19c8c53606ca5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.245543 20036 tablet_replica.cc:333] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.246291 20036 raft_consensus.cc:2243] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.246862 20036 raft_consensus.cc:2272] T cca597f9d49f4059aaa18be216089f24 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.249320 20036 tablet_replica.cc:333] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.249774 20036 raft_consensus.cc:2243] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.250087 20036 raft_consensus.cc:2272] T fceb102b02094b29b56578adb3b10bc5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.251871 20036 tablet_replica.cc:333] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.252430 20036 raft_consensus.cc:2243] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.252830 20036 raft_consensus.cc:2272] T 9f027427f56542cbacf08cba476c2e90 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.254647 20036 tablet_replica.cc:333] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.255138 20036 raft_consensus.cc:2243] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.255924 20036 raft_consensus.cc:2272] T 4f070317853944f7a8c691ed18b301df P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.258441 20036 tablet_replica.cc:333] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.259161 20036 raft_consensus.cc:2243] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.259727 20036 raft_consensus.cc:2272] T e073b9352b144716a65159d5c779fde6 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.262365 20036 tablet_replica.cc:333] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.262877 20036 raft_consensus.cc:2243] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.263384 20036 raft_consensus.cc:2272] T 19c47c6d89604d2d824d3ec0afaac896 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.265553 20036 tablet_replica.cc:333] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.266381 20036 raft_consensus.cc:2243] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.266934 20036 raft_consensus.cc:2272] T 7e977dcac25b40f9b4451a087f94be1a P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.269068 20036 tablet_replica.cc:333] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.269732 20036 raft_consensus.cc:2243] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.270541 20036 raft_consensus.cc:2272] T eb0273d7867b40db9dc87335d36e6f95 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.271612 28678 raft_consensus.cc:493] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9a0c8d4e88f4bdbb310a7dd1e794614)
I20260709 13:10:07.272076 28678 raft_consensus.cc:515] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2685f76105504ec2ab35ae2893841d01" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 36259 } } peers { permanent_uuid: "6352477d8f544921a79fe2a8a4b84c91" member_type: VOTER last_known_addr { host: "127.19.145.4" port: 35273 } } peers { permanent_uuid: "a9a0c8d4e88f4bdbb310a7dd1e794614" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 36015 } }
I20260709 13:10:07.273244 20036 tablet_replica.cc:333] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.274098 20036 raft_consensus.cc:2243] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.274204 28678 leader_election.cc:290] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259), a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015)
I20260709 13:10:07.274735 20036 raft_consensus.cc:2272] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.277467 20036 tablet_replica.cc:333] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
W20260709 13:10:07.278012 27771 leader_election.cc:336] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2685f76105504ec2ab35ae2893841d01 (127.19.145.3:36259): Network error: Client connection negotiation failed: client connection to 127.19.145.3:36259: connect: Connection refused (error 111)
I20260709 13:10:07.278196 20036 raft_consensus.cc:2243] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:10:07.278789 27774 leader_election.cc:336] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9a0c8d4e88f4bdbb310a7dd1e794614 (127.19.145.1:36015): Network error: Client connection negotiation failed: client connection to 127.19.145.1:36015: connect: Connection refused (error 111)
I20260709 13:10:07.279124 27774 leader_election.cc:304] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6352477d8f544921a79fe2a8a4b84c91; no voters: 2685f76105504ec2ab35ae2893841d01, a9a0c8d4e88f4bdbb310a7dd1e794614
I20260709 13:10:07.279147 20036 raft_consensus.cc:2272] T a1ce1e8262b44f7d9d12d08e0c3fe1b5 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.279656 27774 raft_consensus.cc:2686] T f3e15fde3df7459bbee42a28a244ef86 P 6352477d8f544921a79fe2a8a4b84c91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:07.281198 20036 tablet_replica.cc:333] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.281786 20036 raft_consensus.cc:2243] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.282469 20036 raft_consensus.cc:2272] T dde1218f4bbf48f7987c355961adb699 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.284377 20036 tablet_replica.cc:333] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.284883 20036 raft_consensus.cc:2243] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.285266 20036 raft_consensus.cc:2272] T be10201ecf4e49fdb34aa543e5dcf264 P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.286983 20036 tablet_replica.cc:333] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.287547 20036 raft_consensus.cc:2243] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.287925 20036 raft_consensus.cc:2272] T 3c61d995a55841e7b383d1ab3091c2e5 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.289707 20036 tablet_replica.cc:333] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.290217 20036 raft_consensus.cc:2243] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.290616 20036 raft_consensus.cc:2272] T 37e5831f4db34d93ace2689b7db99cd1 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.292373 20036 tablet_replica.cc:333] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.292881 20036 raft_consensus.cc:2243] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.293282 20036 raft_consensus.cc:2272] T ce31eb77bd604406be314032a8b76a81 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.295163 20036 tablet_replica.cc:333] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.295758 20036 raft_consensus.cc:2243] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.296478 20036 raft_consensus.cc:2272] T 671844b3f7454ba090d35213702fd9bf P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.298275 20036 tablet_replica.cc:333] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.298780 20036 raft_consensus.cc:2243] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.299196 20036 raft_consensus.cc:2272] T b4b6a26fb8b24f0eb7d1a0c904eb6280 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.300905 20036 tablet_replica.cc:333] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.301397 20036 raft_consensus.cc:2243] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.301798 20036 raft_consensus.cc:2272] T d6b4d67651944d4c82892d46b4f4948c P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.303515 20036 tablet_replica.cc:333] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.303997 20036 raft_consensus.cc:2243] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.304685 20036 raft_consensus.cc:2272] T 0e19a56e4af742289da53021053e2e16 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.306433 20036 tablet_replica.cc:333] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.306926 20036 raft_consensus.cc:2243] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.307399 20036 raft_consensus.cc:2272] T 8f1eca5604bf471a859dd26aba03fc9d P 6352477d8f544921a79fe2a8a4b84c91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.309098 20036 tablet_replica.cc:333] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.309585 20036 raft_consensus.cc:2243] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.310295 20036 raft_consensus.cc:2272] T 23452fbc71a8440fa12d2eb0075c8e15 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.311993 20036 tablet_replica.cc:333] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.312469 20036 raft_consensus.cc:2243] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.313165 20036 raft_consensus.cc:2272] T 164e20e1bf464255aacb3064f916feed P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.315040 20036 tablet_replica.cc:333] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.315591 20036 raft_consensus.cc:2243] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.316007 20036 raft_consensus.cc:2272] T 79d5ebd76b7743ee96caafce6e15dca9 P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.317873 20036 tablet_replica.cc:333] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.318359 20036 raft_consensus.cc:2243] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.318813 20036 raft_consensus.cc:2272] T 4eab03f165164c039475da5b90d445ed P 6352477d8f544921a79fe2a8a4b84c91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.320609 20036 tablet_replica.cc:333] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.321080 20036 raft_consensus.cc:2243] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.321516 20036 raft_consensus.cc:2272] T dca18e3f1a9e486095c1f06ca4168709 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.323431 20036 tablet_replica.cc:333] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.323896 20036 raft_consensus.cc:2243] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.324630 20036 raft_consensus.cc:2272] T 663f4c3345b74fdbad7101785ed79efb P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.326491 20036 tablet_replica.cc:333] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91: stopping tablet replica
I20260709 13:10:07.326946 20036 raft_consensus.cc:2243] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.327383 20036 raft_consensus.cc:2272] T 1f54782de6c64f439dcec5270aad77d2 P 6352477d8f544921a79fe2a8a4b84c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.394405 20036 tablet_server.cc:196] TabletServer@127.19.145.4:0 shutdown complete.
I20260709 13:10:07.453949 20036 master.cc:562] Master@127.19.145.62:41169 shutting down...
W20260709 13:10:07.483382 27530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:10:07.484449 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.485018 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.485344 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 380adda4de534ee386f37dcd0bf89ab3: stopping tablet replica
I20260709 13:10:07.506681 20036 master.cc:584] Master@127.19.145.62:41169 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28792 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:07.592252 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:38891
I20260709 13:10:07.593365 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.599095 28689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.599682 28692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.599092 28690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.600512 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:07.601575 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.601768 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.601929 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602607601894 us; error 0 us; skew 500 ppm
I20260709 13:10:07.602460 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.604677 20036 webserver.cc:533] Webserver started at http://127.19.145.62:34371/ using document root <none> and password file <none>
I20260709 13:10:07.605145 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.605333 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.605602 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.606784 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "55e0aa5e978745bfab5b5562659301ae"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.610833 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:10:07.614046 28697 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.614718 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:07.614996 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "55e0aa5e978745bfab5b5562659301ae"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.615244 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.635344 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.636492 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.673255 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:38891
I20260709 13:10:07.673363 28748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:38891 every 8 connection(s)
I20260709 13:10:07.677057 28749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.687083 28749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae: Bootstrap starting.
I20260709 13:10:07.692109 28749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.696085 28749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae: No bootstrap required, opened a new log
I20260709 13:10:07.698093 28749 raft_consensus.cc:359] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER }
I20260709 13:10:07.698441 28749 raft_consensus.cc:385] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.698613 28749 raft_consensus.cc:740] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55e0aa5e978745bfab5b5562659301ae, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.699190 28749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER }
I20260709 13:10:07.699621 28749 raft_consensus.cc:399] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:07.699811 28749 raft_consensus.cc:493] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:07.700016 28749 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.704106 28749 raft_consensus.cc:515] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER }
I20260709 13:10:07.704530 28749 leader_election.cc:304] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55e0aa5e978745bfab5b5562659301ae; no voters: 
I20260709 13:10:07.705542 28749 leader_election.cc:290] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:07.705853 28752 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.707154 28752 raft_consensus.cc:697] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 1 LEADER]: Becoming Leader. State: Replica: 55e0aa5e978745bfab5b5562659301ae, State: Running, Role: LEADER
I20260709 13:10:07.707876 28752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER }
I20260709 13:10:07.708467 28749 sys_catalog.cc:565] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:07.712153 28753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55e0aa5e978745bfab5b5562659301ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER } }
I20260709 13:10:07.712847 28753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.712736 28754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55e0aa5e978745bfab5b5562659301ae. Latest consensus state: current_term: 1 leader_uuid: "55e0aa5e978745bfab5b5562659301ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e0aa5e978745bfab5b5562659301ae" member_type: VOTER } }
I20260709 13:10:07.713847 28754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.717730 28759 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:07.722594 28759 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:07.724742 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:07.731015 28759 catalog_manager.cc:1383] Generated new cluster ID: 7d96e11505604e7fbf3827648d9eadd0
I20260709 13:10:07.731225 28759 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:07.744161 28759 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:07.745311 28759 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:07.762566 28759 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae: Generated new TSK 0
I20260709 13:10:07.763053 28759 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:07.790648 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.796267 28770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.797236 28771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.798957 20036 server_base.cc:1061] running on GCE node
W20260709 13:10:07.799314 28773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.800187 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.800397 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.800575 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602607800540 us; error 0 us; skew 500 ppm
I20260709 13:10:07.801090 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.803167 20036 webserver.cc:533] Webserver started at http://127.19.145.1:38223/ using document root <none> and password file <none>
I20260709 13:10:07.803757 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.803947 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.804231 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.805260 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "ecf64565ad324ea4809f272e369a50c8"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.809442 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:07.812463 28778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.813158 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:07.813449 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "ecf64565ad324ea4809f272e369a50c8"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.813717 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.833051 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.834233 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.835625 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.837797 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.837970 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.838258 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.838434 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.877811 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:44175
I20260709 13:10:07.877898 28840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:44175 every 8 connection(s)
I20260709 13:10:07.882611 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.889765 28845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.892427 28846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.894443 28848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.894852 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:07.896417 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.896600 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.896835 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602607896815 us; error 0 us; skew 500 ppm
I20260709 13:10:07.897539 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.899161 28841 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38891
I20260709 13:10:07.899570 28841 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.900265 28841 heartbeater.cc:507] Master 127.19.145.62:38891 requested a full tablet report, sending...
I20260709 13:10:07.900524 20036 webserver.cc:533] Webserver started at http://127.19.145.2:34311/ using document root <none> and password file <none>
I20260709 13:10:07.901103 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.901324 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.901618 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.902287 28714 ts_manager.cc:194] Registered new tserver with Master: ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:07.902751 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "582d72f16d584d22bfb77e365642221f"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.904129 28714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33984
I20260709 13:10:07.907475 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:07.911026 28853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.911809 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:07.912123 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "582d72f16d584d22bfb77e365642221f"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:07.912407 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.959338 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.960520 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.961930 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.964133 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.964354 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.964588 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.964752 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.002540 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:39401
I20260709 13:10:08.002646 28915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:39401 every 8 connection(s)
I20260709 13:10:08.007372 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.014178 28919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.015827 28920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.018117 28922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.020035 28916 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38891
I20260709 13:10:08.020515 28916 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.020970 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:08.021443 28916 heartbeater.cc:507] Master 127.19.145.62:38891 requested a full tablet report, sending...
I20260709 13:10:08.021872 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.022123 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.022296 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602608022262 us; error 0 us; skew 500 ppm
I20260709 13:10:08.023034 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.023625 28714 ts_manager.cc:194] Registered new tserver with Master: 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:08.024951 28714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34000
I20260709 13:10:08.027011 20036 webserver.cc:533] Webserver started at http://127.19.145.3:33547/ using document root <none> and password file <none>
I20260709 13:10:08.027611 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.027822 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.028090 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.029183 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "5ed7024ca4694ad9952d68576ec613b8"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-cd6k"
I20260709 13:10:08.033370 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:08.036466 28927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.037120 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:08.037405 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "5ed7024ca4694ad9952d68576ec613b8"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-cd6k"
I20260709 13:10:08.037690 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.059528 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.060688 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.062100 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.064150 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.064368 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.064618 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.064790 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.104013 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:37251
I20260709 13:10:08.104167 28989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:37251 every 8 connection(s)
I20260709 13:10:08.117894 28990 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38891
I20260709 13:10:08.118292 28990 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.118906 28990 heartbeater.cc:507] Master 127.19.145.62:38891 requested a full tablet report, sending...
I20260709 13:10:08.120995 28714 ts_manager.cc:194] Registered new tserver with Master: 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.121541 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014403757s
I20260709 13:10:08.122273 28714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34014
I20260709 13:10:08.145072 28714 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34020:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:08.147996 28714 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:08.214812 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2973566cf84a59a9ace6f74047bfff (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.217204 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2973566cf84a59a9ace6f74047bfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.214769 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 72c371c3b7f447069b6d53be7b91c342 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.218685 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c371c3b7f447069b6d53be7b91c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.214529 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1abb0f2a704e39abfea8f477a95c50 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.220180 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1abb0f2a704e39abfea8f477a95c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.225934 28952 tablet_service.cc:1511] Processing CreateTablet for tablet c680901e3ed547a2a68369d871d43291 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.228060 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680901e3ed547a2a68369d871d43291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.241250 28881 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1abb0f2a704e39abfea8f477a95c50 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.242653 28881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1abb0f2a704e39abfea8f477a95c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.244333 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.245779 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.253135 28950 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.255012 28950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.256851 28880 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2973566cf84a59a9ace6f74047bfff (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.258184 28880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2973566cf84a59a9ace6f74047bfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.271212 28879 tablet_service.cc:1511] Processing CreateTablet for tablet 72c371c3b7f447069b6d53be7b91c342 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.272603 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c371c3b7f447069b6d53be7b91c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.276459 28878 tablet_service.cc:1511] Processing CreateTablet for tablet c680901e3ed547a2a68369d871d43291 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.277040 28949 tablet_service.cc:1511] Processing CreateTablet for tablet 13068279708745ebb4d82c60413e1017 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.277868 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680901e3ed547a2a68369d871d43291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.278350 28949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13068279708745ebb4d82c60413e1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.280421 28876 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.281776 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.284549 28874 tablet_service.cc:1511] Processing CreateTablet for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.285857 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.287709 28803 tablet_service.cc:1511] Processing CreateTablet for tablet c680901e3ed547a2a68369d871d43291 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.288390 28877 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.289371 28803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680901e3ed547a2a68369d871d43291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.289697 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.295524 28806 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1abb0f2a704e39abfea8f477a95c50 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.295992 28804 tablet_service.cc:1511] Processing CreateTablet for tablet 72c371c3b7f447069b6d53be7b91c342 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.296878 28806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1abb0f2a704e39abfea8f477a95c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.297524 28804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c371c3b7f447069b6d53be7b91c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.297816 28802 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.299103 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7c9e120d5f4d5e80e1a47e16f6eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.299692 28801 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.300993 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1515b16fe4e90a2e6641cf79e1f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.301704 28873 tablet_service.cc:1511] Processing CreateTablet for tablet 0563dbb53e1843f4b87286b2b519a22d (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.303010 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0563dbb53e1843f4b87286b2b519a22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.304034 28800 tablet_service.cc:1511] Processing CreateTablet for tablet 13068279708745ebb4d82c60413e1017 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.305317 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13068279708745ebb4d82c60413e1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.304034 28805 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2973566cf84a59a9ace6f74047bfff (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.309376 28805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2973566cf84a59a9ace6f74047bfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.295709 28875 tablet_service.cc:1511] Processing CreateTablet for tablet 13068279708745ebb4d82c60413e1017 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.314610 28798 tablet_service.cc:1511] Processing CreateTablet for tablet 0563dbb53e1843f4b87286b2b519a22d (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.316773 28799 tablet_service.cc:1511] Processing CreateTablet for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.319556 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13068279708745ebb4d82c60413e1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.324810 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0563dbb53e1843f4b87286b2b519a22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.327687 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.332790 28950 tablet_service.cc:1511] Processing CreateTablet for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44 (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.334151 28950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f8e0b6b3ea493ba9cabbb0d34ecd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.344725 29006 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.352718 29005 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.375463 28950 tablet_service.cc:1511] Processing CreateTablet for tablet 0563dbb53e1843f4b87286b2b519a22d (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.382119 29007 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.390413 28950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0563dbb53e1843f4b87286b2b519a22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.386945 28799 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3a147c734e2ca746e552213ed14f (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.390625 28951 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3a147c734e2ca746e552213ed14f (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.398027 28880 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3a147c734e2ca746e552213ed14f (DEFAULT_TABLE table=test-workload [id=41c11f1596484f3dbc86f35a071c3d68]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.404902 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3a147c734e2ca746e552213ed14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.406242 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3a147c734e2ca746e552213ed14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.407099 29005 tablet_bootstrap.cc:654] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.411381 29006 tablet_bootstrap.cc:654] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.416427 28880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3a147c734e2ca746e552213ed14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.431747 29007 tablet_bootstrap.cc:654] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.444439 29006 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.444974 29006 ts_tablet_manager.cc:1403] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.025s
I20260709 13:10:08.445068 29005 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.445581 29005 ts_tablet_manager.cc:1403] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.015s
I20260709 13:10:08.450383 29005 raft_consensus.cc:359] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.451468 29005 raft_consensus.cc:385] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.451905 29005 raft_consensus.cc:740] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.453198 29005 consensus_queue.cc:260] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.457026 29006 raft_consensus.cc:359] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.458402 28990 heartbeater.cc:499] Master 127.19.145.62:38891 was elected leader, sending a full tablet report...
I20260709 13:10:08.458608 29007 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.457948 29006 raft_consensus.cc:385] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.458848 29005 ts_tablet_manager.cc:1434] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:10:08.459213 29007 ts_tablet_manager.cc:1403] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.003s
I20260709 13:10:08.459158 29006 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.460161 29006 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.463045 29005 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.462486 29007 raft_consensus.cc:359] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.463596 29007 raft_consensus.cc:385] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.463984 29007 raft_consensus.cc:740] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.464910 29007 consensus_queue.cc:260] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.469530 29005 tablet_bootstrap.cc:654] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.473562 28916 heartbeater.cc:499] Master 127.19.145.62:38891 was elected leader, sending a full tablet report...
I20260709 13:10:08.474586 29006 ts_tablet_manager.cc:1434] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.012s
I20260709 13:10:08.475837 29006 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.478529 29005 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.479029 29005 ts_tablet_manager.cc:1403] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.009s
I20260709 13:10:08.482034 29005 raft_consensus.cc:359] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.482717 29005 raft_consensus.cc:385] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.483024 29005 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.484033 29005 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.484989 29006 tablet_bootstrap.cc:654] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.486425 29005 ts_tablet_manager.cc:1434] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:08.487452 29005 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.493682 29005 tablet_bootstrap.cc:654] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.503611 29012 raft_consensus.cc:493] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.504186 29012 raft_consensus.cc:515] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.510314 29012 leader_election.cc:290] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251), ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:08.528373 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
W20260709 13:10:08.530316 28857 leader_election.cc:343] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.532692 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
W20260709 13:10:08.534353 28854 leader_election.cc:343] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.534772 28854 leader_election.cc:304] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 582d72f16d584d22bfb77e365642221f; no voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:08.535109 29005 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.535578 29012 raft_consensus.cc:2749] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.536374 29005 ts_tablet_manager.cc:1403] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.009s
I20260709 13:10:08.538573 29007 ts_tablet_manager.cc:1434] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.079s	user 0.033s	sys 0.040s
I20260709 13:10:08.539543 29005 raft_consensus.cc:359] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.540292 29005 raft_consensus.cc:385] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.540591 29005 raft_consensus.cc:740] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.540645 28841 heartbeater.cc:499] Master 127.19.145.62:38891 was elected leader, sending a full tablet report...
I20260709 13:10:08.541397 29005 consensus_queue.cc:260] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.542476 29006 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.542949 29006 ts_tablet_manager.cc:1403] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.067s	user 0.031s	sys 0.032s
I20260709 13:10:08.543877 29005 ts_tablet_manager.cc:1434] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:08.544863 29005 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.545794 29006 raft_consensus.cc:359] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.546514 29006 raft_consensus.cc:385] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.546802 29006 raft_consensus.cc:740] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.547034 29007 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.547559 29006 consensus_queue.cc:260] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.549757 29006 ts_tablet_manager.cc:1434] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:08.550800 29006 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.552652 29005 tablet_bootstrap.cc:654] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.554271 29007 tablet_bootstrap.cc:654] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.557134 29006 tablet_bootstrap.cc:654] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.572480 29011 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.573060 29011 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.575675 29011 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:08.591708 29007 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.591915 29006 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.592330 29007 ts_tablet_manager.cc:1403] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.026s
I20260709 13:10:08.592538 29006 ts_tablet_manager.cc:1403] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.023s
I20260709 13:10:08.594355 29005 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.596501 29005 ts_tablet_manager.cc:1403] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.007s
I20260709 13:10:08.596032 29006 raft_consensus.cc:359] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.597492 29006 raft_consensus.cc:385] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.597856 29006 raft_consensus.cc:740] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.595420 29007 raft_consensus.cc:359] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.598766 29006 consensus_queue.cc:260] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.599578 29007 raft_consensus.cc:385] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.599938 29007 raft_consensus.cc:740] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.600589 29007 consensus_queue.cc:260] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.601091 29005 raft_consensus.cc:359] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.601753 29006 ts_tablet_manager.cc:1434] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:08.602001 29005 raft_consensus.cc:385] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.602387 29005 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.602692 29007 ts_tablet_manager.cc:1434] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:08.603051 29006 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.603165 29005 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.605800 29005 ts_tablet_manager.cc:1434] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:08.606557 29007 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.606895 29005 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.609135 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.611889 29006 tablet_bootstrap.cc:654] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.613157 29005 tablet_bootstrap.cc:654] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.613309 29007 tablet_bootstrap.cc:654] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:08.615876 28931 leader_election.cc:343] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.617481 29011 raft_consensus.cc:493] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.619321 29011 raft_consensus.cc:515] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.621840 29011 leader_election.cc:290] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:08.623682 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
W20260709 13:10:08.625622 28931 leader_election.cc:343] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.626403 29005 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.626967 29005 ts_tablet_manager.cc:1403] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:10:08.627553 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.628322 29006 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.628839 29006 ts_tablet_manager.cc:1403] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:10:08.629689 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.630370 29005 raft_consensus.cc:359] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.631157 29005 raft_consensus.cc:385] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.631546 29005 raft_consensus.cc:740] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.631650 29006 raft_consensus.cc:359] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.632364 29006 raft_consensus.cc:385] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.632577 29005 consensus_queue.cc:260] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.634699 29005 ts_tablet_manager.cc:1434] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:08.635682 29005 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.636600 29007 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.637089 29007 ts_tablet_manager.cc:1403] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
W20260709 13:10:08.638820 28931 leader_election.cc:343] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.639295 28931 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8; no voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:08.632676 29006 raft_consensus.cc:740] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.640098 29011 raft_consensus.cc:2749] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:08.640472 28931 leader_election.cc:343] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.640331 29006 consensus_queue.cc:260] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.640630 29007 raft_consensus.cc:359] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.640941 28931 leader_election.cc:304] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8; no voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:08.641382 29007 raft_consensus.cc:385] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.641685 29007 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.641692 29011 raft_consensus.cc:2749] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.642568 29006 ts_tablet_manager.cc:1434] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:08.642508 29007 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.643687 29006 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.644773 29007 ts_tablet_manager.cc:1434] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:10:08.645718 29007 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.651859 29007 tablet_bootstrap.cc:654] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.653000 29005 tablet_bootstrap.cc:654] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.655496 29006 tablet_bootstrap.cc:654] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.659929 29005 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.660382 29005 ts_tablet_manager.cc:1403] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 13:10:08.660413 29007 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.661087 29007 ts_tablet_manager.cc:1403] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:10:08.662755 29006 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.663291 29006 ts_tablet_manager.cc:1403] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.006s
I20260709 13:10:08.662912 29005 raft_consensus.cc:359] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.663743 29005 raft_consensus.cc:385] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.664024 29005 raft_consensus.cc:740] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.663867 29007 raft_consensus.cc:359] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.664710 29007 raft_consensus.cc:385] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.665076 29007 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.664770 29005 consensus_queue.cc:260] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.665853 29007 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.666199 29006 raft_consensus.cc:359] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.666906 29006 raft_consensus.cc:385] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.667191 29006 raft_consensus.cc:740] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.667371 29005 ts_tablet_manager.cc:1434] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:08.667948 29006 consensus_queue.cc:260] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.669849 29007 ts_tablet_manager.cc:1434] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:10:08.668393 29005 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.670862 29007 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.672111 29006 ts_tablet_manager.cc:1434] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:08.673115 29006 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.677515 29005 tablet_bootstrap.cc:654] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.678656 29007 tablet_bootstrap.cc:654] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.679425 29006 tablet_bootstrap.cc:654] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.683090 29011 raft_consensus.cc:493] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.683598 29011 raft_consensus.cc:515] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.685560 29011 leader_election.cc:290] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:08.693864 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.694319 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
W20260709 13:10:08.695716 28931 leader_election.cc:343] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:08.696724 28931 leader_election.cc:343] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.697149 28931 leader_election.cc:304] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8; no voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:08.698155 29011 raft_consensus.cc:2749] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.700590 29005 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.701093 29005 ts_tablet_manager.cc:1403] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:10:08.703190 29005 raft_consensus.cc:359] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.703933 29005 raft_consensus.cc:385] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.704236 29005 raft_consensus.cc:740] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.705029 29005 consensus_queue.cc:260] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.706060 29007 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.706339 29006 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.706590 29007 ts_tablet_manager.cc:1403] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.010s
I20260709 13:10:08.706820 29006 ts_tablet_manager.cc:1403] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.011s
I20260709 13:10:08.707064 29005 ts_tablet_manager.cc:1434] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:10:08.708178 29005 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.709589 29007 raft_consensus.cc:359] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.710355 29007 raft_consensus.cc:385] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.710640 29007 raft_consensus.cc:740] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.711423 29007 consensus_queue.cc:260] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.713765 29007 ts_tablet_manager.cc:1434] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:08.713389 29006 raft_consensus.cc:359] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.714213 29006 raft_consensus.cc:385] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.714527 29006 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.714805 29007 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.715363 29006 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.718931 29005 tablet_bootstrap.cc:654] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.720112 29006 ts_tablet_manager.cc:1434] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:10:08.721179 29006 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
W20260709 13:10:08.722128 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:08.722204 29007 tablet_bootstrap.cc:654] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.728305 29006 tablet_bootstrap.cc:654] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.732805 29005 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.733253 29005 ts_tablet_manager.cc:1403] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 13:10:08.734293 29007 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.734995 29007 ts_tablet_manager.cc:1403] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:10:08.735212 29005 raft_consensus.cc:359] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.735847 29005 raft_consensus.cc:385] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.736065 29005 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.736673 29005 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.738499 29005 ts_tablet_manager.cc:1434] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:08.738574 29007 raft_consensus.cc:359] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.739364 29007 raft_consensus.cc:385] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.739596 29005 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.739655 29007 raft_consensus.cc:740] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.740087 29006 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.740586 29006 ts_tablet_manager.cc:1403] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:10:08.740790 29007 consensus_queue.cc:260] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.743414 29013 raft_consensus.cc:493] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.743486 29006 raft_consensus.cc:359] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.743896 29013 raft_consensus.cc:515] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.744270 29006 raft_consensus.cc:385] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.744700 29006 raft_consensus.cc:740] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.745705 29005 tablet_bootstrap.cc:654] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.745568 29006 consensus_queue.cc:260] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.745980 29007 ts_tablet_manager.cc:1434] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:08.747064 29007 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.748092 29006 ts_tablet_manager.cc:1434] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:08.749091 29006 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.753253 29007 tablet_bootstrap.cc:654] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.755345 29006 tablet_bootstrap.cc:654] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.758817 29013 leader_election.cc:290] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.768585 29007 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.768642 29006 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.769237 29006 ts_tablet_manager.cc:1403] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:10:08.769243 29007 ts_tablet_manager.cc:1403] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:10:08.772152 29006 raft_consensus.cc:359] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.772845 29006 raft_consensus.cc:385] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.772552 29007 raft_consensus.cc:359] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.773123 29006 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.773299 29007 raft_consensus.cc:385] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.773626 29007 raft_consensus.cc:740] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.773983 29006 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.774309 29007 consensus_queue.cc:260] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.776245 29006 ts_tablet_manager.cc:1434] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:08.776648 29007 ts_tablet_manager.cc:1434] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:10:08.777472 29006 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.777508 29007 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:08.779388 29011 raft_consensus.cc:493] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.780031 29011 raft_consensus.cc:515] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.782588 29011 leader_election.cc:290] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:08.783707 29006 tablet_bootstrap.cc:654] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.783970 29007 tablet_bootstrap.cc:654] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.787834 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.788003 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.788735 28891 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 0.
I20260709 13:10:08.788892 28816 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 0.
I20260709 13:10:08.789999 29013 raft_consensus.cc:493] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.790696 28931 leader_election.cc:304] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:08.790639 29013 raft_consensus.cc:515] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.793136 29013 leader_election.cc:290] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.794539 29011 raft_consensus.cc:2804] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.794634 29006 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.795150 29011 raft_consensus.cc:493] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.795553 29006 ts_tablet_manager.cc:1403] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:10:08.795717 29011 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.799139 29006 raft_consensus.cc:359] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.800045 29006 raft_consensus.cc:385] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.800392 29006 raft_consensus.cc:740] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.801409 29006 consensus_queue.cc:260] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.804436 29006 ts_tablet_manager.cc:1434] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:08.805600 29006 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: Bootstrap starting.
I20260709 13:10:08.812809 29006 tablet_bootstrap.cc:654] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.825511 29006 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: No bootstrap required, opened a new log
I20260709 13:10:08.826124 29006 ts_tablet_manager.cc:1403] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:10:08.828369 29012 raft_consensus.cc:493] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.829073 29012 raft_consensus.cc:515] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.833271 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.834154 28965 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.835790 28854 leader_election.cc:304] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:08.838670 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.839624 28816 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.841589 29012 leader_election.cc:290] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.842262 29012 raft_consensus.cc:2804] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.842738 29012 raft_consensus.cc:493] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.843161 29012 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.852816 29006 raft_consensus.cc:359] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.853869 29006 raft_consensus.cc:385] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.854229 29006 raft_consensus.cc:740] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.865775 29011 raft_consensus.cc:515] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.867755 29006 consensus_queue.cc:260] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.870599 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:08.871454 28891 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.894622 29042 raft_consensus.cc:493] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.895390 29042 raft_consensus.cc:515] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.899094 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.899987 28816 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.901356 28857 leader_election.cc:304] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:08.870582 29006 ts_tablet_manager.cc:1434] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:10:08.903158 28891 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 1.
I20260709 13:10:08.903954 29012 raft_consensus.cc:515] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.905035 29007 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:08.905426 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.905684 29007 ts_tablet_manager.cc:1403] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.128s	user 0.051s	sys 0.063s
I20260709 13:10:08.906311 28890 raft_consensus.cc:2393] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecf64565ad324ea4809f272e369a50c8 in current term 1: Already voted for candidate 582d72f16d584d22bfb77e365642221f in this term.
I20260709 13:10:08.907119 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:08.908788 28965 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.909770 29042 leader_election.cc:290] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.910353 29042 raft_consensus.cc:493] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.910517 28964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.910830 29042 raft_consensus.cc:515] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.911202 28964 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.912402 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.913067 28963 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 0.
I20260709 13:10:08.913290 29012 leader_election.cc:290] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.913920 29012 raft_consensus.cc:2804] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.914278 29012 raft_consensus.cc:493] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.914348 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.914695 29012 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.915900 29042 leader_election.cc:290] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.916527 29005 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.917128 29005 ts_tablet_manager.cc:1403] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.178s	user 0.070s	sys 0.088s
I20260709 13:10:08.918936 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.923453 29011 leader_election.cc:290] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 election: Requested vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:08.923625 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.924014 29011 raft_consensus.cc:493] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.924445 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:08.924619 29005 raft_consensus.cc:359] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.924813 28779 leader_election.cc:304] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
W20260709 13:10:08.924990 28854 leader_election.cc:343] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.925036 28816 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.925884 29011 raft_consensus.cc:515] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.926082 28779 leader_election.cc:304] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecf64565ad324ea4809f272e369a50c8; no voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:08.925262 29005 raft_consensus.cc:385] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.927177 29005 raft_consensus.cc:740] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.928072 29005 consensus_queue.cc:260] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.929242 29007 raft_consensus.cc:359] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.930133 29005 ts_tablet_manager.cc:1434] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:08.931085 29005 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: Bootstrap starting.
I20260709 13:10:08.927691 29013 raft_consensus.cc:2804] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.931638 29013 raft_consensus.cc:493] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.931972 29013 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.930146 29007 raft_consensus.cc:385] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.932695 29007 raft_consensus.cc:740] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.933480 29007 consensus_queue.cc:260] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.939159 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7c9e120d5f4d5e80e1a47e16f6eebb" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.939185 28931 leader_election.cc:304] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:08.937458 29011 leader_election.cc:290] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:08.938781 29043 raft_consensus.cc:493] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.942768 29045 raft_consensus.cc:2804] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.940719 28815 raft_consensus.cc:2468] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 0.
I20260709 13:10:08.944929 28814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:08.945587 28814 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.945653 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.945925 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7c9e120d5f4d5e80e1a47e16f6eebb" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.946341 28815 raft_consensus.cc:2468] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.946583 28890 raft_consensus.cc:2468] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 0.
I20260709 13:10:08.948122 28857 leader_election.cc:304] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:08.943972 29043 raft_consensus.cc:515] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.951525 29044 raft_consensus.cc:2804] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.956146 28965 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:08.951212 29043 leader_election.cc:290] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.965553 29005 tablet_bootstrap.cc:654] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.967181 28816 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 1.
I20260709 13:10:08.962641 28814 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:08.951977 29044 raft_consensus.cc:493] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.957609 29045 raft_consensus.cc:697] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:08.952255 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:08.969599 29044 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.970291 28854 leader_election.cc:304] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:08.971184 29046 raft_consensus.cc:2749] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.971499 28962 raft_consensus.cc:2468] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.972754 28854 leader_election.cc:304] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:08.973641 29042 raft_consensus.cc:2804] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.974054 29042 raft_consensus.cc:493] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.974406 29042 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.979946 29045 consensus_queue.cc:237] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:08.981671 29042 raft_consensus.cc:515] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.982079 29046 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.982659 29046 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.951848 29013 raft_consensus.cc:515] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.952797 28931 leader_election.cc:304] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:08.954226 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:08.985764 29005 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: No bootstrap required, opened a new log
I20260709 13:10:08.986680 29011 raft_consensus.cc:2804] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.986744 29005 ts_tablet_manager.cc:1403] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:10:08.987224 29011 raft_consensus.cc:493] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.987643 29011 raft_consensus.cc:3060] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.987643 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:08.988405 28890 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 0.
I20260709 13:10:08.989758 28782 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:08.990378 29005 raft_consensus.cc:359] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.991223 29005 raft_consensus.cc:385] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.985051 29012 raft_consensus.cc:515] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.991648 29005 raft_consensus.cc:740] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.992885 29005 consensus_queue.cc:260] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.990962 29046 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.997306 29013 leader_election.cc:290] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Requested vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:08.997918 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:09.000409 29005 ts_tablet_manager.cc:1434] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:10:09.001737 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.002254 28962 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.002377 29042 leader_election.cc:290] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.003283 28814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:08.997754 29007 ts_tablet_manager.cc:1434] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.092s	user 0.015s	sys 0.014s
I20260709 13:10:08.991962 29044 raft_consensus.cc:515] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:08.994403 28815 raft_consensus.cc:2468] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:08.971015 29043 raft_consensus.cc:2804] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.998629 29047 raft_consensus.cc:2804] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.000358 28891 raft_consensus.cc:2393] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecf64565ad324ea4809f272e369a50c8 in current term 1: Already voted for candidate 582d72f16d584d22bfb77e365642221f in this term.
I20260709 13:10:09.006036 29007 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:09.008715 29047 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.009150 29047 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.019414 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:09.019845 28814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:09.020330 28963 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 0.
I20260709 13:10:09.020861 28814 raft_consensus.cc:2393] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 582d72f16d584d22bfb77e365642221f in current term 1: Already voted for candidate ecf64565ad324ea4809f272e369a50c8 in this term.
I20260709 13:10:09.018884 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.023548 28965 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.019385 29012 leader_election.cc:290] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.024624 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.025182 28963 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.026480 28962 raft_consensus.cc:2468] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.025805 29044 leader_election.cc:290] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.027565 28854 leader_election.cc:304] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:09.028147 29011 raft_consensus.cc:515] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.028973 29042 raft_consensus.cc:2804] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.027684 29043 raft_consensus.cc:697] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.031466 29007 tablet_bootstrap.cc:654] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.029546 29042 raft_consensus.cc:697] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.034301 29011 leader_election.cc:290] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:09.036778 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.032840 28814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:09.038048 28814 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.036995 29042 consensus_queue.cc:237] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.043210 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7c9e120d5f4d5e80e1a47e16f6eebb" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:09.043987 29049 raft_consensus.cc:493] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.044425 28891 raft_consensus.cc:3060] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.044530 29049 raft_consensus.cc:515] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.046867 28965 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.048080 29049 leader_election.cc:290] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.049468 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:09.050108 28890 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 0.
I20260709 13:10:09.047981 28854 leader_election.cc:304] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:09.051906 28782 leader_election.cc:304] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.052591 29007 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:09.042596 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7c9e120d5f4d5e80e1a47e16f6eebb" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:09.053004 29049 raft_consensus.cc:2804] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.053386 29007 ts_tablet_manager.cc:1403] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.006s
I20260709 13:10:09.053488 28815 raft_consensus.cc:3060] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.052735 29012 raft_consensus.cc:2804] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.052547 28963 raft_consensus.cc:2468] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.054739 29012 raft_consensus.cc:697] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.042366 29043 consensus_queue.cc:237] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.055629 29012 consensus_queue.cc:237] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.057696 28779 leader_election.cc:304] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecf64565ad324ea4809f272e369a50c8; no voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:09.053385 29049 raft_consensus.cc:493] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.058809 29044 raft_consensus.cc:493] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.059343 29044 raft_consensus.cc:515] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.061272 29044 leader_election.cc:290] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.058811 29013 raft_consensus.cc:2749] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.063566 29007 raft_consensus.cc:359] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.065323 29007 raft_consensus.cc:385] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.065937 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:09.065975 29007 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.066715 28962 raft_consensus.cc:2468] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:09.064483 28854 leader_election.cc:304] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:09.067915 29044 raft_consensus.cc:2804] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.067736 29007 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.069235 28854 leader_election.cc:304] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:09.071017 29007 ts_tablet_manager.cc:1434] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:09.072136 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:09.072748 28963 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 0.
I20260709 13:10:09.072542 28714 catalog_manager.cc:5697] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.073836 29007 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:09.071727 28816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
W20260709 13:10:09.075513 28857 leader_election.cc:343] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.078085 28814 raft_consensus.cc:2468] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.078631 28815 raft_consensus.cc:2468] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 1.
I20260709 13:10:09.053735 29047 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.079895 28931 leader_election.cc:304] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.080629 29011 raft_consensus.cc:2804] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.081081 29011 raft_consensus.cc:697] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:09.081419 29047 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Requested vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.081873 29011 consensus_queue.cc:237] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.082450 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:09.083209 28890 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.083094 28891 raft_consensus.cc:2468] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 1.
I20260709 13:10:09.085307 29056 raft_consensus.cc:2804] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.085815 29056 raft_consensus.cc:493] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.086195 29056 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.087853 29007 tablet_bootstrap.cc:654] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.092638 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.093326 28963 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.095356 29044 raft_consensus.cc:697] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.102737 29044 consensus_queue.cc:237] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.058379 29049 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.113750 28963 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 1.
I20260709 13:10:09.113796 28711 catalog_manager.cc:5697] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.115396 28779 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.116309 29047 raft_consensus.cc:2804] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.117148 29047 raft_consensus.cc:697] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: Becoming Leader. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Running, Role: LEADER
I20260709 13:10:09.117611 29042 raft_consensus.cc:493] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.117935 29047 consensus_queue.cc:237] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.118147 29042 raft_consensus.cc:515] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.120491 29042 leader_election.cc:290] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.118625 29056 raft_consensus.cc:515] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.122152 28814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8" is_pre_election: true
I20260709 13:10:09.122828 28814 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
I20260709 13:10:09.124037 28890 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 1.
I20260709 13:10:09.124296 28857 leader_election.cc:304] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.125423 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.125586 29042 raft_consensus.cc:2804] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.125746 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:09.126013 28965 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.126271 29042 raft_consensus.cc:493] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.125814 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:09.127022 29042 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.127224 28963 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 0.
W20260709 13:10:09.127377 28857 leader_election.cc:343] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.137812 29056 leader_election.cc:290] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.143288 28965 raft_consensus.cc:2468] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.144577 28854 leader_election.cc:304] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:09.147490 29056 raft_consensus.cc:2804] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.148212 29007 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: No bootstrap required, opened a new log
I20260709 13:10:09.148146 29056 raft_consensus.cc:697] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.148772 29007 ts_tablet_manager.cc:1403] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.021s
I20260709 13:10:09.149310 29056 consensus_queue.cc:237] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.150652 29007 raft_consensus.cc:359] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.151153 29007 raft_consensus.cc:385] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.151408 29007 raft_consensus.cc:740] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.142975 29049 raft_consensus.cc:515] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.152158 29007 consensus_queue.cc:260] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.154429 29007 ts_tablet_manager.cc:1434] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:09.155323 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:09.155900 28890 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.157119 28713 catalog_manager.cc:5697] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecf64565ad324ea4809f272e369a50c8 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "ecf64565ad324ea4809f272e369a50c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.158993 29049 leader_election.cc:290] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Requested vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.159112 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.159734 28965 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.163895 28890 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 1.
I20260709 13:10:09.152279 29042 raft_consensus.cc:515] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.166635 28782 leader_election.cc:304] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.168984 29049 raft_consensus.cc:2804] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.169046 28815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:09.169265 29042 leader_election.cc:290] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.174156 28815 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.170471 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:09.176801 28963 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.169965 29049 raft_consensus.cc:697] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: Becoming Leader. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Running, Role: LEADER
I20260709 13:10:09.180174 29047 raft_consensus.cc:493] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.180719 29047 raft_consensus.cc:515] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.180876 29049 consensus_queue.cc:237] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.181638 28815 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.182802 28857 leader_election.cc:304] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:09.165874 28711 catalog_manager.cc:5697] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.183794 28713 catalog_manager.cc:5697] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.185205 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:09.185406 29042 raft_consensus.cc:2804] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.186096 29042 raft_consensus.cc:697] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:09.185498 28713 catalog_manager.cc:5697] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.186926 29042 consensus_queue.cc:237] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:09.187248 28713 catalog_manager.cc:5697] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.188501 28962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:09.182942 29047 leader_election.cc:290] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:09.189620 28962 raft_consensus.cc:2393] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecf64565ad324ea4809f272e369a50c8 in current term 1: Already voted for candidate 582d72f16d584d22bfb77e365642221f in this term.
I20260709 13:10:09.189240 28713 catalog_manager.cc:5697] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.191423 28779 leader_election.cc:304] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecf64565ad324ea4809f272e369a50c8; no voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:09.170849 28965 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecf64565ad324ea4809f272e369a50c8 in term 1.
I20260709 13:10:09.199437 29047 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.203787 28963 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:09.206749 29047 raft_consensus.cc:2749] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.212395 28713 catalog_manager.cc:5697] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecf64565ad324ea4809f272e369a50c8 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "ecf64565ad324ea4809f272e369a50c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.214813 28711 catalog_manager.cc:5697] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 0 to 1, leader changed from <none> to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 1 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.369817 29011 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.381004 29051 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.431049 20036 ts_manager.cc:295] Set tserver state for ecf64565ad324ea4809f272e369a50c8 to MAINTENANCE_MODE
I20260709 13:10:09.431758 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:10:09.447683 29042 consensus_queue.cc:1048] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.453943 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.455005 20036 tablet_replica.cc:333] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.455675 20036 raft_consensus.cc:2243] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.456136 20036 raft_consensus.cc:2272] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.458575 20036 tablet_replica.cc:333] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.459376 20036 raft_consensus.cc:2243] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.459805 20036 raft_consensus.cc:2272] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.461524 20036 tablet_replica.cc:333] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.462069 20036 raft_consensus.cc:2243] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.462423 20036 raft_consensus.cc:2272] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.464000 20036 tablet_replica.cc:333] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.464591 20036 raft_consensus.cc:2243] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.465329 20036 pending_rounds.cc:70] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Trying to abort 1 pending ops.
I20260709 13:10:09.465531 20036 pending_rounds.cc:77] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636287214174208 op_type: NO_OP noop_request { }
I20260709 13:10:09.465843 20036 raft_consensus.cc:2889] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:09.466166 20036 raft_consensus.cc:2272] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.468521 20036 tablet_replica.cc:333] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.469260 20036 raft_consensus.cc:2243] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.469687 20036 raft_consensus.cc:2272] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.472292 20036 tablet_replica.cc:333] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.472797 20036 raft_consensus.cc:2243] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.473148 20036 raft_consensus.cc:2272] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.474633 20036 tablet_replica.cc:333] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.475118 20036 raft_consensus.cc:2243] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.475544 20036 raft_consensus.cc:2272] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.475982 28857 consensus_peers.cc:597] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.477353 20036 tablet_replica.cc:333] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.478036 20036 raft_consensus.cc:2243] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.478439 20036 raft_consensus.cc:2272] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.480554 28857 consensus_peers.cc:597] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.480855 20036 tablet_replica.cc:333] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.481432 20036 raft_consensus.cc:2243] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.481999 20036 pending_rounds.cc:70] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Trying to abort 1 pending ops.
I20260709 13:10:09.482206 20036 pending_rounds.cc:77] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636286959304704 op_type: NO_OP noop_request { }
I20260709 13:10:09.482520 20036 raft_consensus.cc:2889] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:09.482785 20036 raft_consensus.cc:2272] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.484664 20036 tablet_replica.cc:333] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: stopping tablet replica
I20260709 13:10:09.485113 20036 raft_consensus.cc:2243] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.485464 20036 raft_consensus.cc:2272] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.496134 29042 consensus_queue.cc:1048] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.510579 29012 consensus_queue.cc:1048] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.514341 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
W20260709 13:10:09.533866 28857 consensus_peers.cc:597] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.567735 29042 consensus_queue.cc:1048] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:09.571632 28857 consensus_peers.cc:597] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.579847 28857 consensus_peers.cc:597] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.607681 29042 consensus_queue.cc:1048] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:09.621851 28931 consensus_peers.cc:597] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.654254 29056 consensus_queue.cc:1048] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:09.666734 28857 consensus_peers.cc:597] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.686630 29051 consensus_queue.cc:1048] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:09.723130 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:09.984401 28931 consensus_peers.cc:597] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.724012 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:10.877550 28857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111) [suppressed 169 similar messages]
I20260709 13:10:10.878404 29044 raft_consensus.cc:493] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.878885 29044 raft_consensus.cc:515] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:10.880486 29044 leader_election.cc:290] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:10.881623 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:10.882220 28963 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 1.
I20260709 13:10:10.883400 28854 leader_election.cc:304] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
W20260709 13:10:10.884044 28857 leader_election.cc:336] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111)
I20260709 13:10:10.884157 29044 raft_consensus.cc:2804] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:10.884555 29044 raft_consensus.cc:493] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.884886 29044 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.890969 29044 raft_consensus.cc:515] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:10.892606 29044 leader_election.cc:290] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:10.893643 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb1515b16fe4e90a2e6641cf79e1f6e" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:10.894222 28963 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:10.896145 28857 leader_election.cc:336] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111)
I20260709 13:10:10.898967 28963 raft_consensus.cc:2468] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 2.
I20260709 13:10:10.899976 28854 leader_election.cc:304] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:10.900530 29044 raft_consensus.cc:2804] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:10.900919 29044 raft_consensus.cc:697] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:10.901669 29044 consensus_queue.cc:237] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:10.908165 28711 catalog_manager.cc:5697] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 1 to 2, leader changed from ecf64565ad324ea4809f272e369a50c8 (127.19.145.1) to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 2 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.281558 29087 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.282063 29087 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:11.283967 29087 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:11.285406 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:11.286128 28890 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 1.
I20260709 13:10:11.287297 28931 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:11.287953 29087 raft_consensus.cc:2804] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:11.288010 28931 leader_election.cc:336] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111)
I20260709 13:10:11.288358 29087 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.288707 29087 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.293545 29087 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:11.295120 29087 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:11.296446 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:11.297049 28890 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:11.298237 28931 leader_election.cc:336] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111)
I20260709 13:10:11.301806 28890 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:11.302837 28931 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: ecf64565ad324ea4809f272e369a50c8
I20260709 13:10:11.303488 29087 raft_consensus.cc:2804] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.304404 29087 raft_consensus.cc:697] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:11.305087 29087 consensus_queue.cc:237] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:11.312165 28711 catalog_manager.cc:5697] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from ecf64565ad324ea4809f272e369a50c8 (127.19.145.1) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.359182 28963 raft_consensus.cc:1275] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:11.360401 29044 consensus_queue.cc:1048] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:11.373288 28857 consensus_peers.cc:597] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.724920 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:11.856758 28890 raft_consensus.cc:1275] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:11.857986 29087 consensus_queue.cc:1048] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:11.870570 28931 consensus_peers.cc:597] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.885746 28857 consensus_peers.cc:597] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.920143 28857 consensus_peers.cc:597] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.978966 28857 consensus_peers.cc:597] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.986562 28857 consensus_peers.cc:597] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.124374 28931 consensus_peers.cc:597] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.128401 28931 consensus_peers.cc:597] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.212306 28857 consensus_peers.cc:597] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.218729 28857 consensus_peers.cc:597] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.725798 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:13.718394 28857 consensus_peers.cc:597] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.726583 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:14.158385 28931 consensus_peers.cc:597] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:14.255333 28857 consensus_peers.cc:597] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.320472 28857 consensus_peers.cc:597] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.368374 28931 consensus_peers.cc:597] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.401846 28857 consensus_peers.cc:597] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.428238 28857 consensus_peers.cc:597] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.538700 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.545040 29100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.545735 29101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.546459 29103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.550588 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:14.553628 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.553853 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.554086 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602614554067 us; error 0 us; skew 500 ppm
I20260709 13:10:14.554630 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.556952 20036 webserver.cc:533] Webserver started at http://127.19.145.1:38223/ using document root <none> and password file <none>
I20260709 13:10:14.557438 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.557586 20036 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:14.560971 20036 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:14.564322 29108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.564971 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:14.565289 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "ecf64565ad324ea4809f272e369a50c8"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-cd6k"
I20260709 13:10:14.565551 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.592190 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.593295 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.594667 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:14.598568 29115 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:10:14.600417 28857 consensus_peers.cc:597] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.609910 28931 consensus_peers.cc:597] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.645215 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:14.645689 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.002s	sys 0.000s
I20260709 13:10:14.646021 20036 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:14.650226 29115 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.662804 29115 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.663597 29115 tablet_bootstrap.cc:492] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.664209 29115 ts_tablet_manager.cc:1403] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:10:14.666695 29115 raft_consensus.cc:359] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.667384 29115 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.668098 29115 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.670631 29115 ts_tablet_manager.cc:1434] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:14.671443 29115 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.686357 29115 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.687346 29115 tablet_bootstrap.cc:492] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.688016 29115 ts_tablet_manager.cc:1403] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:10:14.690493 29115 raft_consensus.cc:359] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:14.691170 29115 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.691905 29115 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:14.693859 29115 ts_tablet_manager.cc:1434] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:14.694613 29115 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.698077 20036 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:14.698427 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.052s	user 0.050s	sys 0.000s
I20260709 13:10:14.708299 29115 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.709312 29115 tablet_bootstrap.cc:492] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.710222 29115 ts_tablet_manager.cc:1403] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:10:14.713441 29115 raft_consensus.cc:359] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.714349 29115 raft_consensus.cc:740] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.715188 29115 consensus_queue.cc:260] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.717656 29115 ts_tablet_manager.cc:1434] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:14.718648 29115 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
W20260709 13:10:14.727609 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:14.734601 29115 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:14.735673 29115 tablet_bootstrap.cc:492] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.736373 29115 ts_tablet_manager.cc:1403] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:10:14.738320 29115 raft_consensus.cc:359] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.738951 29115 raft_consensus.cc:740] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.739630 29115 consensus_queue.cc:260] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.741019 29115 ts_tablet_manager.cc:1434] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:14.741801 29115 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.750818 29115 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.751511 29115 tablet_bootstrap.cc:492] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.751994 29115 ts_tablet_manager.cc:1403] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:10:14.753726 29115 raft_consensus.cc:359] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.754212 29115 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.754802 29115 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.755621 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:44175
I20260709 13:10:14.755716 29177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:44175 every 8 connection(s)
I20260709 13:10:14.756368 29115 ts_tablet_manager.cc:1434] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:10:14.757083 29115 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
W20260709 13:10:14.759994 29179 tablet.cc:2406] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:14.760545 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.767946 29115 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.768739 29115 tablet_bootstrap.cc:492] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.769328 29115 ts_tablet_manager.cc:1403] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:10:14.772184 29115 raft_consensus.cc:359] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.772848 29115 raft_consensus.cc:740] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.773566 29115 consensus_queue.cc:260] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.775223 29178 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38891
I20260709 13:10:14.775751 29115 ts_tablet_manager.cc:1434] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:14.775818 29178 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:14.776707 29115 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.777170 29178 heartbeater.cc:507] Master 127.19.145.62:38891 requested a full tablet report, sending...
I20260709 13:10:14.783025 28711 ts_manager.cc:194] Re-registered known tserver with Master: ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:14.787288 28890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13068279708745ebb4d82c60413e1017"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:14.787967 28890 raft_consensus.cc:606] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:14.788933 29115 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.789767 29115 tablet_bootstrap.cc:492] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.790390 29115 ts_tablet_manager.cc:1403] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:14.790863 28890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:14.791451 28890 raft_consensus.cc:606] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:14.792663 29115 raft_consensus.cc:359] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.793299 29115 raft_consensus.cc:740] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.793890 28890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c680901e3ed547a2a68369d871d43291"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:14.793984 29115 consensus_queue.cc:260] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.794605 28890 raft_consensus.cc:606] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:14.795795 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:14.795864 29115 ts_tablet_manager.cc:1434] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:14.796446 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.796710 29115 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.797079 28711 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51800
I20260709 13:10:14.797225 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.801611 29178 heartbeater.cc:499] Master 127.19.145.62:38891 was elected leader, sending a full tablet report...
I20260709 13:10:14.808331 29115 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.809023 29115 tablet_bootstrap.cc:492] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.809602 29115 ts_tablet_manager.cc:1403] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:10:14.811790 29115 raft_consensus.cc:359] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.812265 29115 raft_consensus.cc:740] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.812824 29115 consensus_queue.cc:260] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.814337 29115 ts_tablet_manager.cc:1434] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 13:10:14.814909 29115 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.824398 29115 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:14.825086 29115 tablet_bootstrap.cc:492] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.825564 29115 ts_tablet_manager.cc:1403] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:14.827095 29115 raft_consensus.cc:359] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.827675 29115 raft_consensus.cc:740] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.828161 29115 consensus_queue.cc:260] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.829528 29115 ts_tablet_manager.cc:1434] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:14.830186 29115 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Bootstrap starting.
I20260709 13:10:14.839877 29115 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.840466 29115 tablet_bootstrap.cc:492] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Bootstrap complete.
I20260709 13:10:14.840960 29115 ts_tablet_manager.cc:1403] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:14.842519 29115 raft_consensus.cc:359] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.842979 29115 raft_consensus.cc:385] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.843186 29115 raft_consensus.cc:740] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf64565ad324ea4809f272e369a50c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.843716 29115 consensus_queue.cc:260] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.845103 29115 ts_tablet_manager.cc:1434] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:14.884008 29044 raft_consensus.cc:993] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:14.884496 29192 raft_consensus.cc:1081] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:14.886029 28963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c680901e3ed547a2a68369d871d43291"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:14.886507 28963 raft_consensus.cc:493] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.886782 28963 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.891207 29117 raft_consensus.cc:493] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.891714 29117 raft_consensus.cc:515] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.892228 28963 raft_consensus.cc:515] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.894194 29117 leader_election.cc:290] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:14.896071 28963 leader_election.cc:290] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:14.896580 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:14.897225 28890 raft_consensus.cc:3055] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.897541 28890 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:14.898341 28890 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.899478 28890 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.906327 28890 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:14.907507 28931 leader_election.cc:304] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8; no voters: 
I20260709 13:10:14.908355 29087 raft_consensus.cc:2804] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.913976 28891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "582d72f16d584d22bfb77e365642221f" is_pre_election: true
I20260709 13:10:14.920931 29087 raft_consensus.cc:697] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:14.923735 29087 consensus_queue.cc:237] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.927345 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:14.928020 29150 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.938261 29150 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:14.940025 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "ecf64565ad324ea4809f272e369a50c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed7024ca4694ad9952d68576ec613b8" is_pre_election: true
I20260709 13:10:14.941380 29109 leader_election.cc:304] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecf64565ad324ea4809f272e369a50c8; no voters: 582d72f16d584d22bfb77e365642221f, 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:14.942063 29117 raft_consensus.cc:2749] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.944280 28711 catalog_manager.cc:5697] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.951169 29044 raft_consensus.cc:993] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:14.951766 29192 raft_consensus.cc:1081] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:14.953428 28963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13068279708745ebb4d82c60413e1017"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:14.953971 28963 raft_consensus.cc:493] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.954314 28963 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.959630 28963 raft_consensus.cc:515] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.960886 28963 leader_election.cc:290] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:14.961596 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:14.961817 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:14.962242 29150 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.962365 28890 raft_consensus.cc:3055] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.962770 28890 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:14.963591 28890 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.964778 28890 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.969077 29150 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:14.970192 28931 leader_election.cc:304] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:14.970880 29087 raft_consensus.cc:2804] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.971310 29087 raft_consensus.cc:697] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:14.971612 28890 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:14.972071 29087 consensus_queue.cc:237] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:14.978561 28711 catalog_manager.cc:5697] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.084913 29150 raft_consensus.cc:3060] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.091773 29150 pending_rounds.cc:85] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Aborting all ops after (but not including) 0
I20260709 13:10:15.091995 29150 pending_rounds.cc:107] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:15.092185 29150 raft_consensus.cc:2889] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.184484 29150 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.190495 29150 pending_rounds.cc:85] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Aborting all ops after (but not including) 0
I20260709 13:10:15.190845 29150 pending_rounds.cc:107] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:15.191089 29150 raft_consensus.cc:2889] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.269093 29044 raft_consensus.cc:993] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:15.269583 29192 raft_consensus.cc:1081] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:15.271044 28963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:15.271555 28963 raft_consensus.cc:493] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.271790 28963 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.276216 28963 raft_consensus.cc:515] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.278172 28963 leader_election.cc:290] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:15.279129 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:15.279517 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c371c3b7f447069b6d53be7b91c342" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:15.280171 29150 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.280336 28890 raft_consensus.cc:3055] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.280881 28890 raft_consensus.cc:740] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:15.281785 28890 consensus_queue.cc:260] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.282991 28890 raft_consensus.cc:3060] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.287508 29150 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:15.288062 28890 raft_consensus.cc:2468] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:15.288712 28931 leader_election.cc:304] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:15.289353 29087 raft_consensus.cc:2804] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.289741 29087 raft_consensus.cc:697] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:15.290500 29087 consensus_queue.cc:237] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.297881 28714 catalog_manager.cc:5697] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.300860 29150 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.303858 29151 raft_consensus.cc:1275] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.305968 29087 consensus_queue.cc:1048] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.316689 28890 raft_consensus.cc:1275] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.318028 29087 consensus_queue.cc:1048] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.402314 28890 raft_consensus.cc:1275] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.403314 29087 consensus_queue.cc:1048] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.413028 29150 raft_consensus.cc:1275] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.414419 29087 consensus_queue.cc:1048] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:15.728609 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:15.772987 28890 raft_consensus.cc:1275] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.774207 29087 consensus_queue.cc:1048] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.782290 29150 raft_consensus.cc:1275] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.784328 29196 consensus_queue.cc:1048] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.804459 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.819650 28963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13068279708745ebb4d82c60413e1017"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
mode: GRACEFUL
new_leader_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:38684
I20260709 13:10:15.820125 28963 raft_consensus.cc:606] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Received request to transfer leadership to TS 582d72f16d584d22bfb77e365642221f
I20260709 13:10:15.822080 28963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
mode: GRACEFUL
new_leader_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:38684
I20260709 13:10:15.822466 28963 raft_consensus.cc:606] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Received request to transfer leadership to TS 582d72f16d584d22bfb77e365642221f
I20260709 13:10:15.823338 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:15.823786 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.824368 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.836452 29087 raft_consensus.cc:993] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: : Instructing follower 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:15.836906 29196 raft_consensus.cc:1081] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Signalling peer 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:15.838227 28890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:54284
I20260709 13:10:15.838662 28890 raft_consensus.cc:493] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.838975 28890 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.843633 28890 raft_consensus.cc:515] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.845173 28890 leader_election.cc:290] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:15.845729 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:15.846099 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2973566cf84a59a9ace6f74047bfff" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:15.846318 29150 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.846706 28963 raft_consensus.cc:3055] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.847010 28963 raft_consensus.cc:740] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:15.847774 28963 consensus_queue.cc:260] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.848862 28963 raft_consensus.cc:3060] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.851336 29150 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:15.852249 28857 leader_election.cc:304] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:15.852876 29215 raft_consensus.cc:2804] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.853272 29215 raft_consensus.cc:697] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:15.853480 28963 raft_consensus.cc:2468] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:15.854025 29215 consensus_queue.cc:237] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.860692 28714 catalog_manager.cc:5697] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 2 to 3, leader changed from 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3) to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 3 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.951014 29087 raft_consensus.cc:993] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: : Instructing follower 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:15.951503 29196 raft_consensus.cc:1081] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Signalling peer 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:15.952906 28890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13068279708745ebb4d82c60413e1017"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:54284
I20260709 13:10:15.953346 28890 raft_consensus.cc:493] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.953701 28890 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.958798 28890 raft_consensus.cc:515] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.960157 28890 leader_election.cc:290] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:15.961066 28963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:15.961715 28963 raft_consensus.cc:3055] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.961097 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13068279708745ebb4d82c60413e1017" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:15.961978 28963 raft_consensus.cc:740] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:15.962211 29150 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.962723 28963 consensus_queue.cc:260] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.963897 28963 raft_consensus.cc:3060] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.967188 29150 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:15.967975 28963 raft_consensus.cc:2468] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:15.968218 28857 leader_election.cc:304] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:15.968986 29215 raft_consensus.cc:2804] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.969362 29215 raft_consensus.cc:697] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:15.969959 29215 consensus_queue.cc:237] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:15.975059 28714 catalog_manager.cc:5697] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 2 to 3, leader changed from 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3) to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 3 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.252790 29150 raft_consensus.cc:1275] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:16.254293 29215 consensus_queue.cc:1048] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:16.267956 28963 raft_consensus.cc:1275] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:16.271622 29192 consensus_queue.cc:1048] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:16.427778 28963 raft_consensus.cc:1275] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:16.428880 29192 consensus_queue.cc:1048] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.438172 29150 raft_consensus.cc:1275] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:16.439668 29215 consensus_queue.cc:1048] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:16.729703 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:16.830703 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.839159 28890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:16.839774 28890 raft_consensus.cc:606] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:16.842460 28890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:16.842949 28890 raft_consensus.cc:606] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:16.844197 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:16.844647 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.845310 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.010161 29215 raft_consensus.cc:993] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:17.010717 29192 raft_consensus.cc:1081] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:17.012279 28965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:17.012761 28965 raft_consensus.cc:493] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.013077 28965 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.020421 28965 raft_consensus.cc:515] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.022030 28965 leader_election.cc:290] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:17.022871 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:17.023136 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f8e0b6b3ea493ba9cabbb0d34ecd44" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:17.023641 29150 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.023730 28890 raft_consensus.cc:3055] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.024103 28890 raft_consensus.cc:740] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:17.025152 28890 consensus_queue.cc:260] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.026638 28890 raft_consensus.cc:3060] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.032405 29150 raft_consensus.cc:2468] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:17.033727 28931 leader_election.cc:304] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:17.034651 29196 raft_consensus.cc:2804] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.035185 28890 raft_consensus.cc:2468] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:17.035844 29196 raft_consensus.cc:697] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:17.037516 29196 consensus_queue.cc:237] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.043866 28711 catalog_manager.cc:5697] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.148239 29215 raft_consensus.cc:993] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:17.148669 29192 raft_consensus.cc:1081] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:17.150031 28965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:17.150496 28965 raft_consensus.cc:493] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.150815 28965 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.156654 28965 raft_consensus.cc:515] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.158179 28965 leader_election.cc:290] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:17.158910 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:17.159198 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3a147c734e2ca746e552213ed14f" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:17.159629 29150 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.159771 28890 raft_consensus.cc:3055] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.160174 28890 raft_consensus.cc:740] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:17.161074 28890 consensus_queue.cc:260] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.162336 28890 raft_consensus.cc:3060] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.166558 29150 raft_consensus.cc:2468] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:17.167899 28931 leader_election.cc:304] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:17.168637 29196 raft_consensus.cc:2804] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.169057 29196 raft_consensus.cc:697] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:17.169350 28890 raft_consensus.cc:2468] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:17.170177 29196 consensus_queue.cc:237] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.179232 28711 catalog_manager.cc:5697] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.550834 29150 raft_consensus.cc:1275] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.551854 29196 consensus_queue.cc:1048] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.562250 28890 raft_consensus.cc:1275] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.564714 29229 consensus_queue.cc:1048] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.585350 28890 raft_consensus.cc:1275] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.586426 29240 consensus_queue.cc:1048] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.594297 29150 raft_consensus.cc:1275] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.596081 29240 consensus_queue.cc:1048] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:17.730581 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:17.851059 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.858157 28965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
mode: GRACEFUL
new_leader_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:38684
I20260709 13:10:17.858700 28965 raft_consensus.cc:606] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Received request to transfer leadership to TS 582d72f16d584d22bfb77e365642221f
I20260709 13:10:17.861105 28965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c680901e3ed547a2a68369d871d43291"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
mode: GRACEFUL
new_leader_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:38684
I20260709 13:10:17.861545 28965 raft_consensus.cc:606] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Received request to transfer leadership to TS 582d72f16d584d22bfb77e365642221f
I20260709 13:10:17.862681 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:17.863118 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:17.863696 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.975317 29196 raft_consensus.cc:993] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: : Instructing follower 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:17.975795 29240 raft_consensus.cc:1081] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Signalling peer 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:17.977159 28890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c680901e3ed547a2a68369d871d43291"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:54284
I20260709 13:10:17.977660 28890 raft_consensus.cc:493] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.977947 28890 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.982553 28890 raft_consensus.cc:515] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.983933 28890 leader_election.cc:290] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251)
I20260709 13:10:17.984732 29150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:17.985046 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680901e3ed547a2a68369d871d43291" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:17.985332 29150 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.985635 28965 raft_consensus.cc:3055] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.985941 28965 raft_consensus.cc:740] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:17.986673 28965 consensus_queue.cc:260] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.987766 28965 raft_consensus.cc:3060] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.990465 29150 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:17.991570 28857 leader_election.cc:304] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:17.992278 29192 raft_consensus.cc:2804] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.993309 29192 raft_consensus.cc:697] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:17.994253 29192 consensus_queue.cc:237] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:17.994423 28965 raft_consensus.cc:2468] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 3.
I20260709 13:10:18.001242 28714 catalog_manager.cc:5697] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 2 to 3, leader changed from 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3) to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 3 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.129612 29240 raft_consensus.cc:993] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: : Instructing follower 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:18.130062 29229 raft_consensus.cc:1081] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Signalling peer 582d72f16d584d22bfb77e365642221f to start an election
I20260709 13:10:18.131590 28891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
 from {username='slave'} at 127.0.0.1:54284
I20260709 13:10:18.131980 28891 raft_consensus.cc:493] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.132217 28891 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.139184 28891 raft_consensus.cc:515] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:18.140767 28891 leader_election.cc:290] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 election: Requested vote from peers 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3:37251), ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:18.141491 28965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
I20260709 13:10:18.141873 29151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "582d72f16d584d22bfb77e365642221f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:18.142073 28965 raft_consensus.cc:3055] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.142431 29151 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.142452 28965 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:18.143515 28965 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:18.144524 28965 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.148064 29151 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 2.
I20260709 13:10:18.148957 28857 leader_election.cc:304] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 582d72f16d584d22bfb77e365642221f, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:18.149600 29192 raft_consensus.cc:2804] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.149747 28965 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 582d72f16d584d22bfb77e365642221f in term 2.
I20260709 13:10:18.149991 29192 raft_consensus.cc:697] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Becoming Leader. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:18.151271 29192 consensus_queue.cc:237] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:18.157377 28714 catalog_manager.cc:5697] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f reported cstate change: term changed from 1 to 2, leader changed from 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3) to 582d72f16d584d22bfb77e365642221f (127.19.145.2). New cstate: current_term: 2 leader_uuid: "582d72f16d584d22bfb77e365642221f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.441488 28965 raft_consensus.cc:1275] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.442574 29192 consensus_queue.cc:1048] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.451908 29151 raft_consensus.cc:1275] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.453430 29192 consensus_queue.cc:1048] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.564184 29151 raft_consensus.cc:1275] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.565398 29192 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.575347 28965 raft_consensus.cc:1275] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Refusing update from remote peer 582d72f16d584d22bfb77e365642221f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.576864 29192 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:18.731469 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:18.869648 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.876878 28891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:18.877409 28891 raft_consensus.cc:606] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:18.879694 28891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50"
dest_uuid: "582d72f16d584d22bfb77e365642221f"
mode: GRACEFUL
new_leader_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:58720
I20260709 13:10:18.880137 28891 raft_consensus.cc:606] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Received request to transfer leadership to TS 5ed7024ca4694ad9952d68576ec613b8
I20260709 13:10:18.881094 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:18.881542 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.882059 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.123996 29254 raft_consensus.cc:993] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:19.124521 29192 raft_consensus.cc:1081] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:19.126014 28965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:19.126624 28965 raft_consensus.cc:493] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.126961 28965 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.131953 28965 raft_consensus.cc:515] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:19.133414 28965 leader_election.cc:290] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 3 election: Requested vote from peers 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401), ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175)
I20260709 13:10:19.134053 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:19.134282 29151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1abb0f2a704e39abfea8f477a95c50" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:19.134672 28890 raft_consensus.cc:3055] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.134874 29151 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.135010 28890 raft_consensus.cc:740] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:19.135862 28890 consensus_queue.cc:260] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:19.137041 28890 raft_consensus.cc:3060] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.140803 29151 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 3.
I20260709 13:10:19.141893 28931 leader_election.cc:304] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:19.142589 29229 raft_consensus.cc:2804] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.142970 29229 raft_consensus.cc:697] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:19.143555 28890 raft_consensus.cc:2468] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 3.
I20260709 13:10:19.143741 29229 consensus_queue.cc:237] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } }
I20260709 13:10:19.152076 28714 catalog_manager.cc:5697] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 2 to 3, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.223533 29192 raft_consensus.cc:993] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: : Instructing follower 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:19.223994 29254 raft_consensus.cc:1081] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Signalling peer 5ed7024ca4694ad9952d68576ec613b8 to start an election
I20260709 13:10:19.225251 28965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d"
dest_uuid: "5ed7024ca4694ad9952d68576ec613b8"
 from {username='slave'} at 127.0.0.1:57554
I20260709 13:10:19.225724 28965 raft_consensus.cc:493] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.226037 28965 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.231047 28965 raft_consensus.cc:515] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:19.232708 28965 leader_election.cc:290] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Requested vote from peers ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175), 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401)
I20260709 13:10:19.233423 29151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecf64565ad324ea4809f272e369a50c8"
I20260709 13:10:19.233652 28890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0563dbb53e1843f4b87286b2b519a22d" candidate_uuid: "5ed7024ca4694ad9952d68576ec613b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "582d72f16d584d22bfb77e365642221f"
I20260709 13:10:19.234001 29151 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.234171 28890 raft_consensus.cc:3055] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.234433 28890 raft_consensus.cc:740] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 582d72f16d584d22bfb77e365642221f, State: Running, Role: LEADER
I20260709 13:10:19.235203 28890 consensus_queue.cc:260] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:19.236161 28890 raft_consensus.cc:3060] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.238902 29151 raft_consensus.cc:2468] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:19.239866 28931 leader_election.cc:304] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed7024ca4694ad9952d68576ec613b8, ecf64565ad324ea4809f272e369a50c8; no voters: 
I20260709 13:10:19.240500 29229 raft_consensus.cc:2804] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.240880 29229 raft_consensus.cc:697] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5ed7024ca4694ad9952d68576ec613b8, State: Running, Role: LEADER
I20260709 13:10:19.241050 28890 raft_consensus.cc:2468] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ed7024ca4694ad9952d68576ec613b8 in term 2.
I20260709 13:10:19.241739 29229 consensus_queue.cc:237] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } }
I20260709 13:10:19.247943 28714 catalog_manager.cc:5697] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 reported cstate change: term changed from 1 to 2, leader changed from 582d72f16d584d22bfb77e365642221f (127.19.145.2) to 5ed7024ca4694ad9952d68576ec613b8 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "5ed7024ca4694ad9952d68576ec613b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ed7024ca4694ad9952d68576ec613b8" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.591205 28890 raft_consensus.cc:1275] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.592206 29229 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:19.600536 29151 raft_consensus.cc:1275] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.602428 29229 consensus_queue.cc:1048] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:19.732322 28762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:19.751696 28890 raft_consensus.cc:1275] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.753031 29229 consensus_queue.cc:1048] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "582d72f16d584d22bfb77e365642221f" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 39401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.764164 29151 raft_consensus.cc:1275] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Refusing update from remote peer 5ed7024ca4694ad9952d68576ec613b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.765460 29229 consensus_queue.cc:1048] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf64565ad324ea4809f272e369a50c8" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 44175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.889060 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.921232 20036 tablet_server.cc:179] TabletServer@127.19.145.1:44175 shutting down...
I20260709 13:10:19.944772 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:19.945549 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.946346 20036 raft_consensus.cc:2243] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.946910 20036 raft_consensus.cc:2272] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.949600 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.950469 20036 raft_consensus.cc:2243] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.951103 20036 raft_consensus.cc:2272] T 6eb1515b16fe4e90a2e6641cf79e1f6e P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.953680 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.954180 20036 raft_consensus.cc:2243] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.954551 20036 raft_consensus.cc:2272] T 0563dbb53e1843f4b87286b2b519a22d P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.957237 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.957756 20036 raft_consensus.cc:2243] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.958091 20036 raft_consensus.cc:2272] T e38f3a147c734e2ca746e552213ed14f P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.960022 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.960520 20036 raft_consensus.cc:2243] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.960902 20036 raft_consensus.cc:2272] T 72c371c3b7f447069b6d53be7b91c342 P ecf64565ad324ea4809f272e369a50c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.962841 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.963316 20036 raft_consensus.cc:2243] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.963701 20036 raft_consensus.cc:2272] T 5d2973566cf84a59a9ace6f74047bfff P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.965607 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.966059 20036 raft_consensus.cc:2243] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.966418 20036 raft_consensus.cc:2272] T 13068279708745ebb4d82c60413e1017 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.968284 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.968740 20036 raft_consensus.cc:2243] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.969070 20036 raft_consensus.cc:2272] T c680901e3ed547a2a68369d871d43291 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.971027 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.971556 20036 raft_consensus.cc:2243] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.971932 20036 raft_consensus.cc:2272] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P ecf64565ad324ea4809f272e369a50c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.973973 20036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.974344 20036 raft_consensus.cc:2243] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.974689 20036 raft_consensus.cc:2272] T 7b1abb0f2a704e39abfea8f477a95c50 P ecf64565ad324ea4809f272e369a50c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.007148 20036 tablet_server.cc:196] TabletServer@127.19.145.1:44175 shutdown complete.
I20260709 13:10:20.032027 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
W20260709 13:10:20.043586 28931 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 83 similar messages]
W20260709 13:10:20.049638 28931 consensus_peers.cc:597] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 -> Peer 582d72f16d584d22bfb77e365642221f (127.19.145.2:39401): Couldn't send request to peer 582d72f16d584d22bfb77e365642221f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.055073 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.055987 20036 tablet_replica.cc:333] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.056849 20036 raft_consensus.cc:2243] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.057339 20036 raft_consensus.cc:2272] T e38f3a147c734e2ca746e552213ed14f P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.059834 20036 tablet_replica.cc:333] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.060472 20036 raft_consensus.cc:2243] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:20.060667 28931 consensus_peers.cc:597] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.061383 20036 raft_consensus.cc:2272] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.063740 20036 tablet_replica.cc:333] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.064306 20036 raft_consensus.cc:2243] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.065011 20036 raft_consensus.cc:2272] T 13068279708745ebb4d82c60413e1017 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.067149 20036 tablet_replica.cc:333] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.067775 20036 raft_consensus.cc:2243] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.068483 20036 raft_consensus.cc:2272] T c680901e3ed547a2a68369d871d43291 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.070891 20036 tablet_replica.cc:333] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.071530 20036 raft_consensus.cc:2243] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.072055 20036 raft_consensus.cc:2272] T 72c371c3b7f447069b6d53be7b91c342 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.074080 20036 tablet_replica.cc:333] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.074585 20036 raft_consensus.cc:2243] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.075405 20036 raft_consensus.cc:2272] T 5d2973566cf84a59a9ace6f74047bfff P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.077327 20036 tablet_replica.cc:333] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.077852 20036 raft_consensus.cc:2243] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.078248 20036 raft_consensus.cc:2272] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.080134 20036 tablet_replica.cc:333] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.080587 20036 raft_consensus.cc:2243] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.080961 20036 raft_consensus.cc:2272] T 0563dbb53e1843f4b87286b2b519a22d P 582d72f16d584d22bfb77e365642221f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.084376 20036 tablet_replica.cc:333] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.084904 20036 raft_consensus.cc:2243] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.085325 20036 raft_consensus.cc:2272] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 582d72f16d584d22bfb77e365642221f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.087386 20036 tablet_replica.cc:333] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f: stopping tablet replica
I20260709 13:10:20.087874 20036 raft_consensus.cc:2243] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.088260 20036 raft_consensus.cc:2272] T 7b1abb0f2a704e39abfea8f477a95c50 P 582d72f16d584d22bfb77e365642221f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.117272 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
W20260709 13:10:20.141642 28931 consensus_peers.cc:597] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 -> Peer ecf64565ad324ea4809f272e369a50c8 (127.19.145.1:44175): Couldn't send request to peer ecf64565ad324ea4809f272e369a50c8. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:44175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.146250 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:10:20.172646 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.173296 20036 tablet_replica.cc:333] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.174055 20036 raft_consensus.cc:2243] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.174871 20036 raft_consensus.cc:2272] T 0563dbb53e1843f4b87286b2b519a22d P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.177381 20036 tablet_replica.cc:333] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.178018 20036 raft_consensus.cc:2243] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.178826 20036 raft_consensus.cc:2272] T e38f3a147c734e2ca746e552213ed14f P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.180771 20036 tablet_replica.cc:333] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.181303 20036 raft_consensus.cc:2243] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.181996 20036 raft_consensus.cc:2272] T e5f8e0b6b3ea493ba9cabbb0d34ecd44 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.183974 20036 tablet_replica.cc:333] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.184476 20036 raft_consensus.cc:2243] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.185257 20036 raft_consensus.cc:2272] T 0e7c9e120d5f4d5e80e1a47e16f6eebb P 5ed7024ca4694ad9952d68576ec613b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.187208 20036 tablet_replica.cc:333] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.187841 20036 raft_consensus.cc:2243] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.188555 20036 raft_consensus.cc:2272] T 7b1abb0f2a704e39abfea8f477a95c50 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.191702 20036 tablet_replica.cc:333] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.192296 20036 raft_consensus.cc:2243] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.192719 20036 raft_consensus.cc:2272] T 5d2973566cf84a59a9ace6f74047bfff P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.194759 20036 tablet_replica.cc:333] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.195355 20036 raft_consensus.cc:2243] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.196125 20036 raft_consensus.cc:2272] T 72c371c3b7f447069b6d53be7b91c342 P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.198132 20036 tablet_replica.cc:333] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.198637 20036 raft_consensus.cc:2243] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.199071 20036 raft_consensus.cc:2272] T 6eb1515b16fe4e90a2e6641cf79e1f6e P 5ed7024ca4694ad9952d68576ec613b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.200922 20036 tablet_replica.cc:333] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.201469 20036 raft_consensus.cc:2243] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.201891 20036 raft_consensus.cc:2272] T 13068279708745ebb4d82c60413e1017 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.203557 20036 tablet_replica.cc:333] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8: stopping tablet replica
I20260709 13:10:20.203981 20036 raft_consensus.cc:2243] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.204387 20036 raft_consensus.cc:2272] T c680901e3ed547a2a68369d871d43291 P 5ed7024ca4694ad9952d68576ec613b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.234460 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:10:20.256124 20036 master.cc:562] Master@127.19.145.62:38891 shutting down...
I20260709 13:10:20.276116 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.276692 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.277043 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 55e0aa5e978745bfab5b5562659301ae: stopping tablet replica
I20260709 13:10:20.297921 20036 master.cc:584] Master@127.19.145.62:38891 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12753 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:20.345367 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:38497
I20260709 13:10:20.346379 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:20.351630 29280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.352424 29281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.353011 29283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.353669 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:20.354511 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:20.354707 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:20.354874 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602620354841 us; error 0 us; skew 500 ppm
I20260709 13:10:20.355473 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:20.357661 20036 webserver.cc:533] Webserver started at http://127.19.145.62:38745/ using document root <none> and password file <none>
I20260709 13:10:20.358148 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:20.358343 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:20.358623 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:20.359766 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "c9d8286f2d914a72ac645d9e877f94af"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.363986 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:10:20.367029 29288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.367751 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:20.368041 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "c9d8286f2d914a72ac645d9e877f94af"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.368309 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:20.381034 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:20.382180 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:20.418774 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:38497
I20260709 13:10:20.418866 29339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:38497 every 8 connection(s)
I20260709 13:10:20.422472 29340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.433425 29340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af: Bootstrap starting.
I20260709 13:10:20.438172 29340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.442323 29340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af: No bootstrap required, opened a new log
I20260709 13:10:20.444422 29340 raft_consensus.cc:359] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER }
I20260709 13:10:20.444860 29340 raft_consensus.cc:385] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.445057 29340 raft_consensus.cc:740] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d8286f2d914a72ac645d9e877f94af, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.445667 29340 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER }
I20260709 13:10:20.446111 29340 raft_consensus.cc:399] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:20.446305 29340 raft_consensus.cc:493] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:20.446528 29340 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.450793 29340 raft_consensus.cc:515] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER }
I20260709 13:10:20.451263 29340 leader_election.cc:304] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9d8286f2d914a72ac645d9e877f94af; no voters: 
I20260709 13:10:20.452270 29340 leader_election.cc:290] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:20.452579 29343 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.453894 29343 raft_consensus.cc:697] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 1 LEADER]: Becoming Leader. State: Replica: c9d8286f2d914a72ac645d9e877f94af, State: Running, Role: LEADER
I20260709 13:10:20.454566 29343 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER }
I20260709 13:10:20.455503 29340 sys_catalog.cc:565] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:20.457477 29344 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9d8286f2d914a72ac645d9e877f94af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER } }
I20260709 13:10:20.457669 29345 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9d8286f2d914a72ac645d9e877f94af. Latest consensus state: current_term: 1 leader_uuid: "c9d8286f2d914a72ac645d9e877f94af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d8286f2d914a72ac645d9e877f94af" member_type: VOTER } }
I20260709 13:10:20.458119 29344 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:20.458209 29345 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:20.461292 29349 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:20.466230 29349 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:20.470853 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:20.474732 29349 catalog_manager.cc:1383] Generated new cluster ID: 638db3918ebe49f580540ebb03239a59
I20260709 13:10:20.474997 29349 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:20.499681 29349 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:20.500923 29349 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:20.513162 29349 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af: Generated new TSK 0
I20260709 13:10:20.513777 29349 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:20.537923 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:20.543893 29361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.545347 29362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.546597 20036 server_base.cc:1061] running on GCE node
W20260709 13:10:20.546876 29364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.547890 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:20.548070 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:20.548187 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602620548176 us; error 0 us; skew 500 ppm
I20260709 13:10:20.548640 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:20.550756 20036 webserver.cc:533] Webserver started at http://127.19.145.1:46379/ using document root <none> and password file <none>
I20260709 13:10:20.551170 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:20.551419 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:20.551623 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:20.552702 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "da91ca65cc9b45daa7e18617fb85a687"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.557173 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:20.560281 29369 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.560966 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:20.561235 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "da91ca65cc9b45daa7e18617fb85a687"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.561463 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:20.582607 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:20.583784 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:20.585109 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:20.587316 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:20.587500 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.587791 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:20.587962 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.626682 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:40975
I20260709 13:10:20.626786 29431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:40975 every 8 connection(s)
I20260709 13:10:20.631759 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:20.638579 29436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.639004 29437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.641745 20036 server_base.cc:1061] running on GCE node
W20260709 13:10:20.642989 29440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.643726 29432 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38497
I20260709 13:10:20.644094 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:20.644127 29432 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:20.644460 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:20.644659 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602620644644 us; error 0 us; skew 500 ppm
I20260709 13:10:20.645098 29432 heartbeater.cc:507] Master 127.19.145.62:38497 requested a full tablet report, sending...
I20260709 13:10:20.645259 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:20.647300 29305 ts_manager.cc:194] Registered new tserver with Master: da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975)
I20260709 13:10:20.647928 20036 webserver.cc:533] Webserver started at http://127.19.145.2:37985/ using document root <none> and password file <none>
I20260709 13:10:20.648447 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:20.648648 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:20.648905 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:20.649276 29305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33372
I20260709 13:10:20.650121 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "4160c094ee354782ac760fa16537dbfe"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.654764 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:10:20.657895 29444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.658604 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:20.658885 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "4160c094ee354782ac760fa16537dbfe"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.659152 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:20.669791 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:20.670969 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:20.672394 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:20.674429 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:20.674652 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.674875 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:20.675033 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.714075 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:41809
I20260709 13:10:20.714169 29506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:41809 every 8 connection(s)
I20260709 13:10:20.719026 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:20.726482 29510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.727535 29511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:20.728626 29513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:20.729682 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:20.730715 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:20.730939 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:20.731142 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602620731124 us; error 0 us; skew 500 ppm
I20260709 13:10:20.731839 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:20.733942 29507 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38497
I20260709 13:10:20.734377 29507 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:20.734529 20036 webserver.cc:533] Webserver started at http://127.19.145.3:33689/ using document root <none> and password file <none>
I20260709 13:10:20.735118 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:20.735351 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:20.735231 29507 heartbeater.cc:507] Master 127.19.145.62:38497 requested a full tablet report, sending...
I20260709 13:10:20.735841 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:20.737151 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.737689 29305 ts_manager.cc:194] Registered new tserver with Master: 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809)
I20260709 13:10:20.739056 29305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33374
I20260709 13:10:20.741747 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:20.745030 29518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.745700 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:20.745986 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
format_stamp: "Formatted at 2026-07-09 13:10:20 on dist-test-slave-cd6k"
I20260709 13:10:20.746268 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:20.767916 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:20.769022 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:20.770462 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:20.772666 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:20.772881 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.773128 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:20.773295 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:20.811920 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:41853
I20260709 13:10:20.812016 29580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:41853 every 8 connection(s)
I20260709 13:10:20.824747 29581 heartbeater.cc:344] Connected to a master server at 127.19.145.62:38497
I20260709 13:10:20.825124 29581 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:20.825748 29581 heartbeater.cc:507] Master 127.19.145.62:38497 requested a full tablet report, sending...
I20260709 13:10:20.827526 29305 ts_manager.cc:194] Registered new tserver with Master: e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:20.828330 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013260724s
I20260709 13:10:20.828869 29305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33384
I20260709 13:10:20.851172 29305 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:20.853289 29305 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:20.890998 29472 tablet_service.cc:1511] Processing CreateTablet for tablet 05e3511a977c4df29cc2bceef1323097 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:20.892473 29472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e3511a977c4df29cc2bceef1323097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.893976 29471 tablet_service.cc:1511] Processing CreateTablet for tablet 736bd9c358d64adcae87e4227cd7b5ed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:20.895354 29471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736bd9c358d64adcae87e4227cd7b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.896384 29546 tablet_service.cc:1511] Processing CreateTablet for tablet 05e3511a977c4df29cc2bceef1323097 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:20.897689 29546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e3511a977c4df29cc2bceef1323097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.905870 29545 tablet_service.cc:1511] Processing CreateTablet for tablet 736bd9c358d64adcae87e4227cd7b5ed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:20.906131 29397 tablet_service.cc:1511] Processing CreateTablet for tablet 05e3511a977c4df29cc2bceef1323097 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:20.907143 29545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736bd9c358d64adcae87e4227cd7b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.907469 29397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e3511a977c4df29cc2bceef1323097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.910204 29396 tablet_service.cc:1511] Processing CreateTablet for tablet 736bd9c358d64adcae87e4227cd7b5ed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=73890f1d364b4e018b8199f4dad43e53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:20.911480 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736bd9c358d64adcae87e4227cd7b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.940189 29596 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: Bootstrap starting.
I20260709 13:10:20.941937 29598 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: Bootstrap starting.
I20260709 13:10:20.941622 29597 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: Bootstrap starting.
I20260709 13:10:20.947458 29598 tablet_bootstrap.cc:654] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.949463 29597 tablet_bootstrap.cc:654] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.949463 29596 tablet_bootstrap.cc:654] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.953514 29598 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: No bootstrap required, opened a new log
I20260709 13:10:20.954002 29598 ts_tablet_manager.cc:1403] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:10:20.955400 29596 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: No bootstrap required, opened a new log
I20260709 13:10:20.955873 29596 ts_tablet_manager.cc:1403] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:10:20.956362 29597 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: No bootstrap required, opened a new log
I20260709 13:10:20.956881 29597 ts_tablet_manager.cc:1403] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:10:20.956722 29598 raft_consensus.cc:359] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.957479 29598 raft_consensus.cc:385] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.957747 29598 raft_consensus.cc:740] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.958401 29598 consensus_queue.cc:260] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.958766 29596 raft_consensus.cc:359] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:20.959705 29596 raft_consensus.cc:385] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.960155 29596 raft_consensus.cc:740] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.959718 29597 raft_consensus.cc:359] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.960989 29432 heartbeater.cc:499] Master 127.19.145.62:38497 was elected leader, sending a full tablet report...
I20260709 13:10:20.961185 29598 ts_tablet_manager.cc:1434] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:20.961160 29596 consensus_queue.cc:260] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:20.962239 29598 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: Bootstrap starting.
I20260709 13:10:20.963907 29596 ts_tablet_manager.cc:1434] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:20.964295 29507 heartbeater.cc:499] Master 127.19.145.62:38497 was elected leader, sending a full tablet report...
I20260709 13:10:20.965912 29596 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: Bootstrap starting.
I20260709 13:10:20.969343 29598 tablet_bootstrap.cc:654] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.973053 29597 raft_consensus.cc:385] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.973830 29597 raft_consensus.cc:740] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.974153 29596 tablet_bootstrap.cc:654] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.974797 29597 consensus_queue.cc:260] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.983383 29581 heartbeater.cc:499] Master 127.19.145.62:38497 was elected leader, sending a full tablet report...
I20260709 13:10:20.983731 29596 tablet_bootstrap.cc:492] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: No bootstrap required, opened a new log
I20260709 13:10:20.984272 29596 ts_tablet_manager.cc:1403] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:10:20.984329 29597 ts_tablet_manager.cc:1434] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: Time spent starting tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:10:20.984462 29598 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: No bootstrap required, opened a new log
I20260709 13:10:20.985168 29598 ts_tablet_manager.cc:1403] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:10:20.985603 29597 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: Bootstrap starting.
I20260709 13:10:20.987594 29596 raft_consensus.cc:359] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.988409 29596 raft_consensus.cc:385] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.988247 29598 raft_consensus.cc:359] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:20.988870 29596 raft_consensus.cc:740] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.989216 29598 raft_consensus.cc:385] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.989670 29598 raft_consensus.cc:740] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.989966 29596 consensus_queue.cc:260] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:20.990451 29598 consensus_queue.cc:260] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:20.992946 29597 tablet_bootstrap.cc:654] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.995529 29596 ts_tablet_manager.cc:1434] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:10:20.993008 29598 ts_tablet_manager.cc:1434] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:20.998699 29603 raft_consensus.cc:493] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.999154 29603 raft_consensus.cc:515] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:20.999742 29597 tablet_bootstrap.cc:492] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: No bootstrap required, opened a new log
I20260709 13:10:21.000238 29597 ts_tablet_manager.cc:1403] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:10:21.001883 29603 leader_election.cc:290] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:21.003134 29597 raft_consensus.cc:359] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.003902 29597 raft_consensus.cc:385] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.004186 29597 raft_consensus.cc:740] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.004999 29597 consensus_queue.cc:260] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.007320 29597 ts_tablet_manager.cc:1434] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:21.018186 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736bd9c358d64adcae87e4227cd7b5ed" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" is_pre_election: true
I20260709 13:10:21.018668 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736bd9c358d64adcae87e4227cd7b5ed" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687" is_pre_election: true
I20260709 13:10:21.018774 29556 raft_consensus.cc:2468] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 0.
I20260709 13:10:21.019296 29407 raft_consensus.cc:2468] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 0.
I20260709 13:10:21.019888 29446 leader_election.cc:304] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:21.020583 29603 raft_consensus.cc:2804] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:21.020901 29603 raft_consensus.cc:493] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.021186 29603 raft_consensus.cc:3060] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.026043 29603 raft_consensus.cc:515] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.027586 29603 leader_election.cc:290] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 election: Requested vote from peers da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:21.028275 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736bd9c358d64adcae87e4227cd7b5ed" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
I20260709 13:10:21.028367 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736bd9c358d64adcae87e4227cd7b5ed" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
I20260709 13:10:21.028811 29407 raft_consensus.cc:3060] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.028911 29556 raft_consensus.cc:3060] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.033841 29407 raft_consensus.cc:2468] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 1.
I20260709 13:10:21.034087 29556 raft_consensus.cc:2468] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 1.
I20260709 13:10:21.034821 29446 leader_election.cc:304] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, da91ca65cc9b45daa7e18617fb85a687; no voters: 
I20260709 13:10:21.035589 29603 raft_consensus.cc:2804] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.036548 29603 raft_consensus.cc:697] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Becoming Leader. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Running, Role: LEADER
I20260709 13:10:21.037177 29603 consensus_queue.cc:237] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.043771 29302 catalog_manager.cc:5697] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4160c094ee354782ac760fa16537dbfe (127.19.145.2). New cstate: current_term: 1 leader_uuid: "4160c094ee354782ac760fa16537dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.110312 29603 raft_consensus.cc:493] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.110836 29603 raft_consensus.cc:515] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:21.112469 29603 leader_election.cc:290] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853), da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975)
I20260709 13:10:21.113227 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" is_pre_election: true
I20260709 13:10:21.113379 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687" is_pre_election: true
I20260709 13:10:21.113828 29556 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 0.
I20260709 13:10:21.113997 29407 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 0.
I20260709 13:10:21.114764 29446 leader_election.cc:304] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:21.115387 29603 raft_consensus.cc:2804] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:21.115689 29603 raft_consensus.cc:493] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.115957 29603 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.120596 29603 raft_consensus.cc:515] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:21.122013 29603 leader_election.cc:290] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 election: Requested vote from peers e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853), da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975)
I20260709 13:10:21.122663 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
I20260709 13:10:21.122951 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "4160c094ee354782ac760fa16537dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
I20260709 13:10:21.123281 29556 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.123530 29407 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.130012 29407 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 1.
I20260709 13:10:21.130012 29556 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4160c094ee354782ac760fa16537dbfe in term 1.
I20260709 13:10:21.131187 29446 leader_election.cc:304] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:21.132023 29603 raft_consensus.cc:2804] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.132438 29603 raft_consensus.cc:697] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Becoming Leader. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Running, Role: LEADER
I20260709 13:10:21.133141 29603 consensus_queue.cc:237] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:21.138959 29302 catalog_manager.cc:5697] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4160c094ee354782ac760fa16537dbfe (127.19.145.2). New cstate: current_term: 1 leader_uuid: "4160c094ee354782ac760fa16537dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.173152 29302 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33404:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:21.175575 29302 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:21.198015 29397 tablet_service.cc:1511] Processing CreateTablet for tablet 237d5d6fb2174f45925cc1d0ffe0486c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:21.199337 29397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237d5d6fb2174f45925cc1d0ffe0486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.199214 29471 tablet_service.cc:1511] Processing CreateTablet for tablet 237d5d6fb2174f45925cc1d0ffe0486c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:21.200587 29471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237d5d6fb2174f45925cc1d0ffe0486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.200778 29546 tablet_service.cc:1511] Processing CreateTablet for tablet 237d5d6fb2174f45925cc1d0ffe0486c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:21.202014 29546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237d5d6fb2174f45925cc1d0ffe0486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.202356 29396 tablet_service.cc:1511] Processing CreateTablet for tablet 9408a10799e54e2d8530f0142c4a493c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:21.203657 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9408a10799e54e2d8530f0142c4a493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.203815 29472 tablet_service.cc:1511] Processing CreateTablet for tablet 9408a10799e54e2d8530f0142c4a493c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:21.205029 29472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9408a10799e54e2d8530f0142c4a493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.213112 29545 tablet_service.cc:1511] Processing CreateTablet for tablet 9408a10799e54e2d8530f0142c4a493c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c334e156b4043e58732b3999734ec5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:21.214383 29545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9408a10799e54e2d8530f0142c4a493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.217936 29596 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: Bootstrap starting.
I20260709 13:10:21.224156 29596 tablet_bootstrap.cc:654] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.229252 29598 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: Bootstrap starting.
I20260709 13:10:21.229869 29597 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: Bootstrap starting.
I20260709 13:10:21.232579 29596 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: No bootstrap required, opened a new log
I20260709 13:10:21.233108 29596 ts_tablet_manager.cc:1403] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:10:21.235616 29598 tablet_bootstrap.cc:654] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.236196 29596 raft_consensus.cc:359] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.237003 29596 raft_consensus.cc:385] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.237315 29596 raft_consensus.cc:740] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.238039 29596 consensus_queue.cc:260] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.236690 29597 tablet_bootstrap.cc:654] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.240212 29596 ts_tablet_manager.cc:1434] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:21.241175 29596 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: Bootstrap starting.
I20260709 13:10:21.243341 29598 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: No bootstrap required, opened a new log
I20260709 13:10:21.243892 29598 ts_tablet_manager.cc:1403] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:10:21.246821 29598 raft_consensus.cc:359] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.247561 29598 raft_consensus.cc:385] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.247999 29598 raft_consensus.cc:740] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.248663 29596 tablet_bootstrap.cc:654] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.248893 29598 consensus_queue.cc:260] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.254980 29598 ts_tablet_manager.cc:1434] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:21.256815 29598 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: Bootstrap starting.
I20260709 13:10:21.263602 29598 tablet_bootstrap.cc:654] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.269101 29597 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: No bootstrap required, opened a new log
I20260709 13:10:21.269624 29597 ts_tablet_manager.cc:1403] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.015s
I20260709 13:10:21.270464 29596 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: No bootstrap required, opened a new log
I20260709 13:10:21.270957 29596 ts_tablet_manager.cc:1403] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.000s
I20260709 13:10:21.272509 29597 raft_consensus.cc:359] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.272782 29598 tablet_bootstrap.cc:492] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: No bootstrap required, opened a new log
I20260709 13:10:21.273115 29597 raft_consensus.cc:385] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.273367 29598 ts_tablet_manager.cc:1403] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 13:10:21.273437 29597 raft_consensus.cc:740] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.273808 29596 raft_consensus.cc:359] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.274545 29596 raft_consensus.cc:385] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.274391 29597 consensus_queue.cc:260] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.274873 29596 raft_consensus.cc:740] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.275900 29596 consensus_queue.cc:260] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.276598 29597 ts_tablet_manager.cc:1434] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:21.276399 29598 raft_consensus.cc:359] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.277133 29598 raft_consensus.cc:385] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.277951 29596 ts_tablet_manager.cc:1434] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:21.278590 29598 raft_consensus.cc:740] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.279706 29597 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Bootstrap starting.
I20260709 13:10:21.279449 29598 consensus_queue.cc:260] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.282066 29598 ts_tablet_manager.cc:1434] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:21.290910 29597 tablet_bootstrap.cc:654] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.294994 29597 tablet_bootstrap.cc:492] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: No bootstrap required, opened a new log
I20260709 13:10:21.295395 29597 ts_tablet_manager.cc:1403] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:10:21.297367 29597 raft_consensus.cc:359] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.297883 29597 raft_consensus.cc:385] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.298110 29597 raft_consensus.cc:740] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.298681 29597 consensus_queue.cc:260] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.300503 29597 ts_tablet_manager.cc:1434] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:21.425235 29603 consensus_queue.cc:1048] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.435547 29603 consensus_queue.cc:1048] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:21.450662 29604 raft_consensus.cc:493] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.451117 29604 raft_consensus.cc:515] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.453058 29604 leader_election.cc:290] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975), 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809)
I20260709 13:10:21.464352 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687" is_pre_election: true
I20260709 13:10:21.464636 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4160c094ee354782ac760fa16537dbfe" is_pre_election: true
I20260709 13:10:21.465123 29407 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 0.
I20260709 13:10:21.465257 29482 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 0.
W20260709 13:10:21.465538 29353 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:21.466415 29520 leader_election.cc:304] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da91ca65cc9b45daa7e18617fb85a687, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:21.467135 29604 raft_consensus.cc:2804] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:21.467540 29604 raft_consensus.cc:493] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.467813 29604 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.472745 29604 raft_consensus.cc:515] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.474259 29604 leader_election.cc:290] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 1 election: Requested vote from peers da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975), 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809)
I20260709 13:10:21.474957 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
I20260709 13:10:21.475178 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4160c094ee354782ac760fa16537dbfe"
I20260709 13:10:21.475534 29407 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.475762 29482 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.480196 29407 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 1.
I20260709 13:10:21.480618 29482 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 1.
I20260709 13:10:21.481128 29520 leader_election.cc:304] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da91ca65cc9b45daa7e18617fb85a687, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:21.481925 29604 raft_consensus.cc:2804] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.482872 29604 raft_consensus.cc:697] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 LEADER]: Becoming Leader. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Running, Role: LEADER
I20260709 13:10:21.483708 29604 consensus_queue.cc:237] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.489857 29305 catalog_manager.cc:5697] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3). New cstate: current_term: 1 leader_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.518266 29603 consensus_queue.cc:1048] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.528329 29603 consensus_queue.cc:1048] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.717093 29602 raft_consensus.cc:493] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.717509 29602 raft_consensus.cc:515] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.719396 29602 leader_election.cc:290] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:21.729336 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237d5d6fb2174f45925cc1d0ffe0486c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4160c094ee354782ac760fa16537dbfe" is_pre_election: true
I20260709 13:10:21.729741 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237d5d6fb2174f45925cc1d0ffe0486c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" is_pre_election: true
I20260709 13:10:21.729971 29482 raft_consensus.cc:2468] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 0.
I20260709 13:10:21.730369 29556 raft_consensus.cc:2468] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 0.
I20260709 13:10:21.731074 29370 leader_election.cc:304] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, da91ca65cc9b45daa7e18617fb85a687; no voters: 
I20260709 13:10:21.731943 29602 raft_consensus.cc:2804] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:21.732264 29602 raft_consensus.cc:493] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.732481 29602 raft_consensus.cc:3060] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.737272 29602 raft_consensus.cc:515] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.739032 29602 leader_election.cc:290] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 1 election: Requested vote from peers 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:21.739655 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237d5d6fb2174f45925cc1d0ffe0486c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4160c094ee354782ac760fa16537dbfe"
I20260709 13:10:21.740113 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237d5d6fb2174f45925cc1d0ffe0486c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
I20260709 13:10:21.740286 29482 raft_consensus.cc:3060] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.740684 29556 raft_consensus.cc:3060] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.747119 29556 raft_consensus.cc:2468] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 1.
I20260709 13:10:21.747119 29482 raft_consensus.cc:2468] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 1.
I20260709 13:10:21.748299 29370 leader_election.cc:304] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, da91ca65cc9b45daa7e18617fb85a687; no voters: 
I20260709 13:10:21.748946 29602 raft_consensus.cc:2804] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.749715 29602 raft_consensus.cc:697] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 1 LEADER]: Becoming Leader. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Running, Role: LEADER
I20260709 13:10:21.750383 29602 consensus_queue.cc:237] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.756469 29304 catalog_manager.cc:5697] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 reported cstate change: term changed from 0 to 1, leader changed from <none> to da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "da91ca65cc9b45daa7e18617fb85a687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.827735 29482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097"
dest_uuid: "4160c094ee354782ac760fa16537dbfe"
mode: GRACEFUL
new_leader_uuid: "da91ca65cc9b45daa7e18617fb85a687"
 from {username='slave'} at 127.0.0.1:53586
I20260709 13:10:21.828181 29482 raft_consensus.cc:606] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Received request to transfer leadership to TS da91ca65cc9b45daa7e18617fb85a687
I20260709 13:10:21.844022 29556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c"
dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
mode: GRACEFUL
new_leader_uuid: "da91ca65cc9b45daa7e18617fb85a687"
 from {username='slave'} at 127.0.0.1:58200
I20260709 13:10:21.844463 29556 raft_consensus.cc:606] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 LEADER]: Received request to transfer leadership to TS da91ca65cc9b45daa7e18617fb85a687
I20260709 13:10:21.941668 29604 consensus_queue.cc:1048] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.947683 29632 raft_consensus.cc:993] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: : Instructing follower da91ca65cc9b45daa7e18617fb85a687 to start an election
I20260709 13:10:21.948469 29604 raft_consensus.cc:1081] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 LEADER]: Signalling peer da91ca65cc9b45daa7e18617fb85a687 to start an election
I20260709 13:10:21.950991 29406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c"
dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
 from {username='slave'} at 127.0.0.1:60278
I20260709 13:10:21.951570 29406 raft_consensus.cc:493] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.951938 29406 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.953693 29643 consensus_queue.cc:1048] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.958923 29406 raft_consensus.cc:515] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.962239 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4160c094ee354782ac760fa16537dbfe"
I20260709 13:10:21.964218 29406 leader_election.cc:290] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 2 election: Requested vote from peers 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:21.966490 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
I20260709 13:10:21.968142 29556 raft_consensus.cc:3055] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.968351 29556 raft_consensus.cc:740] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Running, Role: LEADER
I20260709 13:10:21.969152 29556 consensus_queue.cc:260] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.970203 29556 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.977053 29556 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 2.
I20260709 13:10:21.978179 29371 leader_election.cc:304] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da91ca65cc9b45daa7e18617fb85a687, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 4160c094ee354782ac760fa16537dbfe
I20260709 13:10:21.978911 29602 raft_consensus.cc:2804] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.979373 29602 raft_consensus.cc:697] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Becoming Leader. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Running, Role: LEADER
I20260709 13:10:21.980161 29602 consensus_queue.cc:237] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:21.986030 29305 catalog_manager.cc:5697] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 reported cstate change: term changed from 1 to 2, leader changed from e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3) to da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "da91ca65cc9b45daa7e18617fb85a687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.024962 29603 raft_consensus.cc:993] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: : Instructing follower da91ca65cc9b45daa7e18617fb85a687 to start an election
I20260709 13:10:22.025475 29603 raft_consensus.cc:1081] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Signalling peer da91ca65cc9b45daa7e18617fb85a687 to start an election
I20260709 13:10:22.027017 29406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097"
dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
 from {username='slave'} at 127.0.0.1:60276
I20260709 13:10:22.027612 29406 raft_consensus.cc:493] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.028013 29406 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.032763 29406 raft_consensus.cc:515] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:22.034970 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4160c094ee354782ac760fa16537dbfe"
I20260709 13:10:22.035408 29556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e3511a977c4df29cc2bceef1323097" candidate_uuid: "da91ca65cc9b45daa7e18617fb85a687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
I20260709 13:10:22.035620 29482 raft_consensus.cc:3055] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.034432 29406 leader_election.cc:290] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 2 election: Requested vote from peers 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809), e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3:41853)
I20260709 13:10:22.036031 29482 raft_consensus.cc:740] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4160c094ee354782ac760fa16537dbfe, State: Running, Role: LEADER
I20260709 13:10:22.036028 29556 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.037009 29482 consensus_queue.cc:260] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:22.038210 29482 raft_consensus.cc:3060] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.041121 29556 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 2.
I20260709 13:10:22.042162 29371 leader_election.cc:304] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da91ca65cc9b45daa7e18617fb85a687, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:22.042824 29602 raft_consensus.cc:2804] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.042851 29482 raft_consensus.cc:2468] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da91ca65cc9b45daa7e18617fb85a687 in term 2.
I20260709 13:10:22.043454 29602 raft_consensus.cc:697] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Becoming Leader. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Running, Role: LEADER
I20260709 13:10:22.044250 29602 consensus_queue.cc:237] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } }
I20260709 13:10:22.049821 29305 catalog_manager.cc:5697] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 reported cstate change: term changed from 1 to 2, leader changed from 4160c094ee354782ac760fa16537dbfe (127.19.145.2) to da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "da91ca65cc9b45daa7e18617fb85a687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.120149 20036 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:22.121645 20036 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:22.122051 20036 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:22.132886 29406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c"
dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
mode: GRACEFUL
new_leader_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:22.133389 29406 raft_consensus.cc:606] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Received request to transfer leadership to TS e7a5b409c8e64ea499059ed269d0b3fd
I20260709 13:10:22.134394 20036 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:22.272619 29602 consensus_queue.cc:1048] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:22.282958 29648 consensus_queue.cc:1048] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:22.385236 29482 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.391000 29482 raft_consensus.cc:1275] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Refusing update from remote peer da91ca65cc9b45daa7e18617fb85a687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.392220 29648 consensus_queue.cc:1048] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.397495 29556 raft_consensus.cc:1275] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Refusing update from remote peer da91ca65cc9b45daa7e18617fb85a687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.399016 29602 consensus_queue.cc:1048] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.405550 29602 raft_consensus.cc:993] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: : Instructing follower e7a5b409c8e64ea499059ed269d0b3fd to start an election
I20260709 13:10:22.405956 29602 raft_consensus.cc:1081] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Signalling peer e7a5b409c8e64ea499059ed269d0b3fd to start an election
I20260709 13:10:22.407395 29556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c"
dest_uuid: "e7a5b409c8e64ea499059ed269d0b3fd"
 from {username='slave'} at 127.0.0.1:58196
I20260709 13:10:22.407850 29556 raft_consensus.cc:493] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.408156 29556 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.412874 29556 raft_consensus.cc:515] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:22.414382 29556 leader_election.cc:290] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 3 election: Requested vote from peers da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1:40975), 4160c094ee354782ac760fa16537dbfe (127.19.145.2:41809)
I20260709 13:10:22.415278 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da91ca65cc9b45daa7e18617fb85a687"
I20260709 13:10:22.415465 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9408a10799e54e2d8530f0142c4a493c" candidate_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4160c094ee354782ac760fa16537dbfe"
I20260709 13:10:22.415957 29406 raft_consensus.cc:3055] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.416086 29482 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.416318 29406 raft_consensus.cc:740] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da91ca65cc9b45daa7e18617fb85a687, State: Running, Role: LEADER
I20260709 13:10:22.417176 29406 consensus_queue.cc:260] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:22.418151 29406 raft_consensus.cc:3060] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.421870 29482 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 3.
I20260709 13:10:22.423058 29406 raft_consensus.cc:2468] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7a5b409c8e64ea499059ed269d0b3fd in term 3.
I20260709 13:10:22.423059 29519 leader_election.cc:304] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4160c094ee354782ac760fa16537dbfe, e7a5b409c8e64ea499059ed269d0b3fd; no voters: 
I20260709 13:10:22.424124 29643 raft_consensus.cc:2804] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.424633 29643 raft_consensus.cc:697] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 LEADER]: Becoming Leader. State: Replica: e7a5b409c8e64ea499059ed269d0b3fd, State: Running, Role: LEADER
I20260709 13:10:22.425323 29643 consensus_queue.cc:237] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } }
I20260709 13:10:22.430567 29304 catalog_manager.cc:5697] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd reported cstate change: term changed from 2 to 3, leader changed from da91ca65cc9b45daa7e18617fb85a687 (127.19.145.1) to e7a5b409c8e64ea499059ed269d0b3fd (127.19.145.3). New cstate: current_term: 3 leader_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da91ca65cc9b45daa7e18617fb85a687" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.474004 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:10:22.476094 29556 raft_consensus.cc:1275] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Refusing update from remote peer da91ca65cc9b45daa7e18617fb85a687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.477564 29602 consensus_queue.cc:1048] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a5b409c8e64ea499059ed269d0b3fd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.492947 29482 raft_consensus.cc:1275] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Refusing update from remote peer da91ca65cc9b45daa7e18617fb85a687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.494412 29648 consensus_queue.cc:1048] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4160c094ee354782ac760fa16537dbfe" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.508610 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:22.509236 20036 tablet_replica.cc:333] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687: stopping tablet replica
I20260709 13:10:22.509879 20036 raft_consensus.cc:2243] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:22.510643 20036 raft_consensus.cc:2272] T 237d5d6fb2174f45925cc1d0ffe0486c P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.513155 20036 tablet_replica.cc:333] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687: stopping tablet replica
I20260709 13:10:22.513707 20036 raft_consensus.cc:2243] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.514104 20036 raft_consensus.cc:2272] T 9408a10799e54e2d8530f0142c4a493c P da91ca65cc9b45daa7e18617fb85a687 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.516441 20036 tablet_replica.cc:333] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687: stopping tablet replica
I20260709 13:10:22.516939 20036 raft_consensus.cc:2243] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.517349 20036 raft_consensus.cc:2272] T 736bd9c358d64adcae87e4227cd7b5ed P da91ca65cc9b45daa7e18617fb85a687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.518937 20036 tablet_replica.cc:333] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687: stopping tablet replica
I20260709 13:10:22.519441 20036 raft_consensus.cc:2243] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:22.520174 20036 raft_consensus.cc:2272] T 05e3511a977c4df29cc2bceef1323097 P da91ca65cc9b45daa7e18617fb85a687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.542104 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
I20260709 13:10:22.553220 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
I20260709 13:10:22.571303 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:22.571933 20036 tablet_replica.cc:333] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe: stopping tablet replica
I20260709 13:10:22.572455 20036 raft_consensus.cc:2243] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.572903 20036 raft_consensus.cc:2272] T 9408a10799e54e2d8530f0142c4a493c P 4160c094ee354782ac760fa16537dbfe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.574981 20036 tablet_replica.cc:333] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe: stopping tablet replica
I20260709 13:10:22.575546 20036 raft_consensus.cc:2243] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.575953 20036 raft_consensus.cc:2272] T 237d5d6fb2174f45925cc1d0ffe0486c P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.578436 20036 tablet_replica.cc:333] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe: stopping tablet replica
I20260709 13:10:22.578931 20036 raft_consensus.cc:2243] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.579387 20036 raft_consensus.cc:2272] T 05e3511a977c4df29cc2bceef1323097 P 4160c094ee354782ac760fa16537dbfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.581315 20036 tablet_replica.cc:333] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe: stopping tablet replica
I20260709 13:10:22.581786 20036 raft_consensus.cc:2243] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:22.582475 20036 raft_consensus.cc:2272] T 736bd9c358d64adcae87e4227cd7b5ed P 4160c094ee354782ac760fa16537dbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.603720 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
I20260709 13:10:22.614847 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:10:22.631172 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:22.631778 20036 tablet_replica.cc:333] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: stopping tablet replica
I20260709 13:10:22.632342 20036 raft_consensus.cc:2243] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:22.633100 20036 pending_rounds.cc:70] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Trying to abort 1 pending ops.
I20260709 13:10:22.633253 20036 pending_rounds.cc:77] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636341460471808 op_type: NO_OP noop_request { }
I20260709 13:10:22.633528 20036 raft_consensus.cc:2889] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:22.633750 20036 raft_consensus.cc:2272] T 9408a10799e54e2d8530f0142c4a493c P e7a5b409c8e64ea499059ed269d0b3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.635691 20036 tablet_replica.cc:333] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd: stopping tablet replica
I20260709 13:10:22.636123 20036 raft_consensus.cc:2243] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.636456 20036 raft_consensus.cc:2272] T 237d5d6fb2174f45925cc1d0ffe0486c P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.638335 20036 tablet_replica.cc:333] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd: stopping tablet replica
I20260709 13:10:22.638752 20036 raft_consensus.cc:2243] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.639084 20036 raft_consensus.cc:2272] T 736bd9c358d64adcae87e4227cd7b5ed P e7a5b409c8e64ea499059ed269d0b3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.640638 20036 tablet_replica.cc:333] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd: stopping tablet replica
I20260709 13:10:22.641196 20036 raft_consensus.cc:2243] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:22.641609 20036 raft_consensus.cc:2272] T 05e3511a977c4df29cc2bceef1323097 P e7a5b409c8e64ea499059ed269d0b3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.653124 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:10:22.663857 20036 master.cc:562] Master@127.19.145.62:38497 shutting down...
I20260709 13:10:22.679406 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:22.679883 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:22.680186 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P c9d8286f2d914a72ac645d9e877f94af: stopping tablet replica
I20260709 13:10:22.697917 20036 master.cc:584] Master@127.19.145.62:38497 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2378 ms)
[----------] 6 tests from LeaderRebalancerTest (284503 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:22.723582 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:39789
I20260709 13:10:22.724540 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.729176 29650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.729185 29651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.731725 29653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.731791 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:22.732833 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.733021 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.733179 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602622733148 us; error 0 us; skew 500 ppm
I20260709 13:10:22.733708 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.735881 20036 webserver.cc:533] Webserver started at http://127.19.145.62:37909/ using document root <none> and password file <none>
I20260709 13:10:22.736330 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.736537 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.736797 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.737811 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "517d2a4d58c345fc838481b249034ae2"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-cd6k"
I20260709 13:10:22.742779 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:22.745813 29658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.746533 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:22.746819 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "517d2a4d58c345fc838481b249034ae2"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-cd6k"
I20260709 13:10:22.747089 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.761060 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.762017 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.799165 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:39789
I20260709 13:10:22.799321 29709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:39789 every 8 connection(s)
I20260709 13:10:22.802773 29710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.813181 29710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: Bootstrap starting.
I20260709 13:10:22.817485 29710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.821136 29710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: No bootstrap required, opened a new log
I20260709 13:10:22.823043 29710 raft_consensus.cc:359] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER }
I20260709 13:10:22.823500 29710 raft_consensus.cc:385] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.823727 29710 raft_consensus.cc:740] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517d2a4d58c345fc838481b249034ae2, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.824314 29710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER }
I20260709 13:10:22.824750 29710 raft_consensus.cc:399] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:22.824973 29710 raft_consensus.cc:493] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:22.825237 29710 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.829445 29710 raft_consensus.cc:515] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER }
I20260709 13:10:22.829905 29710 leader_election.cc:304] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 517d2a4d58c345fc838481b249034ae2; no voters: 
I20260709 13:10:22.830929 29710 leader_election.cc:290] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:22.831215 29713 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.832516 29713 raft_consensus.cc:697] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 1 LEADER]: Becoming Leader. State: Replica: 517d2a4d58c345fc838481b249034ae2, State: Running, Role: LEADER
I20260709 13:10:22.833106 29713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER }
I20260709 13:10:22.833743 29710 sys_catalog.cc:565] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:22.835875 29714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "517d2a4d58c345fc838481b249034ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER } }
I20260709 13:10:22.835973 29715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 517d2a4d58c345fc838481b249034ae2. Latest consensus state: current_term: 1 leader_uuid: "517d2a4d58c345fc838481b249034ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d2a4d58c345fc838481b249034ae2" member_type: VOTER } }
I20260709 13:10:22.836557 29714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:22.836637 29715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:22.840940 29719 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:22.845518 29719 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:22.849655 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:22.853863 29719 catalog_manager.cc:1383] Generated new cluster ID: 52135a2e9a14477d9ae850d5b012a5fa
I20260709 13:10:22.854104 29719 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:22.879992 29719 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:22.881119 29719 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:22.892761 29719 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: Generated new TSK 0
I20260709 13:10:22.893265 29719 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:22.915560 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.920883 29731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.922039 29732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.923801 20036 server_base.cc:1061] running on GCE node
W20260709 13:10:22.923990 29734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.924930 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.925140 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.925333 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602622925312 us; error 0 us; skew 500 ppm
I20260709 13:10:22.925873 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.928085 20036 webserver.cc:533] Webserver started at http://127.19.145.1:36415/ using document root <none> and password file <none>
I20260709 13:10:22.928556 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.928747 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.929016 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.930012 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "81f8147af9ea4940b06921d63f8c233b"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-cd6k"
I20260709 13:10:22.934178 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:22.937350 29739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.938072 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:10:22.938357 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "81f8147af9ea4940b06921d63f8c233b"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-cd6k"
I20260709 13:10:22.938629 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.956291 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.957423 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.958745 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.960894 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.961099 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.961338 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.961504 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.998195 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:34711
I20260709 13:10:22.998284 29801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:34711 every 8 connection(s)
I20260709 13:10:23.003082 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:23.009796 29806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:23.010733 29807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:23.013769 29809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:23.014784 29802 heartbeater.cc:344] Connected to a master server at 127.19.145.62:39789
I20260709 13:10:23.014945 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:23.015273 29802 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:23.016032 29802 heartbeater.cc:507] Master 127.19.145.62:39789 requested a full tablet report, sending...
I20260709 13:10:23.016467 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:23.016713 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:23.016909 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602623016892 us; error 0 us; skew 500 ppm
I20260709 13:10:23.017462 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:23.018004 29675 ts_manager.cc:194] Registered new tserver with Master: 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711)
I20260709 13:10:23.019812 20036 webserver.cc:533] Webserver started at http://127.19.145.2:38007/ using document root <none> and password file <none>
I20260709 13:10:23.020243 29675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38056
I20260709 13:10:23.020346 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:23.020690 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:23.020977 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:23.022075 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "22057d0d84e640a4ba52bbae0dc74494"
format_stamp: "Formatted at 2026-07-09 13:10:23 on dist-test-slave-cd6k"
I20260709 13:10:23.026136 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:10:23.029260 29814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.030345 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:23.030716 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "22057d0d84e640a4ba52bbae0dc74494"
format_stamp: "Formatted at 2026-07-09 13:10:23 on dist-test-slave-cd6k"
I20260709 13:10:23.031086 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:23.044230 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:23.045509 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:23.047465 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:23.051003 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:23.051272 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.051553 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:23.051761 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.096925 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:34575
I20260709 13:10:23.097018 29876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:34575 every 8 connection(s)
I20260709 13:10:23.101634 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:23.108507 29880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:23.110023 29881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:23.112044 29883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:23.113070 29877 heartbeater.cc:344] Connected to a master server at 127.19.145.62:39789
I20260709 13:10:23.113386 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:23.113547 29877 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:23.114476 29877 heartbeater.cc:507] Master 127.19.145.62:39789 requested a full tablet report, sending...
I20260709 13:10:23.114476 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:23.114928 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:23.115136 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602623115118 us; error 0 us; skew 500 ppm
I20260709 13:10:23.115895 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:23.116652 29675 ts_manager.cc:194] Registered new tserver with Master: 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:23.118314 20036 webserver.cc:533] Webserver started at http://127.19.145.3:33933/ using document root <none> and password file <none>
I20260709 13:10:23.118338 29675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38068
I20260709 13:10:23.118928 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:23.119191 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:23.119553 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:23.120968 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "9a237313f4d54a58bf56170293a10edd"
format_stamp: "Formatted at 2026-07-09 13:10:23 on dist-test-slave-cd6k"
I20260709 13:10:23.125216 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:23.128125 29888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.128887 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:23.129166 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "9a237313f4d54a58bf56170293a10edd"
format_stamp: "Formatted at 2026-07-09 13:10:23 on dist-test-slave-cd6k"
I20260709 13:10:23.129449 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:23.143585 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:23.144843 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:23.146160 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:23.148356 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:23.148552 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.148821 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:23.148980 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:23.197021 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:46267
I20260709 13:10:23.197118 29950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:46267 every 8 connection(s)
I20260709 13:10:23.210083 29951 heartbeater.cc:344] Connected to a master server at 127.19.145.62:39789
I20260709 13:10:23.210479 29951 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:23.211089 29951 heartbeater.cc:507] Master 127.19.145.62:39789 requested a full tablet report, sending...
I20260709 13:10:23.212975 29675 ts_manager.cc:194] Registered new tserver with Master: 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.213860 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013503572s
I20260709 13:10:23.214543 29675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38070
I20260709 13:10:23.236634 29675 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38080:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:23.238987 29675 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:23.312556 29916 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d82234f504b9c9b89a35b35321766 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:23.313966 29916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d82234f504b9c9b89a35b35321766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.316335 29915 tablet_service.cc:1511] Processing CreateTablet for tablet dace6a4c98f340b1966e9c48d9c8d290 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:23.316756 29913 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac5a93a51e46e186447643e384f973 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:23.317063 29842 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d82234f504b9c9b89a35b35321766 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:23.317764 29915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dace6a4c98f340b1966e9c48d9c8d290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.318349 29842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d82234f504b9c9b89a35b35321766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.319337 29914 tablet_service.cc:1511] Processing CreateTablet for tablet 7163efc5cd52428b8bf0422b3ef46a24 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:23.319837 29912 tablet_service.cc:1511] Processing CreateTablet for tablet 31aa958674264708b52aa8fe96b73ed8 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:23.320659 29914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7163efc5cd52428b8bf0422b3ef46a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.321295 29912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31aa958674264708b52aa8fe96b73ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.321965 29913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac5a93a51e46e186447643e384f973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.328807 29841 tablet_service.cc:1511] Processing CreateTablet for tablet dace6a4c98f340b1966e9c48d9c8d290 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:23.330188 29841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dace6a4c98f340b1966e9c48d9c8d290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.333114 29840 tablet_service.cc:1511] Processing CreateTablet for tablet 7163efc5cd52428b8bf0422b3ef46a24 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:23.334513 29840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7163efc5cd52428b8bf0422b3ef46a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.338064 29911 tablet_service.cc:1511] Processing CreateTablet for tablet 48b09cddc74a49a4be3c81a4b0c818bf (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:23.339454 29911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b09cddc74a49a4be3c81a4b0c818bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.340757 29839 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac5a93a51e46e186447643e384f973 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:23.342069 29839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac5a93a51e46e186447643e384f973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.348694 29838 tablet_service.cc:1511] Processing CreateTablet for tablet 31aa958674264708b52aa8fe96b73ed8 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:23.350019 29838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31aa958674264708b52aa8fe96b73ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.359598 29910 tablet_service.cc:1511] Processing CreateTablet for tablet 8d590f86870144c7a04b212a06f593fa (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:23.360956 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d590f86870144c7a04b212a06f593fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.361744 29837 tablet_service.cc:1511] Processing CreateTablet for tablet 48b09cddc74a49a4be3c81a4b0c818bf (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:23.363070 29837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b09cddc74a49a4be3c81a4b0c818bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.364336 29836 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03d9152894ed6bb3d61fc5e6a9a16 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:23.365640 29836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03d9152894ed6bb3d61fc5e6a9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.366524 29834 tablet_service.cc:1511] Processing CreateTablet for tablet 3291c57ce8b04fd2818f8bfc937afc37 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:23.367789 29834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291c57ce8b04fd2818f8bfc937afc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.368273 29835 tablet_service.cc:1511] Processing CreateTablet for tablet 8d590f86870144c7a04b212a06f593fa (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:23.369517 29835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d590f86870144c7a04b212a06f593fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.372915 29909 tablet_service.cc:1511] Processing CreateTablet for tablet 3291c57ce8b04fd2818f8bfc937afc37 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:23.374145 29909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291c57ce8b04fd2818f8bfc937afc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.398500 29764 tablet_service.cc:1511] Processing CreateTablet for tablet 5bac5a93a51e46e186447643e384f973 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:23.399935 29764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bac5a93a51e46e186447643e384f973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.400044 29763 tablet_service.cc:1511] Processing CreateTablet for tablet 31aa958674264708b52aa8fe96b73ed8 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:23.401347 29763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31aa958674264708b52aa8fe96b73ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.396389 29767 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9d82234f504b9c9b89a35b35321766 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:23.404264 29762 tablet_service.cc:1511] Processing CreateTablet for tablet 48b09cddc74a49a4be3c81a4b0c818bf (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:23.405555 29767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9d82234f504b9c9b89a35b35321766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.406052 29761 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03d9152894ed6bb3d61fc5e6a9a16 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:23.407291 29765 tablet_service.cc:1511] Processing CreateTablet for tablet 7163efc5cd52428b8bf0422b3ef46a24 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:23.407971 29760 tablet_service.cc:1511] Processing CreateTablet for tablet 8d590f86870144c7a04b212a06f593fa (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:23.413312 29759 tablet_service.cc:1511] Processing CreateTablet for tablet 3291c57ce8b04fd2818f8bfc937afc37 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:23.404264 29766 tablet_service.cc:1511] Processing CreateTablet for tablet dace6a4c98f340b1966e9c48d9c8d290 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:23.416082 29761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03d9152894ed6bb3d61fc5e6a9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.417704 29765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7163efc5cd52428b8bf0422b3ef46a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.419114 29760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d590f86870144c7a04b212a06f593fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.358202 29916 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03d9152894ed6bb3d61fc5e6a9a16 (DEFAULT_TABLE table=test-workload [id=b0d44ad74ea24add9614b83936701800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:23.420660 29759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291c57ce8b04fd2818f8bfc937afc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.421455 29916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03d9152894ed6bb3d61fc5e6a9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.421921 29766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dace6a4c98f340b1966e9c48d9c8d290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.423300 29762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b09cddc74a49a4be3c81a4b0c818bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.443183 29966 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.484170 29966 tablet_bootstrap.cc:654] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.498700 29967 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.500682 29968 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.507591 29968 tablet_bootstrap.cc:654] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.510214 29967 tablet_bootstrap.cc:654] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.518914 29966 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.519709 29966 ts_tablet_manager.cc:1403] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.011s
I20260709 13:10:23.523428 29966 raft_consensus.cc:359] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.525508 29966 raft_consensus.cc:385] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.525849 29966 raft_consensus.cc:740] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.526890 29968 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.526801 29966 consensus_queue.cc:260] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.527431 29968 ts_tablet_manager.cc:1403] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:10:23.529989 29967 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.530514 29967 ts_tablet_manager.cc:1403] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.032s	user 0.000s	sys 0.023s
I20260709 13:10:23.532346 29968 raft_consensus.cc:359] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.533393 29968 raft_consensus.cc:385] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.533934 29968 raft_consensus.cc:740] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.533190 29967 raft_consensus.cc:359] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.534929 29967 raft_consensus.cc:385] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.535357 29967 raft_consensus.cc:740] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.535508 29968 consensus_queue.cc:260] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.536347 29967 consensus_queue.cc:260] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.537604 29951 heartbeater.cc:499] Master 127.19.145.62:39789 was elected leader, sending a full tablet report...
I20260709 13:10:23.537700 29802 heartbeater.cc:499] Master 127.19.145.62:39789 was elected leader, sending a full tablet report...
I20260709 13:10:23.538262 29966 ts_tablet_manager.cc:1434] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:10:23.539661 29966 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.542634 29968 ts_tablet_manager.cc:1434] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:10:23.544581 29968 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.547288 29966 tablet_bootstrap.cc:654] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.550218 29968 tablet_bootstrap.cc:654] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.560190 29966 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.563161 29966 ts_tablet_manager.cc:1403] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:10:23.566694 29966 raft_consensus.cc:359] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.567950 29966 raft_consensus.cc:385] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.568344 29966 raft_consensus.cc:740] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.569402 29966 consensus_queue.cc:260] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.572477 29966 ts_tablet_manager.cc:1434] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:23.573684 29966 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.581480 29966 tablet_bootstrap.cc:654] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.594159 29966 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.594754 29966 ts_tablet_manager.cc:1403] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:10:23.598381 29966 raft_consensus.cc:359] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.599373 29966 raft_consensus.cc:385] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.599738 29966 raft_consensus.cc:740] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.600890 29966 consensus_queue.cc:260] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.603021 29967 ts_tablet_manager.cc:1434] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.072s	user 0.019s	sys 0.052s
I20260709 13:10:23.603739 29966 ts_tablet_manager.cc:1434] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:10:23.603937 29967 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.604275 29877 heartbeater.cc:499] Master 127.19.145.62:39789 was elected leader, sending a full tablet report...
I20260709 13:10:23.604791 29966 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.610659 29967 tablet_bootstrap.cc:654] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.611001 29966 tablet_bootstrap.cc:654] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.618970 29968 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.619617 29968 ts_tablet_manager.cc:1403] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.038s
I20260709 13:10:23.623127 29968 raft_consensus.cc:359] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.623831 29968 raft_consensus.cc:385] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.624145 29968 raft_consensus.cc:740] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.625377 29968 consensus_queue.cc:260] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.631381 29968 ts_tablet_manager.cc:1434] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:23.632597 29968 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.639174 29967 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.639719 29967 ts_tablet_manager.cc:1403] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.018s
I20260709 13:10:23.640098 29966 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.640590 29966 ts_tablet_manager.cc:1403] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 13:10:23.641425 29968 tablet_bootstrap.cc:654] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.642642 29967 raft_consensus.cc:359] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.643445 29967 raft_consensus.cc:385] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.643751 29967 raft_consensus.cc:740] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.643275 29966 raft_consensus.cc:359] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.644279 29966 raft_consensus.cc:385] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.644562 29966 raft_consensus.cc:740] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.644732 29967 consensus_queue.cc:260] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.645462 29966 consensus_queue.cc:260] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.646955 29967 ts_tablet_manager.cc:1434] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:23.647876 29966 ts_tablet_manager.cc:1434] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:23.647975 29967 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.648972 29966 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.650539 29968 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.651093 29968 ts_tablet_manager.cc:1403] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:10:23.654604 29967 tablet_bootstrap.cc:654] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.655135 29966 tablet_bootstrap.cc:654] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.656068 29974 raft_consensus.cc:493] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.656570 29974 raft_consensus.cc:515] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.662389 29968 raft_consensus.cc:359] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.663442 29974 leader_election.cc:290] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267), 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711)
I20260709 13:10:23.663484 29968 raft_consensus.cc:385] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.664288 29968 raft_consensus.cc:740] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.665293 29968 consensus_queue.cc:260] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.673831 29972 raft_consensus.cc:493] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.674485 29972 raft_consensus.cc:515] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.679165 29972 leader_election.cc:290] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711)
I20260709 13:10:23.682216 29968 ts_tablet_manager.cc:1434] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 13:10:23.683761 29968 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.692186 29968 tablet_bootstrap.cc:654] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.697950 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
W20260709 13:10:23.699522 29815 leader_election.cc:343] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.705498 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:23.706480 29852 raft_consensus.cc:2468] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:23.708400 29891 leader_election.cc:304] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:23.709578 29972 raft_consensus.cc:2804] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.710031 29972 raft_consensus.cc:493] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.710449 29972 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.721179 29972 raft_consensus.cc:515] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.721665 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:23.724355 29968 tablet_bootstrap.cc:492] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
W20260709 13:10:23.724994 29889 leader_election.cc:343] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.725145 29968 ts_tablet_manager.cc:1403] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.010s
I20260709 13:10:23.729254 29967 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.731319 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:23.731822 29972 leader_election.cc:290] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711)
I20260709 13:10:23.731962 29852 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.730618 29967 ts_tablet_manager.cc:1403] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.017s
I20260709 13:10:23.732395 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:23.733311 29926 raft_consensus.cc:2393] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22057d0d84e640a4ba52bbae0dc74494 in current term 1: Already voted for candidate 9a237313f4d54a58bf56170293a10edd in this term.
I20260709 13:10:23.734181 29966 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.734750 29966 ts_tablet_manager.cc:1403] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.044s
I20260709 13:10:23.734910 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:23.735841 29968 raft_consensus.cc:359] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.736541 29968 raft_consensus.cc:385] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.736734 29816 leader_election.cc:304] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494; no voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd
W20260709 13:10:23.738317 29889 leader_election.cc:343] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.738041 29966 raft_consensus.cc:359] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.738904 29966 raft_consensus.cc:385] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.739317 29966 raft_consensus.cc:740] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.736887 29968 raft_consensus.cc:740] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.739928 29852 raft_consensus.cc:2468] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 1.
I20260709 13:10:23.740506 29972 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.740531 29974 raft_consensus.cc:2749] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.740799 29968 consensus_queue.cc:260] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:23.741212 29891 leader_election.cc:304] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:23.741530 29966 consensus_queue.cc:260] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.743567 29968 ts_tablet_manager.cc:1434] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:10:23.739159 29967 raft_consensus.cc:359] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.744095 29967 raft_consensus.cc:385] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.744575 29968 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.744644 29967 raft_consensus.cc:740] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.741252 29972 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.746003 29967 consensus_queue.cc:260] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.747457 29972 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:23.748025 29972 raft_consensus.cc:2804] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.748629 29967 ts_tablet_manager.cc:1434] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:10:23.750129 29967 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.750715 29968 tablet_bootstrap.cc:654] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.755522 29972 raft_consensus.cc:697] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:23.760131 29990 raft_consensus.cc:493] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.760622 29990 raft_consensus.cc:515] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.762884 29989 raft_consensus.cc:493] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.762981 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:23.763563 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
W20260709 13:10:23.764550 29889 leader_election.cc:343] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.764412 29972 consensus_queue.cc:237] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
W20260709 13:10:23.765136 29891 leader_election.cc:343] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.765622 29891 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:23.766127 29966 ts_tablet_manager.cc:1434] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 13:10:23.763563 29989 raft_consensus.cc:515] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.767192 29966 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.770823 29990 leader_election.cc:290] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:23.771370 29990 raft_consensus.cc:2749] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.773144 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
W20260709 13:10:23.774696 29891 leader_election.cc:343] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.769697 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:23.775663 29974 raft_consensus.cc:493] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.769774 29967 tablet_bootstrap.cc:654] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.776749 29974 raft_consensus.cc:515] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.768738 29989 leader_election.cc:290] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
W20260709 13:10:23.779325 29891 leader_election.cc:343] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.781566 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:23.782056 29966 tablet_bootstrap.cc:654] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:23.783875 29889 leader_election.cc:343] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.784380 29889 leader_election.cc:304] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:23.784482 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
W20260709 13:10:23.787810 29889 leader_election.cc:343] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.788364 29889 leader_election.cc:304] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:23.789311 29989 raft_consensus.cc:2749] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.789944 29989 raft_consensus.cc:2749] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.790923 29974 leader_election.cc:290] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.796907 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:23.797442 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
W20260709 13:10:23.798570 29816 leader_election.cc:343] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.797786 29675 catalog_manager.cc:5697] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 1 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:23.799079 29815 leader_election.cc:343] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.799861 29815 leader_election.cc:304] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494; no voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:23.801077 29974 raft_consensus.cc:2749] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.802105 29966 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.802651 29966 ts_tablet_manager.cc:1403] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.010s
I20260709 13:10:23.804811 29967 tablet_bootstrap.cc:492] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.804859 29968 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.805560 29966 raft_consensus.cc:359] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.805719 29968 ts_tablet_manager.cc:1403] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.015s
I20260709 13:10:23.806420 29966 raft_consensus.cc:385] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.806748 29966 raft_consensus.cc:740] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.805698 29967 ts_tablet_manager.cc:1403] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.009s
I20260709 13:10:23.807596 29966 consensus_queue.cc:260] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.809310 29968 raft_consensus.cc:359] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.810056 29968 raft_consensus.cc:385] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.810204 29966 ts_tablet_manager.cc:1434] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:23.810359 29968 raft_consensus.cc:740] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.811331 29966 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.811084 29967 raft_consensus.cc:359] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.811522 29968 consensus_queue.cc:260] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.812345 29967 raft_consensus.cc:385] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.812844 29967 raft_consensus.cc:740] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.814332 29967 consensus_queue.cc:260] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.816366 29968 ts_tablet_manager.cc:1434] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:23.816689 29967 ts_tablet_manager.cc:1434] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:23.817379 29968 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.817931 29966 tablet_bootstrap.cc:654] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.817952 29967 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.825264 29967 tablet_bootstrap.cc:654] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.825695 29968 tablet_bootstrap.cc:654] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.835368 29973 raft_consensus.cc:493] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.836053 29973 raft_consensus.cc:515] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.837297 29967 tablet_bootstrap.cc:492] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.837869 29967 ts_tablet_manager.cc:1403] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:10:23.840837 29967 raft_consensus.cc:359] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.842263 29967 raft_consensus.cc:385] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.842628 29967 raft_consensus.cc:740] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
W20260709 13:10:23.845021 29723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:23.843634 29967 consensus_queue.cc:260] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.846393 29973 leader_election.cc:290] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.848299 29967 ts_tablet_manager.cc:1434] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:23.851858 29967 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.857141 29968 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.857833 29968 ts_tablet_manager.cc:1403] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:10:23.861806 29968 raft_consensus.cc:359] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.862746 29968 raft_consensus.cc:385] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.863133 29968 raft_consensus.cc:740] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.866503 29968 consensus_queue.cc:260] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.868933 29968 ts_tablet_manager.cc:1434] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:10:23.869561 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:23.869903 29968 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
W20260709 13:10:23.871101 29742 leader_election.cc:343] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.873658 29966 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.874189 29966 ts_tablet_manager.cc:1403] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.028s
I20260709 13:10:23.876919 29968 tablet_bootstrap.cc:654] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.877210 29966 raft_consensus.cc:359] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.877972 29966 raft_consensus.cc:385] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.878289 29966 raft_consensus.cc:740] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.879098 29967 tablet_bootstrap.cc:654] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.879082 29966 consensus_queue.cc:260] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.879779 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:23.880429 29926 raft_consensus.cc:2468] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:23.881816 29966 ts_tablet_manager.cc:1434] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:23.881789 29741 leader_election.cc:304] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:23.882951 29966 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.883065 29973 raft_consensus.cc:2804] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.883466 29973 raft_consensus.cc:493] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.883805 29973 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.889837 29966 tablet_bootstrap.cc:654] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.891508 29967 tablet_bootstrap.cc:492] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.892182 29967 ts_tablet_manager.cc:1403] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.007s
I20260709 13:10:23.891484 29973 raft_consensus.cc:515] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.895308 29967 raft_consensus.cc:359] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.896051 29967 raft_consensus.cc:385] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.896814 29974 raft_consensus.cc:493] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.897367 29974 raft_consensus.cc:515] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.898907 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:23.899319 29974 leader_election.cc:290] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.899688 29926 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.899991 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
W20260709 13:10:23.901532 29815 leader_election.cc:343] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.896842 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:23.896380 29967 raft_consensus.cc:740] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
W20260709 13:10:23.904680 29742 leader_election.cc:343] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.904855 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:23.905226 29967 consensus_queue.cc:260] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
W20260709 13:10:23.906433 29816 leader_election.cc:343] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.906841 29816 leader_election.cc:304] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494; no voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:23.908154 29974 raft_consensus.cc:2749] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.909955 29967 ts_tablet_manager.cc:1434] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:23.910982 29967 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.911005 29973 leader_election.cc:290] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.911986 29926 raft_consensus.cc:2468] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:23.913255 29741 leader_election.cc:304] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:23.918195 29967 tablet_bootstrap.cc:654] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.920747 29973 raft_consensus.cc:2804] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.922961 30006 raft_consensus.cc:493] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.923638 30006 raft_consensus.cc:515] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.927111 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:23.927459 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
W20260709 13:10:23.928841 29742 leader_election.cc:343] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.929342 30006 leader_election.cc:290] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
W20260709 13:10:23.929581 29741 leader_election.cc:343] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.929924 29967 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.930428 29967 ts_tablet_manager.cc:1403] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:10:23.930197 29741 leader_election.cc:304] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b; no voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:23.930639 30006 raft_consensus.cc:493] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.931577 30006 raft_consensus.cc:515] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.933456 29967 raft_consensus.cc:359] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.933849 30006 leader_election.cc:290] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.934652 30006 raft_consensus.cc:2749] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.934197 29967 raft_consensus.cc:385] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.934762 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:23.935587 29967 raft_consensus.cc:740] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.935789 29852 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:23.936807 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:23.937139 29967 consensus_queue.cc:260] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.937625 29926 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:23.939465 29742 leader_election.cc:304] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:23.940526 30006 raft_consensus.cc:2804] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.940941 30006 raft_consensus.cc:493] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.941468 30006 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.939457 29967 ts_tablet_manager.cc:1434] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:10:23.947500 29967 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.950763 30006 raft_consensus.cc:515] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.953511 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:23.954015 29852 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.956830 29967 tablet_bootstrap.cc:654] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.956727 29973 raft_consensus.cc:697] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:23.957986 29968 tablet_bootstrap.cc:492] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:23.957778 29973 consensus_queue.cc:237] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.958477 29968 ts_tablet_manager.cc:1403] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.009s
I20260709 13:10:23.961587 29968 raft_consensus.cc:359] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.962451 29968 raft_consensus.cc:385] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.962843 29968 raft_consensus.cc:740] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.962922 29852 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:23.963856 29968 consensus_queue.cc:260] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.965490 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:23.965660 29742 leader_election.cc:304] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:23.966069 29926 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.966538 29968 ts_tablet_manager.cc:1434] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:23.964357 30006 leader_election.cc:290] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.966688 30007 raft_consensus.cc:2804] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.967334 30007 raft_consensus.cc:697] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:23.967622 29968 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:23.968119 30007 consensus_queue.cc:237] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.973423 29967 tablet_bootstrap.cc:492] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:23.973934 29967 ts_tablet_manager.cc:1403] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 13:10:23.975142 29926 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:23.975602 29966 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:23.976097 29966 ts_tablet_manager.cc:1403] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.039s
I20260709 13:10:23.976890 29967 raft_consensus.cc:359] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.977532 29967 raft_consensus.cc:385] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.977789 29967 raft_consensus.cc:740] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.978320 29966 raft_consensus.cc:359] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.978425 29967 consensus_queue.cc:260] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.979123 29966 raft_consensus.cc:385] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.979483 29966 raft_consensus.cc:740] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.980253 29966 consensus_queue.cc:260] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.980645 29967 ts_tablet_manager.cc:1434] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:23.981607 29967 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:23.983773 29966 ts_tablet_manager.cc:1434] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:23.984798 29966 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:23.984098 29672 catalog_manager.cc:5697] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.985627 29968 tablet_bootstrap.cc:654] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.987010 29967 tablet_bootstrap.cc:654] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.992717 29966 tablet_bootstrap.cc:654] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.993286 29974 raft_consensus.cc:493] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.993873 29974 raft_consensus.cc:515] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:23.996111 29974 leader_election.cc:290] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:23.998536 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:24.000602 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.001412 29926 raft_consensus.cc:2393] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22057d0d84e640a4ba52bbae0dc74494 in current term 1: Already voted for candidate 81f8147af9ea4940b06921d63f8c233b in this term.
I20260709 13:10:24.002467 29816 leader_election.cc:304] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494; no voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:24.003624 29974 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.012238 29967 tablet_bootstrap.cc:492] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:24.012734 29967 ts_tablet_manager.cc:1403] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.016s
I20260709 13:10:24.013161 29966 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:24.013670 29966 ts_tablet_manager.cc:1403] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:10:24.015592 29967 raft_consensus.cc:359] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.016314 29967 raft_consensus.cc:385] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.016640 29967 raft_consensus.cc:740] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.016402 29966 raft_consensus.cc:359] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.017266 29966 raft_consensus.cc:385] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.017596 29966 raft_consensus.cc:740] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.015727 29672 catalog_manager.cc:5697] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.018446 29966 consensus_queue.cc:260] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.019644 29967 consensus_queue.cc:260] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.021332 29974 raft_consensus.cc:2749] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.020192 29968 tablet_bootstrap.cc:492] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:24.022224 29968 ts_tablet_manager.cc:1403] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.008s
I20260709 13:10:24.029024 29966 ts_tablet_manager.cc:1434] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:24.031884 29967 ts_tablet_manager.cc:1434] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 13:10:24.033083 29968 raft_consensus.cc:359] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.033942 29968 raft_consensus.cc:385] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.034240 29968 raft_consensus.cc:740] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.034886 29968 consensus_queue.cc:260] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.036986 29968 ts_tablet_manager.cc:1434] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:24.038250 29968 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:24.042461 29968 tablet_bootstrap.cc:654] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.047073 29968 tablet_bootstrap.cc:492] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:24.047457 29968 ts_tablet_manager.cc:1403] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:24.049432 29968 raft_consensus.cc:359] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.049907 29968 raft_consensus.cc:385] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.050117 29968 raft_consensus.cc:740] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.050645 29968 consensus_queue.cc:260] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.052033 29968 ts_tablet_manager.cc:1434] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:24.067570 29973 raft_consensus.cc:493] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.068005 29973 raft_consensus.cc:515] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.069900 29974 raft_consensus.cc:493] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.069741 29973 leader_election.cc:290] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.070339 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:24.070412 29974 raft_consensus.cc:515] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.070801 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.070959 29852 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:24.071406 29926 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:24.071931 29742 leader_election.cc:304] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.072583 29974 leader_election.cc:290] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.072805 29973 raft_consensus.cc:2804] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.073195 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:24.073201 29973 raft_consensus.cc:493] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.073875 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.073962 29777 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.074004 29973 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.074244 30006 raft_consensus.cc:493] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.074627 29926 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.074935 30006 raft_consensus.cc:515] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:24.075481 29815 leader_election.cc:304] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.076504 29974 raft_consensus.cc:2804] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.076829 29974 raft_consensus.cc:493] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.077152 29974 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.077749 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.078326 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:24.079120 29852 raft_consensus.cc:2393] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81f8147af9ea4940b06921d63f8c233b in current term 1: Already voted for candidate 9a237313f4d54a58bf56170293a10edd in this term.
I20260709 13:10:24.077092 30006 leader_election.cc:290] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:24.080117 29742 leader_election.cc:304] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b; no voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:24.080865 30006 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.081908 29973 raft_consensus.cc:515] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.083738 30007 raft_consensus.cc:493] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.083976 29973 leader_election.cc:290] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.083916 29974 raft_consensus.cc:515] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.084270 30007 raft_consensus.cc:515] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.086033 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.086275 30007 leader_election.cc:290] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.086619 29852 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.086704 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.087047 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:24.087363 29777 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.087679 29851 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:24.088901 30006 raft_consensus.cc:2749] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.090144 29974 leader_election.cc:290] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.090090 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.091293 29925 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:24.091790 29742 leader_election.cc:304] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.091809 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.092710 29924 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.093331 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.093950 29926 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.094079 29777 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:24.094981 30006 raft_consensus.cc:2804] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.095393 30006 raft_consensus.cc:493] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.095546 29972 raft_consensus.cc:493] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.095800 30006 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.095628 29815 leader_election.cc:304] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.096208 29972 raft_consensus.cc:515] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.096836 29974 raft_consensus.cc:2804] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.097525 29974 raft_consensus.cc:697] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.098228 29972 leader_election.cc:290] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:24.098409 29974 consensus_queue.cc:237] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.099855 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:24.100497 29851 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:24.100673 29926 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:24.101588 29891 leader_election.cc:304] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.102258 29972 raft_consensus.cc:2804] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.102674 29972 raft_consensus.cc:493] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.103050 29972 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.103292 29741 leader_election.cc:304] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.103308 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:24.104286 30007 raft_consensus.cc:2804] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.104291 29777 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:24.104907 30007 raft_consensus.cc:697] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.105744 30006 raft_consensus.cc:515] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.105726 30007 consensus_queue.cc:237] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.109102 30006 leader_election.cc:290] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.109196 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.109813 29851 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.113708 29924 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:24.114307 29972 raft_consensus.cc:515] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.117036 29972 leader_election.cc:290] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:24.118304 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.119019 29850 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.121985 29674 catalog_manager.cc:5697] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.118321 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.123450 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.124027 29777 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.123628 29673 catalog_manager.cc:5697] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.124825 29852 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:24.124500 29926 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.133227 29926 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:24.116945 29851 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:24.134407 29741 leader_election.cc:304] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.134569 29777 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 1.
I20260709 13:10:24.135303 30007 raft_consensus.cc:2804] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.135778 30007 raft_consensus.cc:697] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.132460 29850 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 1.
I20260709 13:10:24.135926 29889 leader_election.cc:304] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.136588 30007 consensus_queue.cc:237] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.137079 29972 raft_consensus.cc:2804] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.137624 29972 raft_consensus.cc:697] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:24.138427 29972 consensus_queue.cc:237] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.145370 29673 catalog_manager.cc:5697] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.145746 29674 catalog_manager.cc:5697] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 1 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.197080 29972 consensus_queue.cc:1048] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.207581 29972 consensus_queue.cc:1048] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.250708 29974 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.251171 29974 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.252833 29974 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.253640 30007 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.253583 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:24.253866 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.254347 30007 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.254570 29926 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.255201 29777 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.255530 29816 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.256242 29974 raft_consensus.cc:2804] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.256399 30007 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.256620 29974 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.257025 29974 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.257068 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:24.257993 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.258484 29926 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:24.259389 29741 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.260030 30007 raft_consensus.cc:2804] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.260330 30007 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.260619 30007 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.262965 29974 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.264010 29850 raft_consensus.cc:2393] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81f8147af9ea4940b06921d63f8c233b in current term 1: Already voted for candidate 22057d0d84e640a4ba52bbae0dc74494 in this term.
I20260709 13:10:24.264948 29974 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.265658 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.265969 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.266492 29926 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.266448 30007 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.267614 29777 raft_consensus.cc:2393] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22057d0d84e640a4ba52bbae0dc74494 in current term 1: Already voted for candidate 81f8147af9ea4940b06921d63f8c233b in this term.
I20260709 13:10:24.269312 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.270421 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.271046 29850 raft_consensus.cc:2393] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81f8147af9ea4940b06921d63f8c233b in current term 1: Already voted for candidate 22057d0d84e640a4ba52bbae0dc74494 in this term.
I20260709 13:10:24.271677 30007 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.272130 29742 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b; no voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:24.272506 29926 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:24.272859 30007 raft_consensus.cc:2749] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.273516 29816 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:24.274158 29974 raft_consensus.cc:2804] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.274544 29974 raft_consensus.cc:697] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.275133 29974 consensus_queue.cc:237] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.277997 29974 raft_consensus.cc:493] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.278399 29974 raft_consensus.cc:515] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.280371 29974 leader_election.cc:290] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.280629 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:24.280931 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:24.281266 29777 raft_consensus.cc:2468] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.281549 29926 raft_consensus.cc:2468] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:24.282398 29815 leader_election.cc:304] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.283164 29974 raft_consensus.cc:2804] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.282555 29673 catalog_manager.cc:5697] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.283509 29974 raft_consensus.cc:493] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.283911 29974 raft_consensus.cc:3060] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.289453 29974 raft_consensus.cc:515] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.291345 29974 leader_election.cc:290] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.291832 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.292250 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d590f86870144c7a04b212a06f593fa" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.292290 29777 raft_consensus.cc:3060] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.292810 29926 raft_consensus.cc:3060] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.296859 29777 raft_consensus.cc:2468] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:24.297230 29926 raft_consensus.cc:2468] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:24.297809 29815 leader_election.cc:304] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.298454 29974 raft_consensus.cc:2804] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.298904 29974 raft_consensus.cc:697] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.299597 29974 consensus_queue.cc:237] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.306070 29673 catalog_manager.cc:5697] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.400134 30007 consensus_queue.cc:1048] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.410390 30006 consensus_queue.cc:1048] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.414904 30007 consensus_queue.cc:1048] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.426683 30007 consensus_queue.cc:1048] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.450755 29926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:35968
I20260709 13:10:24.451284 29926 raft_consensus.cc:606] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:24.466028 29850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:56042
I20260709 13:10:24.466485 29850 raft_consensus.cc:606] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:24.470986 29926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bac5a93a51e46e186447643e384f973"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:35968
I20260709 13:10:24.471475 29926 raft_consensus.cc:606] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:24.483464 29777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:24.483935 29777 raft_consensus.cc:606] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:24.488446 30007 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.489084 29777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:24.489591 29777 raft_consensus.cc:606] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:24.496137 29777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:24.496685 29777 raft_consensus.cc:606] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:24.502707 30007 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.506841 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:56042
I20260709 13:10:24.507481 29851 raft_consensus.cc:606] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:24.510426 30006 raft_consensus.cc:993] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.510850 30007 raft_consensus.cc:1081] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.512468 29850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:24.512916 29850 raft_consensus.cc:493] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.513298 29850 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.518266 29850 raft_consensus.cc:515] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.519949 29850 leader_election.cc:290] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.521025 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.521059 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.521710 29777 raft_consensus.cc:3055] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.521811 29926 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.522135 29777 raft_consensus.cc:740] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.522984 29777 consensus_queue.cc:260] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.524287 29777 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.527129 29926 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.528242 29816 leader_election.cc:304] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.528982 29974 raft_consensus.cc:2804] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.529371 29974 raft_consensus.cc:697] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.529608 29777 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.530123 29974 consensus_queue.cc:237] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.536438 29672 catalog_manager.cc:5697] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.562484 29974 consensus_queue.cc:1048] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.568507 30016 raft_consensus.cc:993] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:24.569599 29974 raft_consensus.cc:1081] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:24.575578 30041 consensus_queue.cc:1048] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.576143 29926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:10:24.576764 29926 raft_consensus.cc:493] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.577116 29926 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.581012 30007 consensus_queue.cc:1048] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.584555 29926 raft_consensus.cc:515] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.587139 29926 leader_election.cc:290] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:24.588932 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.589569 29850 raft_consensus.cc:3055] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.589903 29850 raft_consensus.cc:740] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.590137 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291c57ce8b04fd2818f8bfc937afc37" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.590847 29777 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.590711 29850 consensus_queue.cc:260] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.592180 29850 raft_consensus.cc:3060] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.596457 30007 consensus_queue.cc:1048] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.599036 29850 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:24.600244 29891 leader_election.cc:304] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.601027 29972 raft_consensus.cc:2804] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.601483 29972 raft_consensus.cc:697] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:24.602284 29972 consensus_queue.cc:237] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.603814 29777 raft_consensus.cc:2468] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:24.609701 29973 raft_consensus.cc:993] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.610126 30007 raft_consensus.cc:1081] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.611889 29851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:24.612494 29851 raft_consensus.cc:493] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.613276 29851 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.612716 29673 catalog_manager.cc:5697] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 1 to 2, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 2 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.619699 29851 raft_consensus.cc:515] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.622551 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.622884 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b09cddc74a49a4be3c81a4b0c818bf" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.623080 29777 raft_consensus.cc:3055] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.623510 29924 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.623536 29777 raft_consensus.cc:740] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.624747 29777 consensus_queue.cc:260] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.625888 29777 raft_consensus.cc:3060] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.627528 29851 leader_election.cc:290] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.629971 29924 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.630927 29816 leader_election.cc:304] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.631621 30041 raft_consensus.cc:2804] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.631698 29777 raft_consensus.cc:2468] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.632054 30041 raft_consensus.cc:697] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.632892 30041 consensus_queue.cc:237] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.638367 29673 catalog_manager.cc:5697] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.691000 29972 consensus_queue.cc:1048] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.697585 29972 raft_consensus.cc:993] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.698029 29972 raft_consensus.cc:1081] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.699955 29972 consensus_queue.cc:1048] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.699983 29776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bac5a93a51e46e186447643e384f973"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:10:24.701043 29776 raft_consensus.cc:493] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.701411 29776 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.704984 29988 raft_consensus.cc:993] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.705487 29989 raft_consensus.cc:1081] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.707423 29775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:10:24.707952 29775 raft_consensus.cc:493] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.708326 29775 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.712882 29776 raft_consensus.cc:515] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.715718 29775 raft_consensus.cc:515] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:24.716600 29776 leader_election.cc:290] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.717289 29777 raft_consensus.cc:1240] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Rejecting Update request from peer 9a237313f4d54a58bf56170293a10edd for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:24.717734 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.717913 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bac5a93a51e46e186447643e384f973" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.718381 29851 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.718572 29924 raft_consensus.cc:3055] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.719026 29924 raft_consensus.cc:740] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:24.719911 29924 consensus_queue.cc:260] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.721048 29924 raft_consensus.cc:3060] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.721593 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.722195 29926 raft_consensus.cc:3055] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.722478 29926 raft_consensus.cc:740] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:24.723354 29926 consensus_queue.cc:260] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:24.724179 29775 leader_election.cc:290] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:24.724321 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9d82234f504b9c9b89a35b35321766" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.724484 29926 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.724943 29850 raft_consensus.cc:3060] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.725433 29851 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.728209 30041 consensus_queue.cc:1048] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.729563 29742 leader_election.cc:304] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.730441 30007 raft_consensus.cc:2804] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.730885 30007 raft_consensus.cc:697] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.731611 29850 raft_consensus.cc:2468] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.731668 30007 consensus_queue.cc:237] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.733918 30041 consensus_queue.cc:1048] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.736189 29924 raft_consensus.cc:2468] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.737145 29926 raft_consensus.cc:2468] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.739347 29741 leader_election.cc:304] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.740445 30007 raft_consensus.cc:2804] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.742606 30007 raft_consensus.cc:697] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.743670 30007 consensus_queue.cc:237] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } }
I20260709 13:10:24.745334 29673 catalog_manager.cc:5697] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 9a237313f4d54a58bf56170293a10edd (127.19.145.3) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.757134 30041 consensus_queue.cc:1048] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.775799 29974 consensus_queue.cc:1048] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.787132 30040 raft_consensus.cc:993] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.787626 30040 raft_consensus.cc:1081] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:24.789500 29777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:10:24.790107 29777 raft_consensus.cc:493] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.790719 29777 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.790102 29673 catalog_manager.cc:5697] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 9a237313f4d54a58bf56170293a10edd (127.19.145.3) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.797421 29777 raft_consensus.cc:515] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.799425 29777 leader_election.cc:290] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.799944 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:24.800545 29850 raft_consensus.cc:3055] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.800863 29850 raft_consensus.cc:740] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.801638 29850 consensus_queue.cc:260] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.802595 29850 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.804919 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7163efc5cd52428b8bf0422b3ef46a24" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.805528 29926 raft_consensus.cc:3060] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.810199 29850 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.811462 29742 leader_election.cc:304] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:24.812316 30007 raft_consensus.cc:2804] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.812729 30007 raft_consensus.cc:697] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.813596 29926 raft_consensus.cc:2468] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:24.813576 30007 consensus_queue.cc:237] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.819428 29673 catalog_manager.cc:5697] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.914062 29973 raft_consensus.cc:993] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.914475 30007 raft_consensus.cc:1081] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:24.915753 29850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:24.916152 29850 raft_consensus.cc:493] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.916407 29850 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.920876 29777 raft_consensus.cc:1275] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.922317 30051 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.922454 29850 raft_consensus.cc:515] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.924167 29850 leader_election.cc:290] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:24.924976 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:24.925218 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03d9152894ed6bb3d61fc5e6a9a16" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:24.925628 29775 raft_consensus.cc:3055] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.925813 29926 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.925870 29775 raft_consensus.cc:740] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:24.926803 29775 consensus_queue.cc:260] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.927737 29775 raft_consensus.cc:3060] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.931069 29926 raft_consensus.cc:2468] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.933611 29775 raft_consensus.cc:2468] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:24.934612 29816 leader_election.cc:304] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:24.935616 29926 raft_consensus.cc:1275] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.936148 30040 raft_consensus.cc:2804] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.936630 30040 raft_consensus.cc:697] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:24.936970 29974 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.937422 30040 consensus_queue.cc:237] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:24.947069 29672 catalog_manager.cc:5697] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.001462 29850 raft_consensus.cc:1275] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.002529 29988 consensus_queue.cc:1048] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.010198 29777 raft_consensus.cc:1275] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.013443 29972 consensus_queue.cc:1048] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.030660 29926 raft_consensus.cc:1275] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.031845 30040 consensus_queue.cc:1048] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.038707 29777 raft_consensus.cc:1275] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.040640 30049 consensus_queue.cc:1048] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:25.121146 29850 raft_consensus.cc:1275] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.122411 30007 consensus_queue.cc:1048] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.129887 29926 raft_consensus.cc:1275] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.131376 30007 consensus_queue.cc:1048] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.164008 29926 raft_consensus.cc:1275] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.165179 30007 consensus_queue.cc:1048] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.175176 29850 raft_consensus.cc:1275] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.176939 30007 consensus_queue.cc:1048] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.296888 29926 raft_consensus.cc:1275] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.298091 30007 consensus_queue.cc:1048] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.305593 29850 raft_consensus.cc:1275] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.307050 30007 consensus_queue.cc:1048] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.432865 29777 raft_consensus.cc:1275] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.434134 30049 consensus_queue.cc:1048] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.442008 29926 raft_consensus.cc:1275] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.444202 30051 consensus_queue.cc:1048] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.543540 29673 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38082:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:27.547241 29673 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:27.602964 29762 tablet_service.cc:1511] Processing CreateTablet for tablet 740e7575e252493388b5ed977e124444 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.604502 29835 tablet_service.cc:1511] Processing CreateTablet for tablet 740e7575e252493388b5ed977e124444 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.604971 29762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740e7575e252493388b5ed977e124444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.606204 29835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740e7575e252493388b5ed977e124444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.606483 29910 tablet_service.cc:1511] Processing CreateTablet for tablet 740e7575e252493388b5ed977e124444 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.608160 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740e7575e252493388b5ed977e124444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.610124 29834 tablet_service.cc:1511] Processing CreateTablet for tablet 2f442a15843043e78252e99da923c3ee (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.611349 29911 tablet_service.cc:1511] Processing CreateTablet for tablet 2f442a15843043e78252e99da923c3ee (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.611786 29834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f442a15843043e78252e99da923c3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.612722 29911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f442a15843043e78252e99da923c3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.617070 29759 tablet_service.cc:1511] Processing CreateTablet for tablet 2f442a15843043e78252e99da923c3ee (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.618455 29759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f442a15843043e78252e99da923c3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.636623 29764 tablet_service.cc:1511] Processing CreateTablet for tablet 4e577d48e2fc47aa8c79bae9d580b03c (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.638552 29764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e577d48e2fc47aa8c79bae9d580b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.638332 29836 tablet_service.cc:1511] Processing CreateTablet for tablet 4e577d48e2fc47aa8c79bae9d580b03c (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.639986 30070 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:27.640823 29836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e577d48e2fc47aa8c79bae9d580b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.647347 29763 tablet_service.cc:1511] Processing CreateTablet for tablet 1c81258d55ef4de98ee34f3bf8bcd347 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.648638 29763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c81258d55ef4de98ee34f3bf8bcd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.648983 30070 tablet_bootstrap.cc:654] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.650089 29838 tablet_service.cc:1511] Processing CreateTablet for tablet 1c81258d55ef4de98ee34f3bf8bcd347 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.650642 29910 tablet_service.cc:1511] Processing CreateTablet for tablet 1c81258d55ef4de98ee34f3bf8bcd347 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.651464 29838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c81258d55ef4de98ee34f3bf8bcd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.652029 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c81258d55ef4de98ee34f3bf8bcd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.659389 29765 tablet_service.cc:1511] Processing CreateTablet for tablet d45dfc083ae14c7399eecb82ba10656f (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.660715 29765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45dfc083ae14c7399eecb82ba10656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.661445 29840 tablet_service.cc:1511] Processing CreateTablet for tablet d45dfc083ae14c7399eecb82ba10656f (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.662787 29840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45dfc083ae14c7399eecb82ba10656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.672291 29911 tablet_service.cc:1511] Processing CreateTablet for tablet 4e577d48e2fc47aa8c79bae9d580b03c (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.673784 29911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e577d48e2fc47aa8c79bae9d580b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.682699 29913 tablet_service.cc:1511] Processing CreateTablet for tablet d45dfc083ae14c7399eecb82ba10656f (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.684118 29913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45dfc083ae14c7399eecb82ba10656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.683460 29763 tablet_service.cc:1511] Processing CreateTablet for tablet 1a068825888740c0ba487ca25623a9c2 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.685042 29763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a068825888740c0ba487ca25623a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.694476 29841 tablet_service.cc:1511] Processing CreateTablet for tablet 1a068825888740c0ba487ca25623a9c2 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.695889 29841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a068825888740c0ba487ca25623a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.704821 29767 tablet_service.cc:1511] Processing CreateTablet for tablet af02f33bf0f64580bb89af11c1347561 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.706216 29767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af02f33bf0f64580bb89af11c1347561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.707592 29911 tablet_service.cc:1511] Processing CreateTablet for tablet 1a068825888740c0ba487ca25623a9c2 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.708809 29911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a068825888740c0ba487ca25623a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.714574 29839 tablet_service.cc:1511] Processing CreateTablet for tablet af02f33bf0f64580bb89af11c1347561 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.715878 29839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af02f33bf0f64580bb89af11c1347561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.720086 29910 tablet_service.cc:1511] Processing CreateTablet for tablet af02f33bf0f64580bb89af11c1347561 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.721386 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af02f33bf0f64580bb89af11c1347561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.724197 29760 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c2fcfa1cd447eb5911476cca97f15 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.725497 29760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c2fcfa1cd447eb5911476cca97f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.726588 29916 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c2fcfa1cd447eb5911476cca97f15 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.728190 29916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c2fcfa1cd447eb5911476cca97f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.729233 29766 tablet_service.cc:1511] Processing CreateTablet for tablet 27ea29214a044bbe855286040ce632fd (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.730576 29766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ea29214a044bbe855286040ce632fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.734022 29842 tablet_service.cc:1511] Processing CreateTablet for tablet 27ea29214a044bbe855286040ce632fd (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.738893 29842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ea29214a044bbe855286040ce632fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.747505 30073 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:27.752274 29840 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c2fcfa1cd447eb5911476cca97f15 (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.753546 29840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c2fcfa1cd447eb5911476cca97f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.758064 30073 tablet_bootstrap.cc:654] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.771548 29910 tablet_service.cc:1511] Processing CreateTablet for tablet 27ea29214a044bbe855286040ce632fd (DEFAULT_TABLE table=soft_deleted_table [id=4755b173f6db482f91bf4455e578b677]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.773201 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ea29214a044bbe855286040ce632fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.792152 30073 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:27.793001 30073 ts_tablet_manager.cc:1403] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.011s
I20260709 13:10:27.797130 30073 raft_consensus.cc:359] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.813270 30073 raft_consensus.cc:385] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.813907 30073 raft_consensus.cc:740] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.815668 30071 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:27.819084 30073 consensus_queue.cc:260] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.823102 30071 tablet_bootstrap.cc:654] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.824812 30070 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:27.825349 30070 ts_tablet_manager.cc:1403] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.029s
I20260709 13:10:27.823153 30073 ts_tablet_manager.cc:1434] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:10:27.826833 30073 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:27.829233 30070 raft_consensus.cc:359] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.830173 30070 raft_consensus.cc:385] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.830551 30070 raft_consensus.cc:740] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.831538 30070 consensus_queue.cc:260] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.833887 30073 tablet_bootstrap.cc:654] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.834834 30070 ts_tablet_manager.cc:1434] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:10:27.837731 30070 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:27.839203 30071 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:27.839740 30071 ts_tablet_manager.cc:1403] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 13:10:27.842867 30071 raft_consensus.cc:359] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.843603 30071 raft_consensus.cc:385] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.843873 30071 raft_consensus.cc:740] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.844239 30070 tablet_bootstrap.cc:654] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.844782 30071 consensus_queue.cc:260] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.847369 30071 ts_tablet_manager.cc:1434] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:27.848629 30071 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
W20260709 13:10:27.882896 29723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:27.883396 30073 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:27.883992 30073 ts_tablet_manager.cc:1403] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.043s
I20260709 13:10:27.884747 30071 tablet_bootstrap.cc:654] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.885298 30070 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:27.885738 30070 ts_tablet_manager.cc:1403] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.024s
I20260709 13:10:27.887118 30073 raft_consensus.cc:359] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.887992 30073 raft_consensus.cc:385] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.888350 30073 raft_consensus.cc:740] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.888149 30070 raft_consensus.cc:359] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.889021 30070 raft_consensus.cc:385] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.889308 30070 raft_consensus.cc:740] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.889151 30073 consensus_queue.cc:260] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.890437 30071 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:27.890076 30070 consensus_queue.cc:260] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.891057 30071 ts_tablet_manager.cc:1403] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 13:10:27.891841 30073 ts_tablet_manager.cc:1434] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:27.892787 30073 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:27.894565 30070 ts_tablet_manager.cc:1434] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:10:27.895548 30070 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:27.899190 30073 tablet_bootstrap.cc:654] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.902364 30070 tablet_bootstrap.cc:654] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.907387 30071 raft_consensus.cc:359] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.908447 30071 raft_consensus.cc:385] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.908870 30071 raft_consensus.cc:740] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.910008 30071 consensus_queue.cc:260] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.912551 30071 ts_tablet_manager.cc:1434] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:10:27.912581 30073 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:27.913163 30073 ts_tablet_manager.cc:1403] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 13:10:27.913653 30071 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:27.916198 30073 raft_consensus.cc:359] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.916913 30073 raft_consensus.cc:385] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.917237 30073 raft_consensus.cc:740] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.918200 30070 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:27.917994 30073 consensus_queue.cc:260] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.918807 30070 ts_tablet_manager.cc:1403] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:10:27.920532 30073 ts_tablet_manager.cc:1434] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:27.921717 30073 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:27.922099 30071 tablet_bootstrap.cc:654] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.922176 30070 raft_consensus.cc:359] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.923077 30070 raft_consensus.cc:385] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.923472 30070 raft_consensus.cc:740] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.924376 30070 consensus_queue.cc:260] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.929397 30070 ts_tablet_manager.cc:1434] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:27.929741 30073 tablet_bootstrap.cc:654] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.931522 30070 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:27.936080 30071 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:27.936722 30071 ts_tablet_manager.cc:1403] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:10:27.939376 30070 tablet_bootstrap.cc:654] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.940502 30071 raft_consensus.cc:359] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.941256 30071 raft_consensus.cc:385] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.941541 30071 raft_consensus.cc:740] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.941830 30073 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:27.942297 30073 ts_tablet_manager.cc:1403] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:10:27.942217 30071 consensus_queue.cc:260] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.944872 30071 ts_tablet_manager.cc:1434] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:10:27.945295 30073 raft_consensus.cc:359] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.945989 30071 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:27.945976 30073 raft_consensus.cc:385] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.946452 30073 raft_consensus.cc:740] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.947207 30073 consensus_queue.cc:260] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.949414 30078 raft_consensus.cc:493] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.949898 30078 raft_consensus.cc:515] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.952019 30073 ts_tablet_manager.cc:1434] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:27.952126 30078 leader_election.cc:290] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:27.953100 30073 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:27.953899 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:27.954663 29850 raft_consensus.cc:2468] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:27.956115 29742 leader_election.cc:304] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:27.958088 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
W20260709 13:10:27.959749 29741 leader_election.cc:343] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.960302 30073 tablet_bootstrap.cc:654] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.960644 30078 raft_consensus.cc:2804] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.961040 30078 raft_consensus.cc:493] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.961417 30078 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.971693 30071 tablet_bootstrap.cc:654] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.973840 30078 raft_consensus.cc:515] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.976797 30070 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:27.977347 30070 ts_tablet_manager.cc:1403] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.010s
I20260709 13:10:27.980427 30070 raft_consensus.cc:359] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.981170 30070 raft_consensus.cc:385] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.981519 30070 raft_consensus.cc:740] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.982369 30070 consensus_queue.cc:260] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.983631 30078 leader_election.cc:290] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:27.985383 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:27.986141 29850 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.987268 30070 ts_tablet_manager.cc:1434] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:27.988335 30070 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:27.988596 30073 tablet_bootstrap.cc:492] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:27.989162 30073 ts_tablet_manager.cc:1403] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.020s
I20260709 13:10:27.992157 30073 raft_consensus.cc:359] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.992821 30073 raft_consensus.cc:385] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.992762 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:27.993255 30073 raft_consensus.cc:740] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
W20260709 13:10:27.994233 29741 leader_election.cc:343] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.994033 30073 consensus_queue.cc:260] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:27.997167 30070 tablet_bootstrap.cc:654] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.998900 30073 ts_tablet_manager.cc:1434] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:10:28.003058 30073 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:28.003490 30071 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.001530 29850 raft_consensus.cc:2468] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.004024 30071 ts_tablet_manager.cc:1403] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.004s
I20260709 13:10:28.006944 30071 raft_consensus.cc:359] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.007714 30071 raft_consensus.cc:385] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.008011 30071 raft_consensus.cc:740] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.008713 30071 consensus_queue.cc:260] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.009651 29742 leader_election.cc:304] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:28.010402 30073 tablet_bootstrap.cc:654] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.010478 30078 raft_consensus.cc:2804] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.011046 30078 raft_consensus.cc:697] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.012198 30078 consensus_queue.cc:237] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.017621 30071 ts_tablet_manager.cc:1434] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:28.018617 30071 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:28.028534 30070 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:28.029042 30070 ts_tablet_manager.cc:1403] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.005s
I20260709 13:10:28.030586 30071 tablet_bootstrap.cc:654] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.032935 30070 raft_consensus.cc:359] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.033869 30070 raft_consensus.cc:385] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.034145 30070 raft_consensus.cc:740] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.034953 30070 consensus_queue.cc:260] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.039418 30007 raft_consensus.cc:493] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.040052 30007 raft_consensus.cc:515] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.042663 30007 leader_election.cc:290] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.044195 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.044586 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.044869 29925 raft_consensus.cc:2468] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:28.046028 29741 leader_election.cc:304] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.046793 30007 raft_consensus.cc:2804] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.047111 30007 raft_consensus.cc:493] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.047437 30007 raft_consensus.cc:3060] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.048604 30070 ts_tablet_manager.cc:1434] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
I20260709 13:10:28.048734 30071 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.049543 30071 ts_tablet_manager.cc:1403] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.005s
W20260709 13:10:28.051867 29742 leader_election.cc:343] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.053342 30071 raft_consensus.cc:359] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.054334 30071 raft_consensus.cc:385] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.054745 30071 raft_consensus.cc:740] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.055982 30071 consensus_queue.cc:260] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.056680 30070 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:28.065207 30070 tablet_bootstrap.cc:654] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.068599 30007 raft_consensus.cc:515] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.071907 30078 raft_consensus.cc:493] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.074738 30078 raft_consensus.cc:515] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.075206 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
W20260709 13:10:28.076884 29742 leader_election.cc:343] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.078586 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.079051 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.079731 29925 raft_consensus.cc:3060] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.080196 29742 leader_election.cc:343] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.087419 29675 catalog_manager.cc:5697] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.089604 30051 raft_consensus.cc:493] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.090253 30051 raft_consensus.cc:515] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.092157 29925 raft_consensus.cc:2468] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.099036 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.094022 30007 leader_election.cc:290] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.093873 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.100464 29777 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.094900 30058 raft_consensus.cc:493] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.102048 30073 tablet_bootstrap.cc:492] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:28.102552 30073 ts_tablet_manager.cc:1403] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.057s
I20260709 13:10:28.102198 30058 raft_consensus.cc:515] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.103749 29924 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.107860 29815 leader_election.cc:304] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.110680 30073 raft_consensus.cc:359] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.111563 30073 raft_consensus.cc:385] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.111882 30073 raft_consensus.cc:740] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.111713 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.093930 30071 ts_tablet_manager.cc:1434] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.009s
I20260709 13:10:28.097126 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.113018 29926 raft_consensus.cc:2468] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:28.113603 30071 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:28.114423 29741 leader_election.cc:304] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:28.115023 30058 leader_election.cc:290] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:28.095839 30051 leader_election.cc:290] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.112941 30073 consensus_queue.cc:260] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.116328 30051 raft_consensus.cc:493] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.117003 30051 raft_consensus.cc:515] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.117717 30073 ts_tablet_manager.cc:1434] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:28.119164 30073 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:28.119967 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.120837 29777 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:28.122004 30071 tablet_bootstrap.cc:654] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.122766 29889 leader_election.cc:304] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.124549 30058 raft_consensus.cc:2804] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.112202 30096 raft_consensus.cc:2804] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.129484 30058 raft_consensus.cc:493] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.129817 29851 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:28.127908 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.130336 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.128114 30073 tablet_bootstrap.cc:654] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.132582 29815 leader_election.cc:343] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.133311 30058 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.133836 29741 leader_election.cc:304] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:28.135659 30091 raft_consensus.cc:2804] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.098567 30078 leader_election.cc:290] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.129014 30051 leader_election.cc:290] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.130998 29924 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.139101 30091 raft_consensus.cc:697] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.131354 30096 raft_consensus.cc:493] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.128935 30007 raft_consensus.cc:2804] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.140167 30007 raft_consensus.cc:493] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.140712 30007 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.142110 29816 leader_election.cc:304] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.143291 30051 raft_consensus.cc:2804] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.143653 30051 raft_consensus.cc:493] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.143968 30051 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.144328 30091 consensus_queue.cc:237] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.153954 30071 tablet_bootstrap.cc:492] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.154500 30071 ts_tablet_manager.cc:1403] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.006s
I20260709 13:10:28.140368 30096 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.157722 30071 raft_consensus.cc:359] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.158438 30071 raft_consensus.cc:385] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.158780 30071 raft_consensus.cc:740] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.159637 30071 consensus_queue.cc:260] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.161612 30051 raft_consensus.cc:515] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.162151 30071 ts_tablet_manager.cc:1434] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:28.158502 30007 raft_consensus.cc:515] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.167472 30070 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:28.171892 30070 ts_tablet_manager.cc:1403] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.115s	user 0.025s	sys 0.029s
I20260709 13:10:28.172272 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.172902 29777 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.173007 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.173633 29924 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.175784 30070 raft_consensus.cc:359] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.176743 30070 raft_consensus.cc:385] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.177112 30070 raft_consensus.cc:740] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.178117 30070 consensus_queue.cc:260] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.180101 30071 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:28.181550 29924 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.182346 30051 leader_election.cc:290] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.183004 29816 leader_election.cc:304] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.184193 30007 leader_election.cc:290] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.184310 30096 raft_consensus.cc:515] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.184772 30051 raft_consensus.cc:2804] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.185352 30051 raft_consensus.cc:697] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.184875 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.186470 30096 leader_election.cc:290] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.186587 29851 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.190517 30071 tablet_bootstrap.cc:654] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.194782 30070 ts_tablet_manager.cc:1434] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:10:28.186980 30051 consensus_queue.cc:237] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.185992 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.187297 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.187960 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.195983 29924 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.196211 29775 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.198145 29851 raft_consensus.cc:2468] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.199458 29742 leader_election.cc:304] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.200281 30007 raft_consensus.cc:2804] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.200686 30007 raft_consensus.cc:697] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.201349 30007 consensus_queue.cc:237] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.202244 29924 raft_consensus.cc:2468] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.189078 29777 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.189354 30073 tablet_bootstrap.cc:492] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:28.204247 30073 ts_tablet_manager.cc:1403] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.014s
I20260709 13:10:28.195940 30071 tablet_bootstrap.cc:492] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.206616 30071 ts_tablet_manager.cc:1403] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 13:10:28.207161 30073 raft_consensus.cc:359] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.207903 30073 raft_consensus.cc:385] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.208242 30073 raft_consensus.cc:740] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.170037 30058 raft_consensus.cc:515] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.210120 30058 leader_election.cc:290] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:28.210891 29925 raft_consensus.cc:2393] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22057d0d84e640a4ba52bbae0dc74494 in current term 1: Already voted for candidate 9a237313f4d54a58bf56170293a10edd in this term.
I20260709 13:10:28.203614 29775 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.211421 29776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.212273 29815 leader_election.cc:304] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.212530 29776 raft_consensus.cc:2393] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a237313f4d54a58bf56170293a10edd in current term 1: Already voted for candidate 22057d0d84e640a4ba52bbae0dc74494 in this term.
I20260709 13:10:28.213122 30096 raft_consensus.cc:2804] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.213655 30096 raft_consensus.cc:697] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.214468 30096 consensus_queue.cc:237] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.214175 29675 catalog_manager.cc:5697] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.217748 30058 raft_consensus.cc:493] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.218048 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.218232 30058 raft_consensus.cc:515] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.223548 29777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.224411 30073 consensus_queue.cc:260] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.225270 30071 raft_consensus.cc:359] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.226109 30071 raft_consensus.cc:385] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.226434 30071 raft_consensus.cc:740] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.227391 30058 leader_election.cc:290] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:28.227224 30071 consensus_queue.cc:260] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.195868 30070 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:28.229707 30071 ts_tablet_manager.cc:1434] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:10:28.231369 30091 raft_consensus.cc:493] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.233095 30091 raft_consensus.cc:515] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.233392 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.234027 29851 raft_consensus.cc:2468] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 0.
I20260709 13:10:28.234432 29889 leader_election.cc:304] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a237313f4d54a58bf56170293a10edd; no voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.235168 30091 leader_election.cc:290] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.235345 29891 leader_election.cc:304] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.235818 30073 ts_tablet_manager.cc:1434] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:10:28.236865 30073 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:28.237115 30102 raft_consensus.cc:2749] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.237181 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.237901 29850 raft_consensus.cc:2468] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
W20260709 13:10:28.238562 29889 leader_election.cc:343] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.239202 29742 leader_election.cc:304] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.237946 30102 raft_consensus.cc:2804] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.240087 30102 raft_consensus.cc:493] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.240430 30102 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.241569 30070 tablet_bootstrap.cc:654] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.247125 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.247423 30091 raft_consensus.cc:2804] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.247798 30091 raft_consensus.cc:493] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.248149 30091 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.252640 30073 tablet_bootstrap.cc:654] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.254626 30070 tablet_bootstrap.cc:492] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:28.255242 30070 ts_tablet_manager.cc:1403] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.002s
I20260709 13:10:28.236796 30071 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:28.258383 30070 raft_consensus.cc:359] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.259112 30070 raft_consensus.cc:385] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.259509 30070 raft_consensus.cc:740] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.259582 30102 raft_consensus.cc:515] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.260653 30070 consensus_queue.cc:260] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.262401 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.263240 29675 catalog_manager.cc:5697] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.263593 29925 raft_consensus.cc:2393] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81f8147af9ea4940b06921d63f8c233b in current term 1: Already voted for candidate 9a237313f4d54a58bf56170293a10edd in this term.
I20260709 13:10:28.267326 30070 ts_tablet_manager.cc:1434] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:28.268592 30070 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:28.268947 30071 tablet_bootstrap.cc:654] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.272846 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.273445 29850 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.274000 30102 leader_election.cc:290] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:28.275326 30091 raft_consensus.cc:515] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.276484 29775 raft_consensus.cc:2393] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a237313f4d54a58bf56170293a10edd in current term 1: Already voted for candidate 81f8147af9ea4940b06921d63f8c233b in this term.
I20260709 13:10:28.278347 30096 raft_consensus.cc:493] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.278853 30096 raft_consensus.cc:515] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.280684 29850 raft_consensus.cc:2468] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 1.
I20260709 13:10:28.281788 29891 leader_election.cc:304] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.282508 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45dfc083ae14c7399eecb82ba10656f" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.282708 30091 leader_election.cc:290] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.283023 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.283350 30102 raft_consensus.cc:2804] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.283819 29851 raft_consensus.cc:2393] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81f8147af9ea4940b06921d63f8c233b in current term 1: Already voted for candidate 9a237313f4d54a58bf56170293a10edd in this term.
I20260709 13:10:28.283869 30102 raft_consensus.cc:697] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:28.283133 29775 raft_consensus.cc:2468] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.283860 30096 leader_election.cc:290] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.285791 29815 leader_election.cc:304] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.286600 30096 raft_consensus.cc:2804] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.286942 30096 raft_consensus.cc:493] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.287236 30096 raft_consensus.cc:3060] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.290235 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.290612 30102 consensus_queue.cc:237] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.291580 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45dfc083ae14c7399eecb82ba10656f" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.292183 29925 raft_consensus.cc:2468] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.293965 30096 raft_consensus.cc:515] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.294373 29741 leader_election.cc:304] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b; no voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:28.295110 30091 raft_consensus.cc:2749] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.297341 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45dfc083ae14c7399eecb82ba10656f" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.296723 29674 catalog_manager.cc:5697] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.297921 29775 raft_consensus.cc:3060] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.290581 30070 tablet_bootstrap.cc:654] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.296700 30073 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:28.302991 30073 ts_tablet_manager.cc:1403] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.007s
I20260709 13:10:28.304630 29775 raft_consensus.cc:2468] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.305701 29815 leader_election.cc:304] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.306493 30051 raft_consensus.cc:2804] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.306484 30073 raft_consensus.cc:359] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.325709 30096 leader_election.cc:290] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.330546 30073 raft_consensus.cc:385] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.331460 30073 raft_consensus.cc:740] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.315280 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45dfc083ae14c7399eecb82ba10656f" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.307237 30051 raft_consensus.cc:697] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.319543 29674 catalog_manager.cc:5697] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 1 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.332391 29925 raft_consensus.cc:3060] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.332690 30051 consensus_queue.cc:237] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.334353 30071 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.334841 30071 ts_tablet_manager.cc:1403] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.098s	user 0.028s	sys 0.021s
I20260709 13:10:28.332280 30073 consensus_queue.cc:260] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.323556 30070 tablet_bootstrap.cc:492] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:28.336333 30070 ts_tablet_manager.cc:1403] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 13:10:28.348688 30071 raft_consensus.cc:359] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.349558 30071 raft_consensus.cc:385] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.349835 30071 raft_consensus.cc:740] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.350767 30073 ts_tablet_manager.cc:1434] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:10:28.352970 30073 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: Bootstrap starting.
I20260709 13:10:28.351552 30070 raft_consensus.cc:359] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.353652 30070 raft_consensus.cc:385] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.353928 30070 raft_consensus.cc:740] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.354570 30070 consensus_queue.cc:260] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.350454 30071 consensus_queue.cc:260] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.355485 29925 raft_consensus.cc:2468] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.356796 30071 ts_tablet_manager.cc:1434] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.009s
I20260709 13:10:28.357754 30071 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: Bootstrap starting.
I20260709 13:10:28.360437 30073 tablet_bootstrap.cc:654] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.363104 30071 tablet_bootstrap.cc:654] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.366364 30070 ts_tablet_manager.cc:1434] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:28.371348 30073 tablet_bootstrap.cc:492] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: No bootstrap required, opened a new log
I20260709 13:10:28.371908 30073 ts_tablet_manager.cc:1403] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:10:28.374655 30073 raft_consensus.cc:359] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.378942 30073 raft_consensus.cc:385] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.379280 30073 raft_consensus.cc:740] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.380897 30070 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: Bootstrap starting.
I20260709 13:10:28.380653 30073 consensus_queue.cc:260] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.380594 29671 catalog_manager.cc:5697] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.381669 30071 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: No bootstrap required, opened a new log
I20260709 13:10:28.382447 30071 ts_tablet_manager.cc:1403] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 13:10:28.382891 29671 catalog_manager.cc:5697] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.388234 30073 ts_tablet_manager.cc:1434] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:10:28.389003 30071 raft_consensus.cc:359] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.389551 30071 raft_consensus.cc:385] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.389817 30071 raft_consensus.cc:740] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.390827 30071 consensus_queue.cc:260] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.393023 30071 ts_tablet_manager.cc:1434] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:10:28.393379 30070 tablet_bootstrap.cc:654] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.398521 30070 tablet_bootstrap.cc:492] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: No bootstrap required, opened a new log
I20260709 13:10:28.398936 30070 ts_tablet_manager.cc:1403] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:10:28.401522 30070 raft_consensus.cc:359] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.402096 30070 raft_consensus.cc:385] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.402344 30070 raft_consensus.cc:740] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.403013 30070 consensus_queue.cc:260] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.404763 30070 ts_tablet_manager.cc:1434] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:28.436735 30051 raft_consensus.cc:493] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.437228 30051 raft_consensus.cc:515] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.438782 30051 leader_election.cc:290] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.439687 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.439806 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.440445 29775 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.440587 29925 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 0.
I20260709 13:10:28.441848 29815 leader_election.cc:304] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.442636 30051 raft_consensus.cc:2804] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.443008 30051 raft_consensus.cc:493] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.443379 30051 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.448539 30051 raft_consensus.cc:515] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.450265 30051 leader_election.cc:290] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.450980 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.451257 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.451596 29775 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.451879 29924 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.452570 30091 consensus_queue.cc:1048] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.457906 29775 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.458155 29924 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 1.
I20260709 13:10:28.459226 29815 leader_election.cc:304] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.460067 30051 raft_consensus.cc:2804] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.460525 30051 raft_consensus.cc:697] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.461280 30051 consensus_queue.cc:237] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.464890 29924 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.477656 29674 catalog_manager.cc:5697] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.479719 30091 consensus_queue.cc:1048] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.551390 30091 raft_consensus.cc:493] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.551805 30091 raft_consensus.cc:515] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.553615 30091 leader_election.cc:290] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.554119 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494" is_pre_election: true
I20260709 13:10:28.554641 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.554822 29850 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:28.555385 29924 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 0.
I20260709 13:10:28.555922 29742 leader_election.cc:304] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.556739 30091 raft_consensus.cc:2804] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.557096 30091 raft_consensus.cc:493] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.557384 30091 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.562080 30091 raft_consensus.cc:515] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.563920 30091 leader_election.cc:290] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.563943 30051 raft_consensus.cc:493] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.564302 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.564705 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.564847 29850 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.564692 30051 raft_consensus.cc:515] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.565372 29924 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.567391 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f8147af9ea4940b06921d63f8c233b" is_pre_election: true
I20260709 13:10:28.567734 29925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740e7575e252493388b5ed977e124444" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a237313f4d54a58bf56170293a10edd" is_pre_election: true
I20260709 13:10:28.568547 29925 raft_consensus.cc:2393] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22057d0d84e640a4ba52bbae0dc74494 in current term 1: Already voted for candidate 81f8147af9ea4940b06921d63f8c233b in this term.
I20260709 13:10:28.569205 30051 leader_election.cc:290] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.569669 29816 leader_election.cc:304] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494; no voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:28.570851 30097 raft_consensus.cc:3060] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.571545 29850 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.571893 29924 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 1.
I20260709 13:10:28.572685 29742 leader_election.cc:304] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.573911 30091 raft_consensus.cc:2804] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.574373 30091 raft_consensus.cc:697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.575067 30091 consensus_queue.cc:237] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.580598 30097 raft_consensus.cc:2749] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.582772 29674 catalog_manager.cc:5697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 1 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.641513 30091 consensus_queue.cc:1048] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.651151 30093 consensus_queue.cc:1048] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.659575 30097 consensus_queue.cc:1048] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.670290 30051 consensus_queue.cc:1048] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.689249 30051 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.692773 30093 consensus_queue.cc:1048] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.708482 30097 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.708732 30091 consensus_queue.cc:1048] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.743698 29924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f442a15843043e78252e99da923c3ee"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:35968
I20260709 13:10:28.744314 29924 raft_consensus.cc:606] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.749042 29850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:56042
I20260709 13:10:28.749490 29850 raft_consensus.cc:606] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.753783 29850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:56042
I20260709 13:10:28.754132 29850 raft_consensus.cc:606] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Received request to transfer leadership to TS 81f8147af9ea4940b06921d63f8c233b
I20260709 13:10:28.760850 29775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:28.761314 29775 raft_consensus.cc:606] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:28.765952 29775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:28.766394 29775 raft_consensus.cc:606] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:28.769152 30102 consensus_queue.cc:1048] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.771450 29777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:38656
I20260709 13:10:28.771942 29777 raft_consensus.cc:606] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 22057d0d84e640a4ba52bbae0dc74494
I20260709 13:10:28.777204 30058 raft_consensus.cc:993] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:28.777287 29850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27ea29214a044bbe855286040ce632fd"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:56042
I20260709 13:10:28.777908 29850 raft_consensus.cc:606] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:28.777958 30102 raft_consensus.cc:1081] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:28.780511 29777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f442a15843043e78252e99da923c3ee"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:10:28.781049 29777 raft_consensus.cc:493] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:28.781343 29777 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.786309 29777 raft_consensus.cc:515] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.788586 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.789095 29850 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.790145 29777 leader_election.cc:290] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.791134 29775 raft_consensus.cc:1240] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Rejecting Update request from peer 9a237313f4d54a58bf56170293a10edd for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.791585 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f442a15843043e78252e99da923c3ee" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.792178 29924 raft_consensus.cc:3055] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.792505 29924 raft_consensus.cc:740] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:28.793419 29924 consensus_queue.cc:260] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.794265 29924 raft_consensus.cc:3060] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.795083 29850 raft_consensus.cc:2468] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:28.795756 29851 raft_consensus.cc:1240] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Rejecting Update request from peer 9a237313f4d54a58bf56170293a10edd for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.796101 29742 leader_election.cc:304] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 81f8147af9ea4940b06921d63f8c233b; no voters: 
I20260709 13:10:28.796834 30091 raft_consensus.cc:2804] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.797241 30091 raft_consensus.cc:697] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.798007 30091 consensus_queue.cc:237] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.800014 29924 raft_consensus.cc:2468] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:28.805435 29673 catalog_manager.cc:5697] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 9a237313f4d54a58bf56170293a10edd (127.19.145.3) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.841257 30097 consensus_queue.cc:1048] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.850708 30096 consensus_queue.cc:1048] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.855216 30007 raft_consensus.cc:993] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:28.855703 30007 raft_consensus.cc:1081] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:28.857142 29851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:28.857630 29851 raft_consensus.cc:493] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:28.857986 29851 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.863849 29851 raft_consensus.cc:515] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.865893 29851 leader_election.cc:290] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:28.866170 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.866480 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a068825888740c0ba487ca25623a9c2" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:28.866829 29775 raft_consensus.cc:3055] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.867182 29924 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.867205 29775 raft_consensus.cc:740] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:28.868290 29775 consensus_queue.cc:260] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.869340 29775 raft_consensus.cc:3060] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.872193 29924 raft_consensus.cc:2468] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:28.873176 29816 leader_election.cc:304] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.873929 30051 raft_consensus.cc:2804] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.874310 30051 raft_consensus.cc:697] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.874378 29775 raft_consensus.cc:2468] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:28.875031 30051 consensus_queue.cc:237] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.881328 29671 catalog_manager.cc:5697] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.908938 30051 consensus_queue.cc:1048] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.918802 30097 consensus_queue.cc:1048] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.927497 30096 raft_consensus.cc:993] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:28.927981 30097 raft_consensus.cc:1081] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:28.929508 29924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27ea29214a044bbe855286040ce632fd"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:10:28.930033 29924 raft_consensus.cc:493] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:28.930393 29924 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.935611 29924 raft_consensus.cc:515] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.937181 29924 leader_election.cc:290] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:28.937778 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:28.938227 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ea29214a044bbe855286040ce632fd" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:28.938380 29775 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.938695 29851 raft_consensus.cc:3055] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.938956 29851 raft_consensus.cc:740] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:28.939656 29851 consensus_queue.cc:260] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.940482 29851 raft_consensus.cc:3060] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.943120 29775 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:28.944362 29889 leader_election.cc:304] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:28.945129 30102 raft_consensus.cc:2804] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.945587 30102 raft_consensus.cc:697] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:28.946628 29851 raft_consensus.cc:2468] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:28.946364 30102 consensus_queue.cc:237] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:28.952787 29673 catalog_manager.cc:5697] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 1 to 2, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 2 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.006044 30091 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.011855 30007 raft_consensus.cc:993] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:29.012354 30093 raft_consensus.cc:1081] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:29.013979 29850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:29.014866 29850 raft_consensus.cc:493] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.015216 29850 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.017987 30093 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.021512 29850 raft_consensus.cc:515] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.024689 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:29.025182 29775 raft_consensus.cc:3055] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.025477 29775 raft_consensus.cc:740] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:29.025849 29850 leader_election.cc:290] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:29.027379 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:29.027163 29775 consensus_queue.cc:260] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.027921 29924 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.028592 29775 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.034310 29924 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:29.035048 29775 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:29.035598 29816 leader_election.cc:304] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:29.036455 30097 raft_consensus.cc:2804] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.036914 30097 raft_consensus.cc:697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:29.037678 30097 consensus_queue.cc:237] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.045404 29671 catalog_manager.cc:5697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.104012 30091 raft_consensus.cc:993] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:29.104535 30093 raft_consensus.cc:1081] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 22057d0d84e640a4ba52bbae0dc74494 to start an election
I20260709 13:10:29.105953 29850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
 from {username='slave'} at 127.0.0.1:56030
I20260709 13:10:29.106374 29850 raft_consensus.cc:493] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.106642 29850 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.111219 29850 raft_consensus.cc:515] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.112715 29850 leader_election.cc:290] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:29.113435 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:29.113696 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af02f33bf0f64580bb89af11c1347561" candidate_uuid: "22057d0d84e640a4ba52bbae0dc74494" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:29.114064 29775 raft_consensus.cc:3055] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.114286 29924 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.114480 29775 raft_consensus.cc:740] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:29.115406 29775 consensus_queue.cc:260] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.116508 29775 raft_consensus.cc:3060] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.119722 29924 raft_consensus.cc:2468] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:29.120645 29816 leader_election.cc:304] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:29.121366 30097 raft_consensus.cc:2804] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.121835 30097 raft_consensus.cc:697] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Leader. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:29.122193 29775 raft_consensus.cc:2468] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22057d0d84e640a4ba52bbae0dc74494 in term 2.
I20260709 13:10:29.122666 30097 consensus_queue.cc:237] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.128904 29671 catalog_manager.cc:5697] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "22057d0d84e640a4ba52bbae0dc74494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.170316 30096 raft_consensus.cc:993] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:29.170842 30096 raft_consensus.cc:1081] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:29.172679 29775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:10:29.173309 29775 raft_consensus.cc:493] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.173750 29775 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.180171 29775 raft_consensus.cc:515] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.182034 29775 leader_election.cc:290] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:29.182973 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:29.184033 29850 raft_consensus.cc:3055] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.184389 29850 raft_consensus.cc:740] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:29.185228 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c81258d55ef4de98ee34f3bf8bcd347" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:29.185118 29850 consensus_queue.cc:260] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.185761 29924 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.186262 29850 raft_consensus.cc:3060] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.191918 29924 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:29.192184 29850 raft_consensus.cc:2468] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:29.192967 29741 leader_election.cc:304] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:29.193727 30093 raft_consensus.cc:2804] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.194206 30093 raft_consensus.cc:697] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:29.194887 30093 consensus_queue.cc:237] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.200714 29671 catalog_manager.cc:5697] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.209261 29924 raft_consensus.cc:1275] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.210148 30093 consensus_queue.cc:1048] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.219617 29850 raft_consensus.cc:1275] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.222379 30139 consensus_queue.cc:1048] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.260252 30096 raft_consensus.cc:993] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:29.260696 30097 raft_consensus.cc:1081] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Signalling peer 81f8147af9ea4940b06921d63f8c233b to start an election
I20260709 13:10:29.262081 29775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:10:29.262634 29775 raft_consensus.cc:493] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.262989 29775 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.267704 29775 raft_consensus.cc:515] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.269006 29775 leader_election.cc:290] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Requested vote from peers 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575), 9a237313f4d54a58bf56170293a10edd (127.19.145.3:46267)
I20260709 13:10:29.269726 29850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:29.269939 29924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "81f8147af9ea4940b06921d63f8c233b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a237313f4d54a58bf56170293a10edd"
I20260709 13:10:29.270349 29850 raft_consensus.cc:3055] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.270414 29924 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.270694 29850 raft_consensus.cc:740] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:29.271448 29850 consensus_queue.cc:260] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.272547 29850 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.276546 29924 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:29.277566 29741 leader_election.cc:304] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:29.278259 30139 raft_consensus.cc:2804] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.278719 30139 raft_consensus.cc:697] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Leader. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:29.279386 29850 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f8147af9ea4940b06921d63f8c233b in term 2.
I20260709 13:10:29.279537 30139 consensus_queue.cc:237] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:29.286952 29671 catalog_manager.cc:5697] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b reported cstate change: term changed from 1 to 2, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 81f8147af9ea4940b06921d63f8c233b (127.19.145.1). New cstate: current_term: 2 leader_uuid: "81f8147af9ea4940b06921d63f8c233b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.358716 29850 raft_consensus.cc:1275] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.359899 30102 consensus_queue.cc:1048] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.366452 29775 raft_consensus.cc:1275] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.367884 30141 consensus_queue.cc:1048] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:29.473264 29925 raft_consensus.cc:1275] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.473493 29775 raft_consensus.cc:1275] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.474663 30096 consensus_queue.cc:1048] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.475307 30097 consensus_queue.cc:1048] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.549365 29925 raft_consensus.cc:1275] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.550534 30097 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.558637 29775 raft_consensus.cc:1275] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.559949 30051 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.634424 29850 raft_consensus.cc:1275] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.635823 30139 consensus_queue.cc:1048] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.642522 29925 raft_consensus.cc:1275] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.643858 30139 consensus_queue.cc:1048] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.669435 29925 raft_consensus.cc:1275] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.670619 30051 consensus_queue.cc:1048] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.678385 29777 raft_consensus.cc:1275] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 22057d0d84e640a4ba52bbae0dc74494: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.679782 30097 consensus_queue.cc:1048] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.798175 29925 raft_consensus.cc:1275] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.799345 30139 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.808048 29851 raft_consensus.cc:1275] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 81f8147af9ea4940b06921d63f8c233b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.810860 30093 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.781764 29671 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38082:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:31.799166 29671 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38082:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:31.827214 20036 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:31.908951 30177 tablet.cc:1724] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:31.989832 29878 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d45dfc083ae14c7399eecb82ba10656f)
W20260709 13:10:32.034361 29878 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d45dfc083ae14c7399eecb82ba10656f)
W20260709 13:10:32.060828 29878 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d45dfc083ae14c7399eecb82ba10656f)
I20260709 13:10:32.056562 30190 tablet.cc:1724] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.144296 30206 tablet.cc:1724] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.156721 30199 tablet.cc:1724] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.175175 30210 tablet.cc:1724] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:32.192937 29741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:46267, user_credentials={real_user=slave}} blocked reactor thread for 51011.6us
I20260709 13:10:32.197853 30218 tablet.cc:1724] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.200434 30215 tablet.cc:1724] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.213639 30219 tablet.cc:1724] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.218699 30213 tablet.cc:1724] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.204999 30177 tablet.cc:1724] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.254626 30216 tablet.cc:1724] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.264423 30224 tablet.cc:1724] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.277092 30190 tablet.cc:1724] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.286597 30220 tablet.cc:1724] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.296592 30216 tablet.cc:1724] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.301505 30210 tablet.cc:1724] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.328074 30219 tablet.cc:1724] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.329535 29774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:38672
I20260709 13:10:32.330238 29774 raft_consensus.cc:606] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:32.333098 30213 tablet.cc:1724] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.335978 30206 tablet.cc:1724] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.339975 30219 tablet.cc:1724] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.348176 30199 tablet.cc:1724] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.351862 30219 tablet.cc:1724] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.360476 30206 tablet.cc:1724] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.361740 30218 tablet.cc:1724] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.365065 30219 tablet.cc:1724] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.369915 30215 tablet.cc:1724] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.379412 30177 tablet.cc:1724] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.436565 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:56056
I20260709 13:10:32.437088 29851 raft_consensus.cc:606] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:32.438290 20036 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:32.438807 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.438977 29673 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: soft_deleted_table [id=4755b173f6db482f91bf4455e578b677] alter complete (version 1)
I20260709 13:10:32.449337 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8"
dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:56056
I20260709 13:10:32.449915 29851 raft_consensus.cc:606] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:32.452549 29775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290"
dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
mode: GRACEFUL
new_leader_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:38672
I20260709 13:10:32.453068 29775 raft_consensus.cc:606] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Received request to transfer leadership to TS 9a237313f4d54a58bf56170293a10edd
I20260709 13:10:32.454070 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:32.454506 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:32.640192 30222 raft_consensus.cc:993] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.640370 30097 raft_consensus.cc:993] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.640865 30200 raft_consensus.cc:1081] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.641072 30211 raft_consensus.cc:1081] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.642479 29919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35952
I20260709 13:10:32.642773 29918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:10:32.643077 29919 raft_consensus.cc:493] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.643364 29918 raft_consensus.cc:493] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.643514 29919 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.643755 29918 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.650800 29919 raft_consensus.cc:515] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.650825 29918 raft_consensus.cc:515] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.653225 29918 leader_election.cc:290] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:32.653678 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:32.653867 29919 leader_election.cc:290] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:32.654273 29775 raft_consensus.cc:3055] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.654599 29775 raft_consensus.cc:740] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:32.654922 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e577d48e2fc47aa8c79bae9d580b03c" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:32.655344 29775 consensus_queue.cc:260] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.656113 29851 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.656415 29775 raft_consensus.cc:3060] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.657254 29774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:32.657819 29774 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.655019 29848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31aa958674264708b52aa8fe96b73ed8" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:32.659567 29848 raft_consensus.cc:3055] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.659869 29848 raft_consensus.cc:740] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:32.660547 29848 consensus_queue.cc:260] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.661496 29848 raft_consensus.cc:3060] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.664876 29774 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.666180 29889 leader_election.cc:304] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:32.667129 30217 raft_consensus.cc:2804] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:32.667618 30217 raft_consensus.cc:697] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:32.668453 30217 consensus_queue.cc:237] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.671809 29775 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.672456 29851 raft_consensus.cc:2468] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.673750 29891 leader_election.cc:304] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:32.674463 29848 raft_consensus.cc:2468] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.674558 30217 raft_consensus.cc:2804] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:32.675237 30217 raft_consensus.cc:697] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:32.676097 30217 consensus_queue.cc:237] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.679947 29671 catalog_manager.cc:5697] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 2 to 3, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 3 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.691574 29671 catalog_manager.cc:5697] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 2 to 3, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 3 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.790983 30211 raft_consensus.cc:993] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.791442 30097 raft_consensus.cc:1081] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.792776 29918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:10:32.793169 29918 raft_consensus.cc:493] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.793435 29918 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.798424 29918 raft_consensus.cc:515] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.799978 29918 leader_election.cc:290] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:32.800607 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:32.800892 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c2fcfa1cd447eb5911476cca97f15" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:32.801234 29775 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.801857 29851 raft_consensus.cc:3055] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.802219 29851 raft_consensus.cc:740] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22057d0d84e640a4ba52bbae0dc74494, State: Running, Role: LEADER
I20260709 13:10:32.803249 29851 consensus_queue.cc:260] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.804620 29851 raft_consensus.cc:3060] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.808642 29775 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.809656 29889 leader_election.cc:304] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81f8147af9ea4940b06921d63f8c233b, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:32.810357 30217 raft_consensus.cc:2804] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:32.810736 30217 raft_consensus.cc:697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:32.811537 30217 consensus_queue.cc:237] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.811753 29851 raft_consensus.cc:2468] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 3.
I20260709 13:10:32.818209 29671 catalog_manager.cc:5697] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 2 to 3, leader changed from 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 3 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.939554 30203 raft_consensus.cc:993] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: : Instructing follower 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.939992 30200 raft_consensus.cc:1081] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Signalling peer 9a237313f4d54a58bf56170293a10edd to start an election
I20260709 13:10:32.941366 29918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290"
dest_uuid: "9a237313f4d54a58bf56170293a10edd"
 from {username='slave'} at 127.0.0.1:35952
I20260709 13:10:32.941823 29918 raft_consensus.cc:493] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.942091 29918 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.947572 29918 raft_consensus.cc:515] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.949255 29918 leader_election.cc:290] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Requested vote from peers 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711), 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575)
I20260709 13:10:32.949818 29775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81f8147af9ea4940b06921d63f8c233b"
I20260709 13:10:32.950163 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dace6a4c98f340b1966e9c48d9c8d290" candidate_uuid: "9a237313f4d54a58bf56170293a10edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22057d0d84e640a4ba52bbae0dc74494"
I20260709 13:10:32.950446 29775 raft_consensus.cc:3055] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.950744 29851 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.950807 29775 raft_consensus.cc:740] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81f8147af9ea4940b06921d63f8c233b, State: Running, Role: LEADER
I20260709 13:10:32.951618 29775 consensus_queue.cc:260] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.952539 29775 raft_consensus.cc:3060] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.954989 29851 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:32.955976 29891 leader_election.cc:304] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22057d0d84e640a4ba52bbae0dc74494, 9a237313f4d54a58bf56170293a10edd; no voters: 
I20260709 13:10:32.956652 30217 raft_consensus.cc:2804] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:32.956934 29775 raft_consensus.cc:2468] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a237313f4d54a58bf56170293a10edd in term 2.
I20260709 13:10:32.957032 30217 raft_consensus.cc:697] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Becoming Leader. State: Replica: 9a237313f4d54a58bf56170293a10edd, State: Running, Role: LEADER
I20260709 13:10:32.958070 30217 consensus_queue.cc:237] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } }
I20260709 13:10:32.965619 29671 catalog_manager.cc:5697] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd reported cstate change: term changed from 1 to 2, leader changed from 81f8147af9ea4940b06921d63f8c233b (127.19.145.1) to 9a237313f4d54a58bf56170293a10edd (127.19.145.3). New cstate: current_term: 2 leader_uuid: "9a237313f4d54a58bf56170293a10edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a237313f4d54a58bf56170293a10edd" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 46267 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.116027 29775 raft_consensus.cc:1275] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:33.117190 30217 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.130256 29851 raft_consensus.cc:1275] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:33.131690 30217 consensus_queue.cc:1048] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.176883 29775 raft_consensus.cc:1275] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:33.177843 30217 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:33.181139 29851 raft_consensus.cc:1275] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:33.182255 30148 consensus_queue.cc:1048] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:33.223801 29775 raft_consensus.cc:1275] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:33.224835 30217 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:33.231741 29851 raft_consensus.cc:1275] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:33.233338 30148 consensus_queue.cc:1048] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:33.401959 29851 raft_consensus.cc:1275] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.403141 30148 consensus_queue.cc:1048] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22057d0d84e640a4ba52bbae0dc74494" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.411904 29775 raft_consensus.cc:1275] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Refusing update from remote peer 9a237313f4d54a58bf56170293a10edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.413935 30239 consensus_queue.cc:1048] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f8147af9ea4940b06921d63f8c233b" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.505229 20036 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:33.510748 20036 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:33.511132 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:33.516026 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:33.516397 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:34.543221 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:10:34.568523 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:34.569173 20036 tablet_replica.cc:333] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.569764 20036 raft_consensus.cc:2243] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.570243 20036 raft_consensus.cc:2272] T 7c0c2fcfa1cd447eb5911476cca97f15 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.572098 20036 tablet_replica.cc:333] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.572656 20036 raft_consensus.cc:2243] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.573371 20036 raft_consensus.cc:2272] T 2f442a15843043e78252e99da923c3ee P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.575050 20036 tablet_replica.cc:333] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.575606 20036 raft_consensus.cc:2243] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.576020 20036 raft_consensus.cc:2272] T 4e577d48e2fc47aa8c79bae9d580b03c P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.577574 20036 tablet_replica.cc:333] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.578095 20036 raft_consensus.cc:2243] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.578507 20036 raft_consensus.cc:2272] T af02f33bf0f64580bb89af11c1347561 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.580209 20036 tablet_replica.cc:333] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.580734 20036 raft_consensus.cc:2243] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.581141 20036 raft_consensus.cc:2272] T d45dfc083ae14c7399eecb82ba10656f P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.582713 20036 tablet_replica.cc:333] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.583321 20036 raft_consensus.cc:2243] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.583738 20036 raft_consensus.cc:2272] T 27ea29214a044bbe855286040ce632fd P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.585338 20036 tablet_replica.cc:333] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.585875 20036 raft_consensus.cc:2243] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.586278 20036 raft_consensus.cc:2272] T 1a068825888740c0ba487ca25623a9c2 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.587909 20036 tablet_replica.cc:333] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.588415 20036 raft_consensus.cc:2243] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.589123 20036 raft_consensus.cc:2272] T 740e7575e252493388b5ed977e124444 P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.590711 20036 tablet_replica.cc:333] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.591230 20036 raft_consensus.cc:2243] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.591723 20036 raft_consensus.cc:2272] T 48b09cddc74a49a4be3c81a4b0c818bf P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.593600 20036 tablet_replica.cc:333] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.594110 20036 raft_consensus.cc:2243] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.594497 20036 raft_consensus.cc:2272] T dace6a4c98f340b1966e9c48d9c8d290 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.596305 20036 tablet_replica.cc:333] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.596793 20036 raft_consensus.cc:2243] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.597206 20036 raft_consensus.cc:2272] T 3291c57ce8b04fd2818f8bfc937afc37 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.598961 20036 tablet_replica.cc:333] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.599465 20036 raft_consensus.cc:2243] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.600205 20036 raft_consensus.cc:2272] T 5bac5a93a51e46e186447643e384f973 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.601984 20036 tablet_replica.cc:333] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.602504 20036 raft_consensus.cc:2243] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.602936 20036 raft_consensus.cc:2272] T 31aa958674264708b52aa8fe96b73ed8 P 81f8147af9ea4940b06921d63f8c233b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.604776 20036 tablet_replica.cc:333] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.605314 20036 raft_consensus.cc:2243] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.606081 20036 raft_consensus.cc:2272] T 5e9d82234f504b9c9b89a35b35321766 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.607918 20036 tablet_replica.cc:333] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.608379 20036 raft_consensus.cc:2243] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.609097 20036 raft_consensus.cc:2272] T 7163efc5cd52428b8bf0422b3ef46a24 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.611056 20036 tablet_replica.cc:333] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.611599 20036 raft_consensus.cc:2243] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.612062 20036 raft_consensus.cc:2272] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.614465 20036 tablet_replica.cc:333] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.615005 20036 raft_consensus.cc:2243] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.615727 20036 raft_consensus.cc:2272] T 1c81258d55ef4de98ee34f3bf8bcd347 P 81f8147af9ea4940b06921d63f8c233b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.617417 20036 tablet_replica.cc:333] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b: stopping tablet replica
I20260709 13:10:34.617877 20036 raft_consensus.cc:2243] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.618286 20036 raft_consensus.cc:2272] T 8d590f86870144c7a04b212a06f593fa P 81f8147af9ea4940b06921d63f8c233b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.637095 29889 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:10:34.640156 29889 consensus_peers.cc:597] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd -> Peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Couldn't send request to peer 81f8147af9ea4940b06921d63f8c233b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.646961 29889 consensus_peers.cc:597] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd -> Peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Couldn't send request to peer 81f8147af9ea4940b06921d63f8c233b. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:34711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.657357 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
I20260709 13:10:34.685639 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
I20260709 13:10:34.711722 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:34.712535 20036 tablet_replica.cc:333] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.713132 20036 raft_consensus.cc:2243] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.713617 20036 raft_consensus.cc:2272] T 740e7575e252493388b5ed977e124444 P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.715548 20036 tablet_replica.cc:333] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.716091 20036 raft_consensus.cc:2243] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.716806 20036 raft_consensus.cc:2272] T af02f33bf0f64580bb89af11c1347561 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.718447 20036 tablet_replica.cc:333] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.718966 20036 raft_consensus.cc:2243] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.719477 20036 raft_consensus.cc:2272] T 27ea29214a044bbe855286040ce632fd P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.721318 20036 tablet_replica.cc:333] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.721870 20036 raft_consensus.cc:2243] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.722618 20036 raft_consensus.cc:2272] T 1a068825888740c0ba487ca25623a9c2 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.723057 29891 consensus_peers.cc:597] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd -> Peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Couldn't send request to peer 22057d0d84e640a4ba52bbae0dc74494. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.724375 20036 tablet_replica.cc:333] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.724987 20036 raft_consensus.cc:2243] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.725390 20036 raft_consensus.cc:2272] T 7c0c2fcfa1cd447eb5911476cca97f15 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.727077 20036 tablet_replica.cc:333] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.727630 20036 raft_consensus.cc:2243] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.728032 20036 raft_consensus.cc:2272] T 2f442a15843043e78252e99da923c3ee P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.729780 20036 tablet_replica.cc:333] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.730327 20036 raft_consensus.cc:2243] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.731036 20036 raft_consensus.cc:2272] T d45dfc083ae14c7399eecb82ba10656f P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.732815 20036 tablet_replica.cc:333] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.733420 20036 raft_consensus.cc:2243] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.733843 20036 raft_consensus.cc:2272] T 4e577d48e2fc47aa8c79bae9d580b03c P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.735618 20036 tablet_replica.cc:333] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.736140 20036 raft_consensus.cc:2243] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.736565 20036 raft_consensus.cc:2272] T 1c81258d55ef4de98ee34f3bf8bcd347 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.738369 20036 tablet_replica.cc:333] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.738924 20036 raft_consensus.cc:2243] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.739893 20036 raft_consensus.cc:2272] T 8d590f86870144c7a04b212a06f593fa P 22057d0d84e640a4ba52bbae0dc74494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.742120 20036 tablet_replica.cc:333] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.742662 20036 raft_consensus.cc:2243] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:34.742970 29891 consensus_peers.cc:597] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd -> Peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Couldn't send request to peer 22057d0d84e640a4ba52bbae0dc74494. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.743077 20036 raft_consensus.cc:2272] T dace6a4c98f340b1966e9c48d9c8d290 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.745232 20036 tablet_replica.cc:333] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.745739 20036 raft_consensus.cc:2243] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.746192 20036 raft_consensus.cc:2272] T 3291c57ce8b04fd2818f8bfc937afc37 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.748076 20036 tablet_replica.cc:333] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.748613 20036 raft_consensus.cc:2243] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.749063 20036 raft_consensus.cc:2272] T 31aa958674264708b52aa8fe96b73ed8 P 22057d0d84e640a4ba52bbae0dc74494 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.750859 20036 tablet_replica.cc:333] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.751408 20036 raft_consensus.cc:2243] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.751847 20036 raft_consensus.cc:2272] T 7163efc5cd52428b8bf0422b3ef46a24 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.753644 20036 tablet_replica.cc:333] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.754136 20036 raft_consensus.cc:2243] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.754856 20036 raft_consensus.cc:2272] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.756747 20036 tablet_replica.cc:333] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.757234 20036 raft_consensus.cc:2243] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.757688 20036 raft_consensus.cc:2272] T 5e9d82234f504b9c9b89a35b35321766 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.759594 20036 tablet_replica.cc:333] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.760063 20036 raft_consensus.cc:2243] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.760828 20036 raft_consensus.cc:2272] T 48b09cddc74a49a4be3c81a4b0c818bf P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.762679 20036 tablet_replica.cc:333] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494: stopping tablet replica
I20260709 13:10:34.763154 20036 raft_consensus.cc:2243] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.763633 20036 raft_consensus.cc:2272] T 5bac5a93a51e46e186447643e384f973 P 22057d0d84e640a4ba52bbae0dc74494 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.800767 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
W20260709 13:10:34.822544 29891 consensus_peers.cc:597] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd -> Peer 22057d0d84e640a4ba52bbae0dc74494 (127.19.145.2:34575): Couldn't send request to peer 22057d0d84e640a4ba52bbae0dc74494. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.2:34575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.831491 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:10:34.866384 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:34.867048 20036 tablet_replica.cc:333] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.867658 20036 raft_consensus.cc:2243] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.868458 20036 raft_consensus.cc:2272] T 27ea29214a044bbe855286040ce632fd P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.870237 20036 tablet_replica.cc:333] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.870774 20036 raft_consensus.cc:2243] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.871198 20036 raft_consensus.cc:2272] T 1a068825888740c0ba487ca25623a9c2 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.872879 20036 tablet_replica.cc:333] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.873425 20036 raft_consensus.cc:2243] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.873844 20036 raft_consensus.cc:2272] T d45dfc083ae14c7399eecb82ba10656f P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.875536 20036 tablet_replica.cc:333] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.876060 20036 raft_consensus.cc:2243] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.876493 20036 raft_consensus.cc:2272] T af02f33bf0f64580bb89af11c1347561 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.878110 20036 tablet_replica.cc:333] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.878626 20036 raft_consensus.cc:2243] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.879423 20036 raft_consensus.cc:2272] T 4e577d48e2fc47aa8c79bae9d580b03c P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.881073 20036 tablet_replica.cc:333] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.881608 20036 raft_consensus.cc:2243] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.882016 20036 raft_consensus.cc:2272] T 740e7575e252493388b5ed977e124444 P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.883673 20036 tablet_replica.cc:333] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.884222 20036 raft_consensus.cc:2243] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.884637 20036 raft_consensus.cc:2272] T 48b09cddc74a49a4be3c81a4b0c818bf P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.886433 20036 tablet_replica.cc:333] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.886920 20036 raft_consensus.cc:2243] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.887394 20036 raft_consensus.cc:2272] T 1c81258d55ef4de98ee34f3bf8bcd347 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.888996 20036 tablet_replica.cc:333] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.889514 20036 raft_consensus.cc:2243] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.889932 20036 raft_consensus.cc:2272] T 8d590f86870144c7a04b212a06f593fa P 9a237313f4d54a58bf56170293a10edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.891891 20036 tablet_replica.cc:333] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.892581 20036 raft_consensus.cc:2243] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.893118 20036 raft_consensus.cc:2272] T 5bac5a93a51e46e186447643e384f973 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.895294 20036 tablet_replica.cc:333] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.895972 20036 raft_consensus.cc:2243] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:10:34.896548 29889 consensus_peers.cc:597] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd -> Peer 81f8147af9ea4940b06921d63f8c233b (127.19.145.1:34711): Couldn't send request to peer 81f8147af9ea4940b06921d63f8c233b. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:34711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.896847 20036 raft_consensus.cc:2272] T 7c0c2fcfa1cd447eb5911476cca97f15 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.898648 20036 tablet_replica.cc:333] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.899161 20036 raft_consensus.cc:2243] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.899631 20036 raft_consensus.cc:2272] T 2f442a15843043e78252e99da923c3ee P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.901304 20036 tablet_replica.cc:333] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.901834 20036 raft_consensus.cc:2243] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.902522 20036 raft_consensus.cc:2272] T dace6a4c98f340b1966e9c48d9c8d290 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.904458 20036 tablet_replica.cc:333] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.905012 20036 raft_consensus.cc:2243] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.905728 20036 raft_consensus.cc:2272] T 3291c57ce8b04fd2818f8bfc937afc37 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.907693 20036 tablet_replica.cc:333] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.908195 20036 raft_consensus.cc:2243] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.908622 20036 raft_consensus.cc:2272] T 7163efc5cd52428b8bf0422b3ef46a24 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.910511 20036 tablet_replica.cc:333] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.911001 20036 raft_consensus.cc:2243] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.911460 20036 raft_consensus.cc:2272] T 59f03d9152894ed6bb3d61fc5e6a9a16 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.913233 20036 tablet_replica.cc:333] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.913769 20036 raft_consensus.cc:2243] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.914268 20036 raft_consensus.cc:2272] T 5e9d82234f504b9c9b89a35b35321766 P 9a237313f4d54a58bf56170293a10edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.916262 20036 tablet_replica.cc:333] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd: stopping tablet replica
I20260709 13:10:34.916742 20036 raft_consensus.cc:2243] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.917461 20036 raft_consensus.cc:2272] T 31aa958674264708b52aa8fe96b73ed8 P 9a237313f4d54a58bf56170293a10edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.955487 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:10:34.983682 20036 master.cc:562] Master@127.19.145.62:39789 shutting down...
I20260709 13:10:35.004320 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.004873 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.005215 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 517d2a4d58c345fc838481b249034ae2: stopping tablet replica
I20260709 13:10:35.025332 20036 master.cc:584] Master@127.19.145.62:39789 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12351 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:35.075459 20036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.145.62:43531
I20260709 13:10:35.076538 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.082341 30247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.082353 30246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.082599 30249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.084870 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:35.085686 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.085868 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.085983 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602635085973 us; error 0 us; skew 500 ppm
I20260709 13:10:35.086409 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.088603 20036 webserver.cc:533] Webserver started at http://127.19.145.62:33435/ using document root <none> and password file <none>
I20260709 13:10:35.089032 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.089176 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.089372 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.090466 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/master-0-root/instance:
uuid: "991c46b8c2724c2eb5a5ab8615db490e"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.094669 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:10:35.097754 30254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.098515 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:35.098794 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/master-0-root
uuid: "991c46b8c2724c2eb5a5ab8615db490e"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.099076 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.132328 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.133558 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.172602 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.62:43531
I20260709 13:10:35.172744 30305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.62:43531 every 8 connection(s)
I20260709 13:10:35.178205 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.189219 30306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: Bootstrap starting.
I20260709 13:10:35.193980 30306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.197921 30306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: No bootstrap required, opened a new log
I20260709 13:10:35.200066 30306 raft_consensus.cc:359] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER }
I20260709 13:10:35.200487 30306 raft_consensus.cc:385] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.200739 30306 raft_consensus.cc:740] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991c46b8c2724c2eb5a5ab8615db490e, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.201359 30306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER }
I20260709 13:10:35.201833 30306 raft_consensus.cc:399] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:35.202055 30306 raft_consensus.cc:493] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:35.202345 30306 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.206585 30306 raft_consensus.cc:515] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER }
I20260709 13:10:35.207077 30306 leader_election.cc:304] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 991c46b8c2724c2eb5a5ab8615db490e; no voters: 
I20260709 13:10:35.208223 30306 leader_election.cc:290] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:35.208546 30309 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.209830 30309 raft_consensus.cc:697] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 1 LEADER]: Becoming Leader. State: Replica: 991c46b8c2724c2eb5a5ab8615db490e, State: Running, Role: LEADER
I20260709 13:10:35.210460 30309 consensus_queue.cc:237] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER }
I20260709 13:10:35.211081 30306 sys_catalog.cc:565] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:35.215024 30311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 991c46b8c2724c2eb5a5ab8615db490e. Latest consensus state: current_term: 1 leader_uuid: "991c46b8c2724c2eb5a5ab8615db490e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER } }
I20260709 13:10:35.215821 30311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:35.216775 30310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "991c46b8c2724c2eb5a5ab8615db490e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991c46b8c2724c2eb5a5ab8615db490e" member_type: VOTER } }
I20260709 13:10:35.217352 30310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:35.217927 30316 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:35.222625 30316 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:35.227697 20036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:35.230997 30316 catalog_manager.cc:1383] Generated new cluster ID: 50a6337bb0364108885cdaa58a13eec1
I20260709 13:10:35.231302 30316 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:35.243744 30316 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:35.245013 30316 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:35.263145 30316 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: Generated new TSK 0
I20260709 13:10:35.263785 30316 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:35.294395 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.300091 30327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.301618 30328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.305876 30330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.310194 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:35.316066 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.316293 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.316473 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602635316433 us; error 0 us; skew 500 ppm
I20260709 13:10:35.316993 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.319172 20036 webserver.cc:533] Webserver started at http://127.19.145.1:35929/ using document root <none> and password file <none>
I20260709 13:10:35.319692 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.319904 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.320192 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.321228 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-0-root/instance:
uuid: "4d4d910762234fb684b6fb15432253d1"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.325644 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:35.328680 30335 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.329399 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:35.329676 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-0-root
uuid: "4d4d910762234fb684b6fb15432253d1"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.329977 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.349056 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.350203 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.351665 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.353760 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.353983 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.354215 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.354403 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.393966 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.1:38613
I20260709 13:10:35.394047 30397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.1:38613 every 8 connection(s)
I20260709 13:10:35.399103 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.406494 30402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.407418 30403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.410961 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:35.411403 30398 heartbeater.cc:344] Connected to a master server at 127.19.145.62:43531
I20260709 13:10:35.411966 30398 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:35.411899 30405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.413020 30398 heartbeater.cc:507] Master 127.19.145.62:43531 requested a full tablet report, sending...
I20260709 13:10:35.413337 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.413637 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.413818 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602635413797 us; error 0 us; skew 500 ppm
I20260709 13:10:35.414423 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.415215 30271 ts_manager.cc:194] Registered new tserver with Master: 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613)
I20260709 13:10:35.418229 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57030
I20260709 13:10:35.419013 20036 webserver.cc:533] Webserver started at http://127.19.145.2:38603/ using document root <none> and password file <none>
I20260709 13:10:35.419636 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.419868 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.420125 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.421198 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-1-root/instance:
uuid: "114185d24edf4fb0809161989486a8c8"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.425592 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:35.428683 30410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.429400 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:35.429634 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-1-root
uuid: "114185d24edf4fb0809161989486a8c8"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.429872 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.445014 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.446094 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.447469 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.449524 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.449730 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.450001 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.450157 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.488988 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.2:35313
I20260709 13:10:35.489097 30472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.2:35313 every 8 connection(s)
I20260709 13:10:35.494138 20036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.501966 30477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.502166 30476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.505659 30473 heartbeater.cc:344] Connected to a master server at 127.19.145.62:43531
I20260709 13:10:35.506204 30473 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:35.506928 30479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.507040 30473 heartbeater.cc:507] Master 127.19.145.62:43531 requested a full tablet report, sending...
I20260709 13:10:35.507567 20036 server_base.cc:1061] running on GCE node
I20260709 13:10:35.508647 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.508876 20036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.509063 20036 hybrid_clock.cc:648] HybridClock initialized: now 1783602635509048 us; error 0 us; skew 500 ppm
I20260709 13:10:35.509473 30271 ts_manager.cc:194] Registered new tserver with Master: 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:35.509591 20036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.511317 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57038
I20260709 13:10:35.512243 20036 webserver.cc:533] Webserver started at http://127.19.145.3:45971/ using document root <none> and password file <none>
I20260709 13:10:35.512956 20036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.513175 20036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.513449 20036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.514539 20036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-2-root/instance:
uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.518769 20036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:35.522022 30484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.522831 20036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:35.523057 20036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-2-root
uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-cd6k"
I20260709 13:10:35.523342 20036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyg8utO/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602338050287-20036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.541545 20036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.542629 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.544090 20036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.546229 20036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.546442 20036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.546695 20036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.546857 20036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.585688 20036 rpc_server.cc:307] RPC server started. Bound to: 127.19.145.3:35211
I20260709 13:10:35.585781 30546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.145.3:35211 every 8 connection(s)
I20260709 13:10:35.600236 30547 heartbeater.cc:344] Connected to a master server at 127.19.145.62:43531
I20260709 13:10:35.600934 30547 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:35.601675 30547 heartbeater.cc:507] Master 127.19.145.62:43531 requested a full tablet report, sending...
I20260709 13:10:35.603597 30271 ts_manager.cc:194] Registered new tserver with Master: eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:35.604450 20036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015625761s
I20260709 13:10:35.604964 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57042
I20260709 13:10:35.628597 30271 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57044:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:35.631331 30271 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:35.695148 30437 tablet_service.cc:1511] Processing CreateTablet for tablet 4562e7c9d58c48bfb644efdcdceb5112 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:35.695573 30438 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9a2adcf22d4875838ac278aa142e2b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:35.696650 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4562e7c9d58c48bfb644efdcdceb5112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.697680 30438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9a2adcf22d4875838ac278aa142e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.697979 30436 tablet_service.cc:1511] Processing CreateTablet for tablet b0a8004c62e045c8a3a5e180cdace92a (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:35.699323 30436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a8004c62e045c8a3a5e180cdace92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.714835 30435 tablet_service.cc:1511] Processing CreateTablet for tablet 220ff2b761b5487faa43e301a3a4196d (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:35.719128 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220ff2b761b5487faa43e301a3a4196d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.737236 30562 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:35.746694 30562 tablet_bootstrap.cc:654] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.746927 30437 tablet_service.cc:1511] Processing CreateTablet for tablet b771396bb9104a77b8364a3dea4cf59b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:35.747529 30436 tablet_service.cc:1511] Processing CreateTablet for tablet e8adcbd8a1da4c17bd326e55477f0d58 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:35.748944 30436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8adcbd8a1da4c17bd326e55477f0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.750219 30361 tablet_service.cc:1511] Processing CreateTablet for tablet b0a8004c62e045c8a3a5e180cdace92a (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:35.751626 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a8004c62e045c8a3a5e180cdace92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.740960 30438 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5cb83965af4da19eded8da4a2b5628 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:35.752331 30359 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5cb83965af4da19eded8da4a2b5628 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:35.753122 30438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5cb83965af4da19eded8da4a2b5628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.753690 30359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5cb83965af4da19eded8da4a2b5628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.749053 30362 tablet_service.cc:1511] Processing CreateTablet for tablet 4562e7c9d58c48bfb644efdcdceb5112 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:35.756546 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4562e7c9d58c48bfb644efdcdceb5112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.756397 30358 tablet_service.cc:1511] Processing CreateTablet for tablet b771396bb9104a77b8364a3dea4cf59b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:35.758503 30357 tablet_service.cc:1511] Processing CreateTablet for tablet e8adcbd8a1da4c17bd326e55477f0d58 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:35.759919 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b771396bb9104a77b8364a3dea4cf59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.760401 30363 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9a2adcf22d4875838ac278aa142e2b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:35.751015 30360 tablet_service.cc:1511] Processing CreateTablet for tablet 220ff2b761b5487faa43e301a3a4196d (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:35.764509 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8adcbd8a1da4c17bd326e55477f0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.770429 30512 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9a2adcf22d4875838ac278aa142e2b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:35.771770 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9a2adcf22d4875838ac278aa142e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.776464 30511 tablet_service.cc:1511] Processing CreateTablet for tablet 4562e7c9d58c48bfb644efdcdceb5112 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:35.777848 30511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4562e7c9d58c48bfb644efdcdceb5112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.780591 30510 tablet_service.cc:1511] Processing CreateTablet for tablet b0a8004c62e045c8a3a5e180cdace92a (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:35.782337 30510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a8004c62e045c8a3a5e180cdace92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.784287 30509 tablet_service.cc:1511] Processing CreateTablet for tablet 220ff2b761b5487faa43e301a3a4196d (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:35.784808 30507 tablet_service.cc:1511] Processing CreateTablet for tablet b771396bb9104a77b8364a3dea4cf59b (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:35.785621 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220ff2b761b5487faa43e301a3a4196d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.786571 30507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b771396bb9104a77b8364a3dea4cf59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.788697 30508 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5cb83965af4da19eded8da4a2b5628 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:35.790465 30508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5cb83965af4da19eded8da4a2b5628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.792462 30358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b771396bb9104a77b8364a3dea4cf59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.794425 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9a2adcf22d4875838ac278aa142e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.796878 30360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220ff2b761b5487faa43e301a3a4196d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.832993 30506 tablet_service.cc:1511] Processing CreateTablet for tablet e8adcbd8a1da4c17bd326e55477f0d58 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:35.835090 30506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8adcbd8a1da4c17bd326e55477f0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.843457 30362 tablet_service.cc:1511] Processing CreateTablet for tablet a0570e21b0e14c319ec354392cc153a4 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:35.844859 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0570e21b0e14c319ec354392cc153a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.862134 30435 tablet_service.cc:1511] Processing CreateTablet for tablet a0570e21b0e14c319ec354392cc153a4 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:35.864558 30564 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:35.864831 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0570e21b0e14c319ec354392cc153a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.868590 30505 tablet_service.cc:1511] Processing CreateTablet for tablet a0570e21b0e14c319ec354392cc153a4 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:35.869923 30505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0570e21b0e14c319ec354392cc153a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.873417 30562 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:35.873951 30562 ts_tablet_manager.cc:1403] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.014s
I20260709 13:10:35.875100 30361 tablet_service.cc:1511] Processing CreateTablet for tablet 63a12f4f60f34012bd7abb44fc2823f3 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:35.875893 30437 tablet_service.cc:1511] Processing CreateTablet for tablet 63a12f4f60f34012bd7abb44fc2823f3 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:35.876415 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a12f4f60f34012bd7abb44fc2823f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.877138 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a12f4f60f34012bd7abb44fc2823f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.876991 30562 raft_consensus.cc:359] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.877789 30562 raft_consensus.cc:385] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.878098 30562 raft_consensus.cc:740] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.878957 30562 consensus_queue.cc:260] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.879962 30564 tablet_bootstrap.cc:654] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.886742 30504 tablet_service.cc:1511] Processing CreateTablet for tablet 63a12f4f60f34012bd7abb44fc2823f3 (DEFAULT_TABLE table=test-workload [id=c6a2025b7c90410cbbd831e6d6d61adb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:35.888114 30504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a12f4f60f34012bd7abb44fc2823f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.894160 30473 heartbeater.cc:499] Master 127.19.145.62:43531 was elected leader, sending a full tablet report...
I20260709 13:10:35.894704 30562 ts_tablet_manager.cc:1434] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 13:10:35.895828 30562 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:35.901718 30562 tablet_bootstrap.cc:654] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.929111 30564 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:35.929601 30564 ts_tablet_manager.cc:1403] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.008s
I20260709 13:10:35.934965 30564 raft_consensus.cc:359] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.935710 30564 raft_consensus.cc:385] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.936010 30564 raft_consensus.cc:740] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.936709 30564 consensus_queue.cc:260] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.934365 30565 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:35.951074 30398 heartbeater.cc:499] Master 127.19.145.62:43531 was elected leader, sending a full tablet report...
I20260709 13:10:35.951453 30564 ts_tablet_manager.cc:1434] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 13:10:35.952428 30564 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:35.958506 30564 tablet_bootstrap.cc:654] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.960539 30565 tablet_bootstrap.cc:654] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.961645 30562 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:35.962172 30562 ts_tablet_manager.cc:1403] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.003s
I20260709 13:10:35.966907 30562 raft_consensus.cc:359] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.967519 30562 raft_consensus.cc:385] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.967892 30562 raft_consensus.cc:740] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.968765 30562 consensus_queue.cc:260] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.972380 30562 ts_tablet_manager.cc:1434] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:35.973304 30562 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:35.973925 30564 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:35.974434 30564 ts_tablet_manager.cc:1403] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.012s
I20260709 13:10:35.977252 30564 raft_consensus.cc:359] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.977913 30564 raft_consensus.cc:385] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.978209 30564 raft_consensus.cc:740] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.978628 30565 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:35.979061 30562 tablet_bootstrap.cc:654] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.979115 30565 ts_tablet_manager.cc:1403] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 13:10:35.979000 30564 consensus_queue.cc:260] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.981966 30564 ts_tablet_manager.cc:1434] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:35.982884 30564 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:35.983021 30565 raft_consensus.cc:359] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.984053 30565 raft_consensus.cc:385] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.984447 30565 raft_consensus.cc:740] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.985577 30565 consensus_queue.cc:260] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:35.989730 30564 tablet_bootstrap.cc:654] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.994927 30547 heartbeater.cc:499] Master 127.19.145.62:43531 was elected leader, sending a full tablet report...
I20260709 13:10:35.995003 30565 ts_tablet_manager.cc:1434] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:10:35.996630 30565 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:35.997604 30564 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:35.998267 30564 ts_tablet_manager.cc:1403] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:10:36.001367 30564 raft_consensus.cc:359] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.002090 30564 raft_consensus.cc:385] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.002427 30564 raft_consensus.cc:740] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.004359 30565 tablet_bootstrap.cc:654] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.005115 30564 consensus_queue.cc:260] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.005987 30562 tablet_bootstrap.cc:492] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.006510 30562 ts_tablet_manager.cc:1403] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.013s
I20260709 13:10:36.007838 30564 ts_tablet_manager.cc:1434] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:10:36.009034 30564 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.010242 30562 raft_consensus.cc:359] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.011152 30562 raft_consensus.cc:385] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.011548 30562 raft_consensus.cc:740] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.012681 30562 consensus_queue.cc:260] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.015991 30564 tablet_bootstrap.cc:654] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.023164 30562 ts_tablet_manager.cc:1434] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:10:36.024271 30562 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.024564 30565 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.025100 30565 ts_tablet_manager.cc:1403] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.009s
I20260709 13:10:36.028028 30565 raft_consensus.cc:359] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.028724 30565 raft_consensus.cc:385] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.029018 30565 raft_consensus.cc:740] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.030258 30562 tablet_bootstrap.cc:654] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.030978 30565 consensus_queue.cc:260] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.032832 30564 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:36.033427 30564 ts_tablet_manager.cc:1403] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 13:10:36.033669 30565 ts_tablet_manager.cc:1434] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:36.035157 30565 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.036679 30564 raft_consensus.cc:359] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.037520 30564 raft_consensus.cc:385] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.037860 30564 raft_consensus.cc:740] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.038877 30564 consensus_queue.cc:260] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.043959 30564 ts_tablet_manager.cc:1434] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:10:36.044013 30565 tablet_bootstrap.cc:654] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.045159 30564 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.050074 30562 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.050460 30565 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.050616 30562 ts_tablet_manager.cc:1403] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.005s
I20260709 13:10:36.050953 30565 ts_tablet_manager.cc:1403] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:10:36.053884 30564 tablet_bootstrap.cc:654] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.053933 30565 raft_consensus.cc:359] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.054316 30562 raft_consensus.cc:359] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.054917 30565 raft_consensus.cc:385] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.055001 30562 raft_consensus.cc:385] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.055313 30565 raft_consensus.cc:740] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.055390 30562 raft_consensus.cc:740] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.056238 30562 consensus_queue.cc:260] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.056416 30565 consensus_queue.cc:260] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.058723 30565 ts_tablet_manager.cc:1434] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:36.058724 30562 ts_tablet_manager.cc:1434] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:36.059819 30565 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.059826 30562 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.065744 30564 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:36.066320 30564 ts_tablet_manager.cc:1403] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:10:36.066639 30565 tablet_bootstrap.cc:654] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.066639 30562 tablet_bootstrap.cc:654] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.069469 30564 raft_consensus.cc:359] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.070334 30564 raft_consensus.cc:385] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.070636 30564 raft_consensus.cc:740] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.071609 30564 consensus_queue.cc:260] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.076654 30564 ts_tablet_manager.cc:1434] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:36.077767 30564 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.079101 30562 tablet_bootstrap.cc:492] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.079331 30565 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.079677 30562 ts_tablet_manager.cc:1403] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 13:10:36.079774 30565 ts_tablet_manager.cc:1403] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:10:36.082653 30565 raft_consensus.cc:359] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.082880 30562 raft_consensus.cc:359] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.083374 30565 raft_consensus.cc:385] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.083627 30562 raft_consensus.cc:385] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.083675 30565 raft_consensus.cc:740] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.084002 30562 raft_consensus.cc:740] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.084787 30564 tablet_bootstrap.cc:654] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.084793 30562 consensus_queue.cc:260] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.084812 30565 consensus_queue.cc:260] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.087664 30565 ts_tablet_manager.cc:1434] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:36.088721 30565 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.089778 30562 ts_tablet_manager.cc:1434] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:36.090799 30562 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.095059 30565 tablet_bootstrap.cc:654] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.087632 30573 raft_consensus.cc:493] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.097052 30564 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:36.097136 30562 tablet_bootstrap.cc:654] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.097923 30564 ts_tablet_manager.cc:1403] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:10:36.097329 30573 raft_consensus.cc:515] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.101464 30564 raft_consensus.cc:359] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.102320 30564 raft_consensus.cc:385] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.102622 30564 raft_consensus.cc:740] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.103557 30564 consensus_queue.cc:260] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.107100 30573 leader_election.cc:290] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.110227 30562 tablet_bootstrap.cc:492] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.111066 30562 ts_tablet_manager.cc:1403] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.012s
I20260709 13:10:36.114384 30564 ts_tablet_manager.cc:1434] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:10:36.115557 30564 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.115224 30562 raft_consensus.cc:359] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.116453 30562 raft_consensus.cc:385] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.116910 30562 raft_consensus.cc:740] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.118299 30569 raft_consensus.cc:493] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.118110 30562 consensus_queue.cc:260] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.119089 30569 raft_consensus.cc:515] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.122103 30562 ts_tablet_manager.cc:1434] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:36.123521 30562 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.131942 30562 tablet_bootstrap.cc:654] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.140054 30569 leader_election.cc:290] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.145920 30562 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.146726 30562 ts_tablet_manager.cc:1403] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:10:36.153884 30566 raft_consensus.cc:493] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.154119 30562 raft_consensus.cc:359] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.154417 30566 raft_consensus.cc:515] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.155529 30562 raft_consensus.cc:385] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.156044 30562 raft_consensus.cc:740] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.157105 30562 consensus_queue.cc:260] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.160579 30566 leader_election.cc:290] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.167171 30562 ts_tablet_manager.cc:1434] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:10:36.168707 30562 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.177642 30573 raft_consensus.cc:493] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.178296 30573 raft_consensus.cc:515] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.179113 30562 tablet_bootstrap.cc:654] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.181066 30573 leader_election.cc:290] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.191485 30562 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.192260 30562 ts_tablet_manager.cc:1403] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:10:36.195866 30562 raft_consensus.cc:359] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.196800 30562 raft_consensus.cc:385] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.197201 30562 raft_consensus.cc:740] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.198175 30562 consensus_queue.cc:260] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.200886 30562 ts_tablet_manager.cc:1434] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:36.202160 30562 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:36.214439 30564 tablet_bootstrap.cc:654] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.216509 30562 tablet_bootstrap.cc:654] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.212198 30565 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.279706 30592 raft_consensus.cc:493] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.280292 30565 ts_tablet_manager.cc:1403] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.192s	user 0.038s	sys 0.074s
I20260709 13:10:36.280411 30566 raft_consensus.cc:493] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.281124 30592 raft_consensus.cc:515] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.281450 30566 raft_consensus.cc:515] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
W20260709 13:10:36.249420 30319 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:36.253455 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.288113 30373 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:36.255354 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.263449 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.295871 30448 raft_consensus.cc:2468] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.295976 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.284868 30566 leader_election.cc:290] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.294521 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.297351 30447 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:36.297485 30446 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:36.298674 30565 raft_consensus.cc:359] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.299522 30339 leader_election.cc:304] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:36.301080 30569 raft_consensus.cc:2804] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.301570 30569 raft_consensus.cc:493] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.301935 30569 raft_consensus.cc:3060] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.303442 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.304701 30372 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
W20260709 13:10:36.306742 30337 leader_election.cc:343] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.306789 30485 leader_election.cc:304] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.309024 30573 raft_consensus.cc:2804] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.309276 30488 leader_election.cc:304] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.309636 30573 raft_consensus.cc:493] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.313336 30600 raft_consensus.cc:493] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.314251 30600 raft_consensus.cc:515] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.311288 30573 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.317010 30592 leader_election.cc:290] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.321895 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.299728 30565 raft_consensus.cc:385] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.326284 30373 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:36.323521 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.326689 30565 raft_consensus.cc:740] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.329120 30565 consensus_queue.cc:260] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.334188 30603 raft_consensus.cc:2804] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.334852 30603 raft_consensus.cc:493] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.335608 30603 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.339486 30562 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:36.340560 30562 ts_tablet_manager.cc:1403] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.139s	user 0.027s	sys 0.024s
I20260709 13:10:36.341485 30600 leader_election.cc:290] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.342178 30600 raft_consensus.cc:493] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.344899 30562 raft_consensus.cc:359] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.345772 30562 raft_consensus.cc:385] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.346056 30562 raft_consensus.cc:740] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.346069 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.346863 30446 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.346966 30562 consensus_queue.cc:260] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.348272 30339 leader_election.cc:304] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:36.350064 30562 ts_tablet_manager.cc:1434] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:10:36.350366 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.350693 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.351929 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8adcbd8a1da4c17bd326e55477f0d58" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.352092 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8adcbd8a1da4c17bd326e55477f0d58" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.353034 30520 raft_consensus.cc:2468] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:36.354210 30411 leader_election.cc:304] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
W20260709 13:10:36.355238 30411 leader_election.cc:343] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:36.355911 30411 leader_election.cc:343] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.356554 30592 raft_consensus.cc:2804] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.356948 30592 raft_consensus.cc:493] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.357262 30592 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.357504 30603 raft_consensus.cc:515] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.358946 30522 raft_consensus.cc:2393] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 114185d24edf4fb0809161989486a8c8 in current term 1: Already voted for candidate eaf1885b8d53412a92eeb8d864dd8a22 in this term.
I20260709 13:10:36.342765 30600 raft_consensus.cc:515] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.361837 30600 leader_election.cc:290] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.362411 30600 raft_consensus.cc:2804] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.363190 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
W20260709 13:10:36.362511 30412 leader_election.cc:343] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.364502 30412 leader_election.cc:304] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 114185d24edf4fb0809161989486a8c8; no voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.364732 30520 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.365345 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.365834 30412 leader_election.cc:304] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:36.365957 30337 leader_election.cc:304] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.363106 30565 ts_tablet_manager.cc:1434] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.002s
I20260709 13:10:36.358574 30573 raft_consensus.cc:515] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.367018 30566 raft_consensus.cc:2749] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.367760 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.363766 30600 raft_consensus.cc:493] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.349526 30569 raft_consensus.cc:515] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.372401 30601 raft_consensus.cc:2804] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.372951 30601 raft_consensus.cc:493] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.373337 30601 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.373905 30566 raft_consensus.cc:2804] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.374454 30569 leader_election.cc:290] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.374311 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.374320 30566 raft_consensus.cc:493] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.375161 30566 raft_consensus.cc:3060] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.375228 30372 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.367013 30564 tablet_bootstrap.cc:492] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:36.382151 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.382735 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.382997 30564 ts_tablet_manager.cc:1403] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.268s	user 0.017s	sys 0.008s
W20260709 13:10:36.383527 30337 leader_election.cc:343] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.378058 30600 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.379896 30521 raft_consensus.cc:2393] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d4d910762234fb684b6fb15432253d1 in current term 1: Already voted for candidate eaf1885b8d53412a92eeb8d864dd8a22 in this term.
I20260709 13:10:36.380374 30446 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.381565 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.378726 30603 leader_election.cc:290] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.390393 30447 raft_consensus.cc:3060] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.392879 30569 raft_consensus.cc:493] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.393555 30569 raft_consensus.cc:515] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.393754 30566 raft_consensus.cc:515] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.387145 30564 raft_consensus.cc:359] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.397444 30569 leader_election.cc:290] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.399829 30564 raft_consensus.cc:385] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.397466 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.401589 30564 raft_consensus.cc:740] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.399507 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.402969 30445 raft_consensus.cc:2468] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.403756 30564 consensus_queue.cc:260] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.404187 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.404933 30446 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.405118 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8adcbd8a1da4c17bd326e55477f0d58" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.405939 30521 raft_consensus.cc:3060] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.405716 30339 leader_election.cc:304] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:36.407217 30604 raft_consensus.cc:493] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.407754 30604 raft_consensus.cc:515] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.408216 30371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8adcbd8a1da4c17bd326e55477f0d58" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.410288 30604 leader_election.cc:290] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.411417 30569 raft_consensus.cc:2804] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.411839 30569 raft_consensus.cc:493] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.412165 30569 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.413483 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.414207 30371 raft_consensus.cc:3060] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.415165 30412 leader_election.cc:343] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.415759 30566 leader_election.cc:290] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.416543 30370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.417356 30370 raft_consensus.cc:2468] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:36.415174 30447 raft_consensus.cc:2468] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.419016 30411 leader_election.cc:304] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.419806 30339 leader_election.cc:304] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.421051 30521 raft_consensus.cc:2468] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:36.422792 30412 leader_election.cc:304] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.421053 30592 raft_consensus.cc:515] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.424116 30371 raft_consensus.cc:2468] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:36.424732 30448 raft_consensus.cc:2393] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaf1885b8d53412a92eeb8d864dd8a22 in current term 1: Already voted for candidate 114185d24edf4fb0809161989486a8c8 in this term.
I20260709 13:10:36.399180 30573 leader_election.cc:290] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.426934 30370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.427017 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.396687 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.427357 30566 raft_consensus.cc:2804] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.427923 30522 raft_consensus.cc:2393] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 114185d24edf4fb0809161989486a8c8 in current term 1: Already voted for candidate eaf1885b8d53412a92eeb8d864dd8a22 in this term.
I20260709 13:10:36.430815 30592 leader_election.cc:290] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.442595 30601 raft_consensus.cc:515] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.443567 30565 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
W20260709 13:10:36.444442 30337 leader_election.cc:343] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.444873 30601 leader_election.cc:290] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.445873 30601 raft_consensus.cc:2804] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.446352 30601 raft_consensus.cc:697] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:36.431625 30604 raft_consensus.cc:2804] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.447520 30604 raft_consensus.cc:697] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:36.447490 30601 consensus_queue.cc:237] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.447839 30411 leader_election.cc:304] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 114185d24edf4fb0809161989486a8c8; no voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.430575 30372 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:36.451427 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.454985 30522 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.452476 30564 ts_tablet_manager.cc:1434] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.012s
I20260709 13:10:36.450125 30604 consensus_queue.cc:237] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.453451 30446 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:36.431034 30566 raft_consensus.cc:493] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.456014 30485 leader_election.cc:304] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:36.458428 30573 raft_consensus.cc:2804] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.458636 30488 leader_election.cc:304] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.458963 30573 raft_consensus.cc:697] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:36.459645 30603 raft_consensus.cc:2804] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.460165 30603 raft_consensus.cc:697] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:36.460232 30573 consensus_queue.cc:237] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.461156 30603 consensus_queue.cc:237] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.465832 30565 tablet_bootstrap.cc:654] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.466951 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.467620 30446 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.456686 30592 raft_consensus.cc:2749] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.457819 30566 raft_consensus.cc:3060] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.473464 30564 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.470224 30522 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.477448 30337 leader_election.cc:304] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.478523 30606 raft_consensus.cc:2804] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.480154 30606 raft_consensus.cc:697] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:36.480399 30600 raft_consensus.cc:515] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.482059 30373 raft_consensus.cc:2393] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaf1885b8d53412a92eeb8d864dd8a22 in current term 1: Already voted for candidate 4d4d910762234fb684b6fb15432253d1 in this term.
I20260709 13:10:36.484012 30600 leader_election.cc:290] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.493875 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.502537 30565 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.494431 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.503582 30564 tablet_bootstrap.cc:654] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.481563 30606 consensus_queue.cc:237] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.504328 30448 raft_consensus.cc:2393] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d4d910762234fb684b6fb15432253d1 in current term 1: Already voted for candidate eaf1885b8d53412a92eeb8d864dd8a22 in this term.
I20260709 13:10:36.504920 30569 raft_consensus.cc:515] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.505895 30339 leader_election.cc:304] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1; no voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.505653 30267 catalog_manager.cc:5697] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.507133 30569 leader_election.cc:290] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.507846 30569 raft_consensus.cc:2749] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.503093 30565 ts_tablet_manager.cc:1403] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.012s
I20260709 13:10:36.508280 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.492018 30446 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.510951 30268 catalog_manager.cc:5697] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:36.522778 30337 leader_election.cc:343] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.526995 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.527815 30446 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.528455 30566 raft_consensus.cc:515] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.533123 30565 raft_consensus.cc:359] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.534122 30565 raft_consensus.cc:385] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.534548 30565 raft_consensus.cc:740] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.536790 30270 catalog_manager.cc:5697] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.537952 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.538739 30373 raft_consensus.cc:3060] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.542261 30446 raft_consensus.cc:2468] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.543519 30339 leader_election.cc:304] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.544327 30606 raft_consensus.cc:2804] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.544859 30606 raft_consensus.cc:697] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:36.545992 30606 consensus_queue.cc:237] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.549347 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.550935 30564 tablet_bootstrap.cc:492] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
W20260709 13:10:36.551198 30412 leader_election.cc:343] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.551621 30564 ts_tablet_manager.cc:1403] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.006s
I20260709 13:10:36.554136 30566 leader_election.cc:290] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.555140 30565 consensus_queue.cc:260] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.555573 30564 raft_consensus.cc:359] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.556542 30564 raft_consensus.cc:385] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.556901 30564 raft_consensus.cc:740] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.557348 30373 raft_consensus.cc:2468] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:36.559175 30411 leader_election.cc:304] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:36.560708 30566 raft_consensus.cc:2804] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.560803 30565 ts_tablet_manager.cc:1434] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.012s
I20260709 13:10:36.561424 30566 raft_consensus.cc:697] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:36.562536 30565 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.562630 30566 consensus_queue.cc:237] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.569378 30565 tablet_bootstrap.cc:654] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.572053 30564 consensus_queue.cc:260] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.575126 30564 ts_tablet_manager.cc:1434] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:10:36.576438 30564 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:36.583242 30565 tablet_bootstrap.cc:492] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.583983 30565 ts_tablet_manager.cc:1403] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:10:36.585682 30564 tablet_bootstrap.cc:654] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.588197 30565 raft_consensus.cc:359] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.589200 30565 raft_consensus.cc:385] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.589589 30565 raft_consensus.cc:740] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.590798 30565 consensus_queue.cc:260] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.594316 30565 ts_tablet_manager.cc:1434] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:10:36.595872 30565 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.605032 30565 tablet_bootstrap.cc:654] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.606634 30267 catalog_manager.cc:5697] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.612409 30565 tablet_bootstrap.cc:492] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.613047 30565 ts_tablet_manager.cc:1403] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:10:36.612164 30268 catalog_manager.cc:5697] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.615998 30565 raft_consensus.cc:359] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.616752 30565 raft_consensus.cc:385] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.617074 30565 raft_consensus.cc:740] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.617854 30565 consensus_queue.cc:260] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.614866 30268 catalog_manager.cc:5697] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.620075 30565 ts_tablet_manager.cc:1434] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:36.621202 30565 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:36.621824 30573 raft_consensus.cc:493] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.622344 30573 raft_consensus.cc:515] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.629768 30565 tablet_bootstrap.cc:654] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.629952 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a12f4f60f34012bd7abb44fc2823f3" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.630645 30446 raft_consensus.cc:2468] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:36.631407 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a12f4f60f34012bd7abb44fc2823f3" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.633054 30488 leader_election.cc:304] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.633625 30573 leader_election.cc:290] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.634522 30573 raft_consensus.cc:2804] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.635012 30573 raft_consensus.cc:493] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.635577 30573 raft_consensus.cc:3060] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.636308 30485 leader_election.cc:343] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.640388 30564 tablet_bootstrap.cc:492] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:36.640928 30564 ts_tablet_manager.cc:1403] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.028s
I20260709 13:10:36.641649 30270 catalog_manager.cc:5697] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.644650 30565 tablet_bootstrap.cc:492] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:36.645066 30565 ts_tablet_manager.cc:1403] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.005s
I20260709 13:10:36.645949 30573 raft_consensus.cc:515] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.647421 30565 raft_consensus.cc:359] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.648102 30565 raft_consensus.cc:385] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.648363 30565 raft_consensus.cc:740] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.646979 30564 raft_consensus.cc:359] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.648705 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a12f4f60f34012bd7abb44fc2823f3" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:36.648998 30564 raft_consensus.cc:385] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.649281 30564 raft_consensus.cc:740] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.649189 30565 consensus_queue.cc:260] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.650167 30573 leader_election.cc:290] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.650161 30564 consensus_queue.cc:260] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.650954 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a12f4f60f34012bd7abb44fc2823f3" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.651068 30373 raft_consensus.cc:3060] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.651654 30565 ts_tablet_manager.cc:1434] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:36.651602 30446 raft_consensus.cc:3060] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.652902 30564 ts_tablet_manager.cc:1434] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:10:36.659219 30446 raft_consensus.cc:2468] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:36.660003 30373 raft_consensus.cc:2468] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:36.660631 30488 leader_election.cc:304] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.661531 30573 raft_consensus.cc:2804] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.662243 30573 raft_consensus.cc:697] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:36.663120 30573 consensus_queue.cc:237] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.669488 30606 raft_consensus.cc:493] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.669994 30606 raft_consensus.cc:515] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.671878 30606 leader_election.cc:290] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.672437 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.672854 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:36.672183 30270 catalog_manager.cc:5697] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.673097 30446 raft_consensus.cc:2468] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.673499 30522 raft_consensus.cc:2468] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:36.674182 30339 leader_election.cc:304] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:36.674912 30606 raft_consensus.cc:2804] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.675292 30606 raft_consensus.cc:493] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.675625 30606 raft_consensus.cc:3060] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.682363 30606 raft_consensus.cc:515] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.684176 30606 leader_election.cc:290] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.684837 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:36.685174 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9a2adcf22d4875838ac278aa142e2b" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.685380 30446 raft_consensus.cc:3060] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.685745 30522 raft_consensus.cc:3060] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.690696 30522 raft_consensus.cc:2468] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.690848 30446 raft_consensus.cc:2468] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:36.691783 30337 leader_election.cc:304] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.692529 30606 raft_consensus.cc:2804] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.692974 30606 raft_consensus.cc:697] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:36.693676 30606 consensus_queue.cc:237] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.700538 30573 raft_consensus.cc:493] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.701129 30573 raft_consensus.cc:515] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.701090 30268 catalog_manager.cc:5697] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.703467 30573 leader_election.cc:290] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.704052 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.704648 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0570e21b0e14c319ec354392cc153a4" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.704918 30373 raft_consensus.cc:2393] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaf1885b8d53412a92eeb8d864dd8a22 in current term 1: Already voted for candidate 114185d24edf4fb0809161989486a8c8 in this term.
I20260709 13:10:36.706419 30485 leader_election.cc:304] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:36.707158 30573 raft_consensus.cc:3060] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.713850 30573 raft_consensus.cc:2749] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.789165 30573 raft_consensus.cc:493] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.789661 30573 raft_consensus.cc:515] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.791553 30573 leader_election.cc:290] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.792371 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.792572 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a8004c62e045c8a3a5e180cdace92a" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.793376 30446 raft_consensus.cc:2393] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaf1885b8d53412a92eeb8d864dd8a22 in current term 1: Already voted for candidate 4d4d910762234fb684b6fb15432253d1 in this term.
I20260709 13:10:36.794277 30488 leader_election.cc:304] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:36.794862 30573 raft_consensus.cc:3060] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.799652 30573 raft_consensus.cc:2749] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.863804 30566 consensus_queue.cc:1048] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.865927 30566 consensus_queue.cc:1048] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.925670 30573 consensus_queue.cc:1048] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.932276 30573 raft_consensus.cc:493] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.932751 30573 raft_consensus.cc:515] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.934984 30573 leader_election.cc:290] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:36.935811 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:36.936726 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:36.937654 30446 raft_consensus.cc:2393] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaf1885b8d53412a92eeb8d864dd8a22 in current term 1: Already voted for candidate 4d4d910762234fb684b6fb15432253d1 in this term.
I20260709 13:10:36.938890 30488 leader_election.cc:304] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:36.939821 30603 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.946590 30522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
mode: GRACEFUL
new_leader_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:54966
I20260709 13:10:36.947479 30522 raft_consensus.cc:606] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Received request to transfer leadership to TS 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:36.949684 30602 consensus_queue.cc:1048] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.952993 30602 raft_consensus.cc:993] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: : Instructing follower 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:36.953459 30602 raft_consensus.cc:1081] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Signalling peer 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:36.955789 30373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:45836
I20260709 13:10:36.948935 30603 raft_consensus.cc:2749] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.956555 30373 raft_consensus.cc:493] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.959865 30373 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.958109 30522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
mode: GRACEFUL
new_leader_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:54966
I20260709 13:10:36.961488 30522 raft_consensus.cc:606] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Received request to transfer leadership to TS 114185d24edf4fb0809161989486a8c8
I20260709 13:10:36.964783 30635 consensus_queue.cc:1048] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.967932 30373 raft_consensus.cc:515] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.971442 30373 leader_election.cc:290] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:36.971501 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:36.972555 30522 raft_consensus.cc:3055] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.972870 30522 raft_consensus.cc:740] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:36.973745 30522 consensus_queue.cc:260] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:36.975128 30522 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.977887 30603 consensus_queue.cc:1048] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.996978 30522 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 2.
I20260709 13:10:36.999130 30337 leader_election.cc:304] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:36.999976 30606 raft_consensus.cc:2804] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.000468 30606 raft_consensus.cc:697] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:37.000562 30602 raft_consensus.cc:993] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: : Instructing follower 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:37.001122 30602 raft_consensus.cc:1081] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Signalling peer 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:37.001442 30606 consensus_queue.cc:237] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.002946 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628"
dest_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:52002
I20260709 13:10:37.003547 30446 raft_consensus.cc:493] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.003901 30446 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.011813 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220ff2b761b5487faa43e301a3a4196d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:37.012482 30447 raft_consensus.cc:3060] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.015429 30446 raft_consensus.cc:515] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.016513 30448 raft_consensus.cc:1240] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Rejecting Update request from peer eaf1885b8d53412a92eeb8d864dd8a22 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.016402 30600 consensus_queue.cc:1048] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.018285 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:37.018898 30372 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.018759 30600 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.021881 30373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
mode: GRACEFUL
new_leader_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:45850
I20260709 13:10:37.022504 30373 raft_consensus.cc:606] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Received request to transfer leadership to TS 114185d24edf4fb0809161989486a8c8
I20260709 13:10:37.021993 30267 catalog_manager.cc:5697] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 1 to 2, leader changed from eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3) to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.023006 30603 consensus_queue.cc:1059] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.023346 30447 raft_consensus.cc:2468] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 2.
I20260709 13:10:37.023885 30603 raft_consensus.cc:3055] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.024240 30603 raft_consensus.cc:740] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:37.025036 30603 consensus_queue.cc:260] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.030241 30372 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 2.
I20260709 13:10:37.032675 30446 leader_election.cc:290] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:37.033772 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5cb83965af4da19eded8da4a2b5628" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:37.026137 30603 raft_consensus.cc:3060] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.035710 30411 leader_election.cc:304] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:37.036585 30604 raft_consensus.cc:2804] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.037081 30604 raft_consensus.cc:697] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:37.038010 30604 consensus_queue.cc:237] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.042938 30606 raft_consensus.cc:993] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: : Instructing follower 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:37.043816 30600 raft_consensus.cc:1081] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Signalling peer 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:37.050583 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b"
dest_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:52010
I20260709 13:10:37.051132 30446 raft_consensus.cc:493] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.050801 30600 consensus_queue.cc:1048] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.051538 30446 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.059284 30566 consensus_queue.cc:1048] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.061530 30522 raft_consensus.cc:2468] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 2.
I20260709 13:10:37.069132 30446 raft_consensus.cc:515] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.079133 30600 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.080947 30600 consensus_queue.cc:1048] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.093145 30268 catalog_manager.cc:5697] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 1 to 2, leader changed from eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3) to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.102172 30446 leader_election.cc:290] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:37.104522 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:37.109927 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:37.110510 30372 raft_consensus.cc:3055] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.110867 30372 raft_consensus.cc:740] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:37.110558 30648 consensus_queue.cc:1048] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.113358 30372 consensus_queue.cc:260] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.116992 30372 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.118577 30566 consensus_queue.cc:1048] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.127705 30372 raft_consensus.cc:2468] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 2.
I20260709 13:10:37.135850 30411 leader_election.cc:304] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:37.137218 30566 raft_consensus.cc:2804] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.137879 30566 raft_consensus.cc:697] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:37.140794 30566 consensus_queue.cc:237] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:37.147993 30642 consensus_queue.cc:1048] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.156473 30268 catalog_manager.cc:5697] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 1 to 2, leader changed from 4d4d910762234fb684b6fb15432253d1 (127.19.145.1) to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.166097 30606 consensus_queue.cc:1048] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.190434 30603 consensus_queue.cc:1048] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.199916 30603 consensus_queue.cc:1048] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.451016 30521 raft_consensus.cc:1275] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.452289 30606 consensus_queue.cc:1048] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.459628 30446 raft_consensus.cc:1275] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.461428 30600 consensus_queue.cc:1048] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.483431 30372 raft_consensus.cc:1275] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.484520 30592 consensus_queue.cc:1048] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.492018 30521 raft_consensus.cc:1275] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.493345 30592 consensus_queue.cc:1048] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.566015 30372 raft_consensus.cc:1275] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.567420 30592 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.575824 30521 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.584064 30521 raft_consensus.cc:1275] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.585204 30604 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.066991 30268 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57050:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:40.069635 30268 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:40.116264 30361 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2d726e129a404f95cf8b12416fafec (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:40.117941 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2d726e129a404f95cf8b12416fafec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.117585 30435 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2d726e129a404f95cf8b12416fafec (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:40.119232 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2d726e129a404f95cf8b12416fafec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.119128 30505 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2d726e129a404f95cf8b12416fafec (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:40.120527 30505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2d726e129a404f95cf8b12416fafec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.122680 30437 tablet_service.cc:1511] Processing CreateTablet for tablet eb1616b892bc4934bf8cf010cd52aed3 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:40.124010 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1616b892bc4934bf8cf010cd52aed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.124433 30363 tablet_service.cc:1511] Processing CreateTablet for tablet eb1616b892bc4934bf8cf010cd52aed3 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:40.125741 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1616b892bc4934bf8cf010cd52aed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.128630 30357 tablet_service.cc:1511] Processing CreateTablet for tablet 2600e5efa9c542e1bfef48610290e26a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:40.129037 30438 tablet_service.cc:1511] Processing CreateTablet for tablet 2600e5efa9c542e1bfef48610290e26a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:40.129945 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2600e5efa9c542e1bfef48610290e26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.130283 30438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2600e5efa9c542e1bfef48610290e26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.133080 30360 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9462a686c642f4a669cd5e40712a04 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:40.134443 30360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9462a686c642f4a669cd5e40712a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.134613 30436 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9462a686c642f4a669cd5e40712a04 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:40.135947 30436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9462a686c642f4a669cd5e40712a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.137012 30510 tablet_service.cc:1511] Processing CreateTablet for tablet eb1616b892bc4934bf8cf010cd52aed3 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:40.138269 30510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1616b892bc4934bf8cf010cd52aed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.138048 30362 tablet_service.cc:1511] Processing CreateTablet for tablet d1f134672ad04c9eb8dc17f94444feee (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:40.140126 30434 tablet_service.cc:1511] Processing CreateTablet for tablet d1f134672ad04c9eb8dc17f94444feee (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:40.141418 30434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f134672ad04c9eb8dc17f94444feee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.144068 30359 tablet_service.cc:1511] Processing CreateTablet for tablet b4b347e4c3554d499d66de95654f416a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:40.144421 30507 tablet_service.cc:1511] Processing CreateTablet for tablet 2600e5efa9c542e1bfef48610290e26a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:40.145371 30359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b347e4c3554d499d66de95654f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.145721 30507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2600e5efa9c542e1bfef48610290e26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.147630 30433 tablet_service.cc:1511] Processing CreateTablet for tablet b4b347e4c3554d499d66de95654f416a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:40.148211 30508 tablet_service.cc:1511] Processing CreateTablet for tablet b4b347e4c3554d499d66de95654f416a (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:40.148947 30433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b347e4c3554d499d66de95654f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.149458 30508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b347e4c3554d499d66de95654f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.143059 30512 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9462a686c642f4a669cd5e40712a04 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:40.151372 30432 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26adb270484ddbac86569b8f488f19 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:40.152647 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9462a686c642f4a669cd5e40712a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.152779 30432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26adb270484ddbac86569b8f488f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.152997 30358 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26adb270484ddbac86569b8f488f19 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:40.143030 30504 tablet_service.cc:1511] Processing CreateTablet for tablet d1f134672ad04c9eb8dc17f94444feee (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:40.156435 30504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f134672ad04c9eb8dc17f94444feee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.156144 30506 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26adb270484ddbac86569b8f488f19 (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:40.157509 30506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26adb270484ddbac86569b8f488f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.160049 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f134672ad04c9eb8dc17f94444feee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.160750 30511 tablet_service.cc:1511] Processing CreateTablet for tablet d123779ba71d4cf0ab0fe596e2448d6d (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:40.163002 30430 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4f5c435b124476b72659f891552e0f (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:40.163532 30511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123779ba71d4cf0ab0fe596e2448d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.164288 30430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4f5c435b124476b72659f891552e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.164697 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4f5c435b124476b72659f891552e0f (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:40.165987 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4f5c435b124476b72659f891552e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.166249 30431 tablet_service.cc:1511] Processing CreateTablet for tablet d123779ba71d4cf0ab0fe596e2448d6d (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:40.167450 30431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123779ba71d4cf0ab0fe596e2448d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.156075 30356 tablet_service.cc:1511] Processing CreateTablet for tablet d123779ba71d4cf0ab0fe596e2448d6d (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:40.168869 30356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123779ba71d4cf0ab0fe596e2448d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.171662 30509 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4f5c435b124476b72659f891552e0f (DEFAULT_TABLE table=soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:40.173230 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4f5c435b124476b72659f891552e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.189821 30358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26adb270484ddbac86569b8f488f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.243961 30675 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.250281 30675 tablet_bootstrap.cc:654] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.306003 30676 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.307530 30677 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.312386 30676 tablet_bootstrap.cc:654] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.323299 30675 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.323879 30675 ts_tablet_manager.cc:1403] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.008s
I20260709 13:10:40.325205 30677 tablet_bootstrap.cc:654] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.327638 30675 raft_consensus.cc:359] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.328264 30675 raft_consensus.cc:385] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.328567 30675 raft_consensus.cc:740] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.328926 30676 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.329450 30676 ts_tablet_manager.cc:1403] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.010s
I20260709 13:10:40.329335 30675 consensus_queue.cc:260] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.330904 30677 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.331563 30677 ts_tablet_manager.cc:1403] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 13:10:40.331825 30675 ts_tablet_manager.cc:1434] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:40.332803 30675 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.332739 30676 raft_consensus.cc:359] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.333636 30676 raft_consensus.cc:385] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.333948 30676 raft_consensus.cc:740] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.334565 30677 raft_consensus.cc:359] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.334630 30676 consensus_queue.cc:260] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.335461 30677 raft_consensus.cc:385] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.335774 30677 raft_consensus.cc:740] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.336608 30677 consensus_queue.cc:260] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.337236 30676 ts_tablet_manager.cc:1434] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:40.338400 30676 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.339509 30677 ts_tablet_manager.cc:1434] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:10:40.340533 30677 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.344774 30675 tablet_bootstrap.cc:654] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.345281 30676 tablet_bootstrap.cc:654] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.353155 30677 tablet_bootstrap.cc:654] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.358493 30675 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.358963 30675 ts_tablet_manager.cc:1403] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.010s
I20260709 13:10:40.362025 30675 raft_consensus.cc:359] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.362716 30675 raft_consensus.cc:385] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.358978 30676 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.363945 30676 ts_tablet_manager.cc:1403] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:10:40.362986 30675 raft_consensus.cc:740] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.367558 30675 consensus_queue.cc:260] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.370663 30675 ts_tablet_manager.cc:1434] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:10:40.371908 30675 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
W20260709 13:10:40.373111 30319 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:40.377985 30677 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.377647 30676 raft_consensus.cc:359] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.378520 30677 ts_tablet_manager.cc:1403] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.014s
I20260709 13:10:40.378587 30676 raft_consensus.cc:385] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.379065 30676 raft_consensus.cc:740] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.379211 30675 tablet_bootstrap.cc:654] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.380012 30676 consensus_queue.cc:260] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.381731 30677 raft_consensus.cc:359] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.382422 30676 ts_tablet_manager.cc:1434] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:10:40.382658 30677 raft_consensus.cc:385] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.383095 30677 raft_consensus.cc:740] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.383738 30676 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.384056 30677 consensus_queue.cc:260] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.387775 30677 ts_tablet_manager.cc:1434] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:10:40.388975 30677 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.397445 30677 tablet_bootstrap.cc:654] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.407174 30676 tablet_bootstrap.cc:654] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.407975 30675 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.408329 30677 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.408517 30675 ts_tablet_manager.cc:1403] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.015s
I20260709 13:10:40.408831 30677 ts_tablet_manager.cc:1403] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:10:40.411783 30675 raft_consensus.cc:359] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.412518 30675 raft_consensus.cc:385] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.412282 30677 raft_consensus.cc:359] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.412818 30675 raft_consensus.cc:740] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.413070 30677 raft_consensus.cc:385] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.413430 30677 raft_consensus.cc:740] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.413671 30675 consensus_queue.cc:260] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.414161 30677 consensus_queue.cc:260] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.416316 30675 ts_tablet_manager.cc:1434] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:40.416368 30677 ts_tablet_manager.cc:1434] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:40.417505 30675 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.418211 30677 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.424846 30675 tablet_bootstrap.cc:654] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.425087 30677 tablet_bootstrap.cc:654] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.434521 30676 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.435292 30676 ts_tablet_manager.cc:1403] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.002s
I20260709 13:10:40.438522 30675 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.438278 30676 raft_consensus.cc:359] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.438984 30676 raft_consensus.cc:385] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.439122 30675 ts_tablet_manager.cc:1403] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 13:10:40.439356 30676 raft_consensus.cc:740] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.440110 30676 consensus_queue.cc:260] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.442322 30676 ts_tablet_manager.cc:1434] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:40.442255 30675 raft_consensus.cc:359] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.443045 30675 raft_consensus.cc:385] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.443372 30675 raft_consensus.cc:740] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.444398 30675 consensus_queue.cc:260] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.447156 30675 ts_tablet_manager.cc:1434] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:10:40.448766 30675 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.449694 30676 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.452064 30677 tablet_bootstrap.cc:492] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.453312 30677 ts_tablet_manager.cc:1403] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 13:10:40.455514 30675 tablet_bootstrap.cc:654] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.456179 30677 raft_consensus.cc:359] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.456945 30677 raft_consensus.cc:385] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.457237 30677 raft_consensus.cc:740] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.457962 30677 consensus_queue.cc:260] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.461059 30677 ts_tablet_manager.cc:1434] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:40.470861 30677 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.487533 30676 tablet_bootstrap.cc:654] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.490118 30677 tablet_bootstrap.cc:654] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.494092 30675 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.494629 30675 ts_tablet_manager.cc:1403] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.016s
I20260709 13:10:40.495502 30664 raft_consensus.cc:493] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.495956 30664 raft_consensus.cc:515] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.498202 30664 leader_election.cc:290] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.498025 30675 raft_consensus.cc:359] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.498633 30676 tablet_bootstrap.cc:492] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.498811 30675 raft_consensus.cc:385] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.498901 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.499176 30676 ts_tablet_manager.cc:1403] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.003s
I20260709 13:10:40.499132 30675 raft_consensus.cc:740] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.499714 30372 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:40.504875 30677 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.499785 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.500128 30675 consensus_queue.cc:260] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.508849 30677 ts_tablet_manager.cc:1403] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:10:40.508934 30446 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:40.509512 30485 leader_election.cc:304] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.510689 30675 ts_tablet_manager.cc:1434] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 13:10:40.511739 30675 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.507978 30676 raft_consensus.cc:359] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.513018 30676 raft_consensus.cc:385] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.513293 30676 raft_consensus.cc:740] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.514200 30676 consensus_queue.cc:260] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.512027 30677 raft_consensus.cc:359] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.516218 30677 raft_consensus.cc:385] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.516525 30677 raft_consensus.cc:740] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.517263 30677 consensus_queue.cc:260] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.518399 30675 tablet_bootstrap.cc:654] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.525723 30676 ts_tablet_manager.cc:1434] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.005s
I20260709 13:10:40.527889 30677 ts_tablet_manager.cc:1434] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:10:40.529131 30677 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.529039 30695 raft_consensus.cc:2804] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.529700 30695 raft_consensus.cc:493] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.530092 30695 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.530901 30675 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.531359 30676 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.531447 30675 ts_tablet_manager.cc:1403] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:10:40.534852 30675 raft_consensus.cc:359] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.535652 30675 raft_consensus.cc:385] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.535972 30675 raft_consensus.cc:740] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.536829 30675 consensus_queue.cc:260] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.538462 30676 tablet_bootstrap.cc:654] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.539456 30675 ts_tablet_manager.cc:1434] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:40.540990 30675 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.543656 30695 raft_consensus.cc:515] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.546742 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:40.547278 30677 tablet_bootstrap.cc:654] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.547395 30446 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.547885 30675 tablet_bootstrap.cc:654] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.552742 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.553325 30372 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.554687 30676 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.555230 30676 ts_tablet_manager.cc:1403] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:10:40.556879 30675 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.557485 30675 ts_tablet_manager.cc:1403] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 13:10:40.558997 30446 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:40.559900 30695 leader_election.cc:290] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.558947 30676 raft_consensus.cc:359] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.564257 30676 raft_consensus.cc:385] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.564782 30488 leader_election.cc:304] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.565800 30676 raft_consensus.cc:740] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.565160 30675 raft_consensus.cc:359] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.566781 30675 raft_consensus.cc:385] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.567093 30675 raft_consensus.cc:740] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.567997 30372 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:40.568084 30675 consensus_queue.cc:260] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.569589 30664 raft_consensus.cc:2804] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.570282 30676 consensus_queue.cc:260] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.570977 30675 ts_tablet_manager.cc:1434] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:40.572175 30675 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.573443 30676 ts_tablet_manager.cc:1434] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:40.574479 30676 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.579437 30675 tablet_bootstrap.cc:654] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.572206 30677 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.580431 30677 ts_tablet_manager.cc:1403] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.001s
I20260709 13:10:40.580893 30676 tablet_bootstrap.cc:654] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.584393 30677 raft_consensus.cc:359] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.594148 30677 raft_consensus.cc:385] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.594681 30677 raft_consensus.cc:740] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.595749 30696 raft_consensus.cc:493] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.595590 30677 consensus_queue.cc:260] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.596481 30696 raft_consensus.cc:515] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.593159 30701 raft_consensus.cc:493] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.598248 30701 raft_consensus.cc:515] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.597667 30664 raft_consensus.cc:697] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:40.599915 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26adb270484ddbac86569b8f488f19" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.600819 30372 raft_consensus.cc:2468] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:40.599279 30696 leader_election.cc:290] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.602349 30411 leader_election.cc:304] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:40.603206 30696 raft_consensus.cc:2804] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.603710 30696 raft_consensus.cc:493] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.604202 30696 raft_consensus.cc:3060] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.603811 30664 consensus_queue.cc:237] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.604661 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.605365 30372 raft_consensus.cc:2468] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:40.606899 30485 leader_election.cc:304] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.609218 30677 ts_tablet_manager.cc:1434] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:40.611846 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.610740 30701 leader_election.cc:290] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.612581 30677 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
W20260709 13:10:40.613309 30488 leader_election.cc:343] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.617470 30696 raft_consensus.cc:515] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.620260 30677 tablet_bootstrap.cc:654] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.620931 30696 leader_election.cc:290] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.622929 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26adb270484ddbac86569b8f488f19" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.630216 30372 raft_consensus.cc:3060] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.626590 30695 raft_consensus.cc:2804] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.634477 30695 raft_consensus.cc:493] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.637123 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26adb270484ddbac86569b8f488f19" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.637938 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26adb270484ddbac86569b8f488f19" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.634898 30695 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:40.639542 30412 leader_election.cc:343] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.641407 30675 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.643168 30372 raft_consensus.cc:2468] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:40.643965 30675 ts_tablet_manager.cc:1403] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.051s
W20260709 13:10:40.643860 30412 leader_election.cc:343] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.645152 30411 leader_election.cc:304] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:40.641759 30676 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.646080 30696 raft_consensus.cc:2804] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.646757 30696 raft_consensus.cc:697] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:40.646837 30689 raft_consensus.cc:493] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.646845 30677 tablet_bootstrap.cc:492] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.647378 30689 raft_consensus.cc:515] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.648046 30677 ts_tablet_manager.cc:1403] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.001s
I20260709 13:10:40.647679 30696 consensus_queue.cc:237] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.649626 30689 leader_election.cc:290] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.651149 30677 raft_consensus.cc:359] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.651783 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2600e5efa9c542e1bfef48610290e26a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.651933 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2600e5efa9c542e1bfef48610290e26a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.652223 30677 raft_consensus.cc:385] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.652444 30521 raft_consensus.cc:2468] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:40.652051 30676 ts_tablet_manager.cc:1403] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.026s
I20260709 13:10:40.651190 30695 raft_consensus.cc:515] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.654023 30337 leader_election.cc:304] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.654910 30689 raft_consensus.cc:2804] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.655297 30689 raft_consensus.cc:493] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.655645 30689 raft_consensus.cc:3060] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.652757 30677 raft_consensus.cc:740] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.659054 30676 raft_consensus.cc:359] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.652949 30604 raft_consensus.cc:493] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.659807 30676 raft_consensus.cc:385] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.659551 30677 consensus_queue.cc:260] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.660136 30676 raft_consensus.cc:740] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.659987 30604 raft_consensus.cc:515] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.661038 30676 consensus_queue.cc:260] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.662218 30604 leader_election.cc:290] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.662721 30604 raft_consensus.cc:493] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.652525 30446 raft_consensus.cc:2468] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:40.663393 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b347e4c3554d499d66de95654f416a" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.664117 30521 raft_consensus.cc:2468] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:40.663918 30675 raft_consensus.cc:359] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.664662 30675 raft_consensus.cc:385] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.664934 30675 raft_consensus.cc:740] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.665295 30412 leader_election.cc:304] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.665577 30675 consensus_queue.cc:260] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.667951 30677 ts_tablet_manager.cc:1434] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:10:40.669279 30677 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.661856 30269 catalog_manager.cc:5697] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.672024 30675 ts_tablet_manager.cc:1434] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:40.674101 30675 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: Bootstrap starting.
I20260709 13:10:40.676316 30702 raft_consensus.cc:493] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.676800 30702 raft_consensus.cc:515] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.677688 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b347e4c3554d499d66de95654f416a" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.678315 30373 raft_consensus.cc:2468] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:40.678949 30702 leader_election.cc:290] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.675583 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.681026 30372 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.683975 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.684635 30446 raft_consensus.cc:2468] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 0.
I20260709 13:10:40.685338 30677 tablet_bootstrap.cc:654] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.685526 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.659469 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:40.688316 30488 leader_election.cc:304] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
W20260709 13:10:40.689219 30488 leader_election.cc:343] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.690176 30702 raft_consensus.cc:2804] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.690635 30702 raft_consensus.cc:493] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.691913 30675 tablet_bootstrap.cc:654] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.691056 30702 raft_consensus.cc:3060] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:40.693550 30485 leader_election.cc:343] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.663105 30604 raft_consensus.cc:515] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.698297 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.699745 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:40.700430 30604 leader_election.cc:290] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
W20260709 13:10:40.701591 30411 leader_election.cc:343] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.702312 30521 raft_consensus.cc:2468] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 0.
I20260709 13:10:40.703547 30412 leader_election.cc:304] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:40.702261 30604 raft_consensus.cc:2804] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.705287 30604 raft_consensus.cc:493] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.705683 30604 raft_consensus.cc:3060] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.707396 30689 raft_consensus.cc:515] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.710374 30675 tablet_bootstrap.cc:492] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: No bootstrap required, opened a new log
I20260709 13:10:40.717658 30675 ts_tablet_manager.cc:1403] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.005s
I20260709 13:10:40.720304 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2600e5efa9c542e1bfef48610290e26a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:40.720636 30696 raft_consensus.cc:2804] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.721065 30445 raft_consensus.cc:3060] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.721138 30696 raft_consensus.cc:493] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.721714 30696 raft_consensus.cc:3060] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.728811 30445 raft_consensus.cc:2468] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:40.728767 30270 catalog_manager.cc:5697] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.730249 30339 leader_election.cc:304] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:40.731573 30690 raft_consensus.cc:2804] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.731564 30675 raft_consensus.cc:359] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.732379 30690 raft_consensus.cc:697] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:40.732730 30675 raft_consensus.cc:385] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.733139 30675 raft_consensus.cc:740] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.730897 30696 raft_consensus.cc:515] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.733263 30690 consensus_queue.cc:237] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.733920 30675 consensus_queue.cc:260] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.735280 30696 leader_election.cc:290] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.736846 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.738577 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.739318 30521 raft_consensus.cc:3060] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.741478 30689 leader_election.cc:290] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.712903 30372 raft_consensus.cc:2468] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:40.745008 30677 tablet_bootstrap.cc:492] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.745527 30677 ts_tablet_manager.cc:1403] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.014s
I20260709 13:10:40.745811 30485 leader_election.cc:304] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:40.714489 30702 raft_consensus.cc:515] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.745358 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2600e5efa9c542e1bfef48610290e26a" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.747296 30522 raft_consensus.cc:3060] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:40.747483 30411 leader_election.cc:343] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.748279 30664 raft_consensus.cc:2804] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.748813 30664 raft_consensus.cc:697] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:40.749159 30675 ts_tablet_manager.cc:1434] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:10:40.749747 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.749642 30664 consensus_queue.cc:237] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.752020 30702 leader_election.cc:290] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.752218 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:40.753085 30446 raft_consensus.cc:3060] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:40.755306 30485 leader_election.cc:343] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.755820 30522 raft_consensus.cc:2468] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:40.757597 30677 raft_consensus.cc:359] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.758262 30677 raft_consensus.cc:385] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.758510 30677 raft_consensus.cc:740] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.713001 30695 leader_election.cc:290] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:40.761497 30676 ts_tablet_manager.cc:1434] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.107s	user 0.014s	sys 0.025s
I20260709 13:10:40.759106 30677 consensus_queue.cc:260] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.762879 30676 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.764434 30677 ts_tablet_manager.cc:1434] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:10:40.765390 30677 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: Bootstrap starting.
I20260709 13:10:40.752492 30689 raft_consensus.cc:493] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.767221 30446 raft_consensus.cc:2468] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 1.
I20260709 13:10:40.784703 30677 tablet_bootstrap.cc:654] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.785359 30488 leader_election.cc:304] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:40.786674 30695 raft_consensus.cc:2804] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.787148 30695 raft_consensus.cc:697] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:40.788028 30695 consensus_queue.cc:237] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.784711 30676 tablet_bootstrap.cc:654] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.775903 30521 raft_consensus.cc:2468] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:40.795413 30412 leader_election.cc:304] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:40.773437 30604 raft_consensus.cc:515] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.784045 30689 raft_consensus.cc:515] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.799643 30709 raft_consensus.cc:2804] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.803824 30709 raft_consensus.cc:697] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:40.805124 30709 consensus_queue.cc:237] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.814440 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.815093 30689 leader_election.cc:290] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.818310 30677 tablet_bootstrap.cc:492] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: No bootstrap required, opened a new log
I20260709 13:10:40.818869 30677 ts_tablet_manager.cc:1403] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.027s
W20260709 13:10:40.821689 30339 leader_election.cc:343] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.822031 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b347e4c3554d499d66de95654f416a" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:40.822710 30373 raft_consensus.cc:3060] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.820356 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b347e4c3554d499d66de95654f416a" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.818630 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.823935 30522 raft_consensus.cc:3060] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.824255 30521 raft_consensus.cc:2468] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:40.825623 30337 leader_election.cc:304] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:40.826996 30268 catalog_manager.cc:5697] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.818094 30604 leader_election.cc:290] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.831067 30690 raft_consensus.cc:493] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.831611 30690 raft_consensus.cc:515] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.833678 30690 leader_election.cc:290] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.836956 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:40.838619 30522 raft_consensus.cc:2468] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
W20260709 13:10:40.838965 30339 leader_election.cc:343] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.840674 30412 leader_election.cc:304] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:40.842113 30708 raft_consensus.cc:2804] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.842697 30708 raft_consensus.cc:697] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:40.828262 30677 raft_consensus.cc:359] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.843595 30677 raft_consensus.cc:385] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.843892 30677 raft_consensus.cc:740] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.844551 30677 consensus_queue.cc:260] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.846832 30677 ts_tablet_manager.cc:1434] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.005s
I20260709 13:10:40.843691 30708 consensus_queue.cc:237] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.852434 30373 raft_consensus.cc:2468] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 1.
I20260709 13:10:40.854164 30676 tablet_bootstrap.cc:492] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.855288 30676 ts_tablet_manager.cc:1403] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.021s
I20260709 13:10:40.851610 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:40.857944 30270 catalog_manager.cc:5697] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.851888 30689 raft_consensus.cc:2804] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.860045 30270 catalog_manager.cc:5697] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 1 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.862401 30676 raft_consensus.cc:359] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.863085 30676 raft_consensus.cc:385] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.859462 30689 raft_consensus.cc:493] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.863394 30676 raft_consensus.cc:740] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.864017 30522 raft_consensus.cc:2468] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 0.
I20260709 13:10:40.864172 30689 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.865340 30676 consensus_queue.cc:260] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.865733 30337 leader_election.cc:304] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:40.866923 30690 raft_consensus.cc:2804] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.867304 30690 raft_consensus.cc:493] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.867663 30690 raft_consensus.cc:3060] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.870117 30676 ts_tablet_manager.cc:1434] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:10:40.871237 30676 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.875898 30689 raft_consensus.cc:515] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.877846 30676 tablet_bootstrap.cc:654] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.878252 30689 leader_election.cc:290] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.879298 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.879365 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:40.879988 30522 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.880113 30446 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.883126 30676 tablet_bootstrap.cc:492] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.883747 30676 ts_tablet_manager.cc:1403] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:10:40.886375 30676 raft_consensus.cc:359] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.886965 30676 raft_consensus.cc:385] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.887194 30676 raft_consensus.cc:740] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.887184 30446 raft_consensus.cc:2468] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:40.887974 30676 consensus_queue.cc:260] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.887660 30266 catalog_manager.cc:5697] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.888857 30339 leader_election.cc:304] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:40.889739 30689 raft_consensus.cc:2804] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.890153 30676 ts_tablet_manager.cc:1434] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:10:40.890388 30689 raft_consensus.cc:697] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:40.890543 30690 raft_consensus.cc:515] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.891096 30676 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: Bootstrap starting.
I20260709 13:10:40.891228 30689 consensus_queue.cc:237] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.893599 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8"
W20260709 13:10:40.894776 30339 leader_election.cc:343] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.895496 30522 raft_consensus.cc:2468] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:40.896929 30690 leader_election.cc:290] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:40.897069 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:40.897487 30676 tablet_bootstrap.cc:654] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.897708 30521 raft_consensus.cc:3060] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.906257 30676 tablet_bootstrap.cc:492] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: No bootstrap required, opened a new log
I20260709 13:10:40.906802 30676 ts_tablet_manager.cc:1403] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:10:40.908651 30521 raft_consensus.cc:2468] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 1.
I20260709 13:10:40.909488 30676 raft_consensus.cc:359] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.910158 30676 raft_consensus.cc:385] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.910420 30676 raft_consensus.cc:740] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.911055 30676 consensus_queue.cc:260] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.911866 30337 leader_election.cc:304] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:40.913072 30689 raft_consensus.cc:2804] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.913295 30676 ts_tablet_manager.cc:1434] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:40.913740 30689 raft_consensus.cc:697] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:40.914486 30689 consensus_queue.cc:237] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:40.915604 30269 catalog_manager.cc:5697] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.923982 30266 catalog_manager.cc:5697] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 1 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.930855 30269 catalog_manager.cc:5697] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 1 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.958705 30522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
mode: GRACEFUL
new_leader_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:54966
I20260709 13:10:40.959234 30522 raft_consensus.cc:606] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Received request to transfer leadership to TS 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:40.968905 30522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
mode: GRACEFUL
new_leader_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:54966
I20260709 13:10:40.969380 30522 raft_consensus.cc:606] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Received request to transfer leadership to TS 4d4d910762234fb684b6fb15432253d1
I20260709 13:10:40.980836 30373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
mode: GRACEFUL
new_leader_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:45850
I20260709 13:10:40.981307 30373 raft_consensus.cc:606] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Received request to transfer leadership to TS 114185d24edf4fb0809161989486a8c8
I20260709 13:10:41.006632 30689 raft_consensus.cc:493] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.007090 30689 raft_consensus.cc:515] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.008801 30689 leader_election.cc:290] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.009393 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:41.009857 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f134672ad04c9eb8dc17f94444feee" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:41.010665 30522 raft_consensus.cc:2393] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d4d910762234fb684b6fb15432253d1 in current term 1: Already voted for candidate 114185d24edf4fb0809161989486a8c8 in this term.
I20260709 13:10:41.011595 30337 leader_election.cc:304] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1; no voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:41.012212 30690 raft_consensus.cc:3060] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.017002 30690 raft_consensus.cc:2749] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.128793 30708 consensus_queue.cc:1048] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.139497 30522 raft_consensus.cc:3060] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.139686 30695 consensus_queue.cc:1048] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.150403 30708 consensus_queue.cc:1048] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.156486 30695 consensus_queue.cc:1048] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.167044 30695 raft_consensus.cc:993] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: : Instructing follower 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:41.167532 30664 raft_consensus.cc:1081] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Signalling peer 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:41.169287 30372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:45836
I20260709 13:10:41.169864 30372 raft_consensus.cc:493] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.170215 30372 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.177965 30372 raft_consensus.cc:515] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.180976 30372 leader_election.cc:290] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.183641 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:41.184291 30445 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.185386 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2d726e129a404f95cf8b12416fafec" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:41.186024 30522 raft_consensus.cc:3055] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.186342 30690 raft_consensus.cc:493] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.186352 30522 raft_consensus.cc:740] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:41.187012 30690 raft_consensus.cc:515] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.187667 30522 consensus_queue.cc:260] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.189049 30522 raft_consensus.cc:3060] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.189342 30690 leader_election.cc:290] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.190644 30445 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 2.
I20260709 13:10:41.190953 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114185d24edf4fb0809161989486a8c8" is_pre_election: true
I20260709 13:10:41.191601 30339 leader_election.cc:304] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: 
I20260709 13:10:41.191818 30446 raft_consensus.cc:2393] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d4d910762234fb684b6fb15432253d1 in current term 1: Already voted for candidate eaf1885b8d53412a92eeb8d864dd8a22 in this term.
I20260709 13:10:41.192365 30690 raft_consensus.cc:2804] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.193596 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4f5c435b124476b72659f891552e0f" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:41.193064 30690 raft_consensus.cc:697] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:41.194862 30690 consensus_queue.cc:237] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.194962 30337 leader_election.cc:304] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1; no voters: 114185d24edf4fb0809161989486a8c8, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:41.195797 30522 raft_consensus.cc:2468] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 2.
I20260709 13:10:41.195906 30689 raft_consensus.cc:3060] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.202592 30689 raft_consensus.cc:2749] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.206439 30269 catalog_manager.cc:5697] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 1 to 2, leader changed from eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3) to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.233556 30664 consensus_queue.cc:1048] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.243408 30701 consensus_queue.cc:1048] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.259510 30689 consensus_queue.cc:1048] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.269330 30689 consensus_queue.cc:1048] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.274974 30701 consensus_queue.cc:1048] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.281914 30709 consensus_queue.cc:1048] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.285285 30701 raft_consensus.cc:993] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: : Instructing follower 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:41.285704 30701 raft_consensus.cc:1081] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Signalling peer 4d4d910762234fb684b6fb15432253d1 to start an election
I20260709 13:10:41.289386 30370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
 from {username='slave'} at 127.0.0.1:45836
I20260709 13:10:41.290258 30370 raft_consensus.cc:493] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.290647 30370 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.296175 30446 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.299571 30370 raft_consensus.cc:515] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.303341 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:41.303759 30370 leader_election.cc:290] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Requested vote from peers 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.303906 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "4d4d910762234fb684b6fb15432253d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:41.304544 30521 raft_consensus.cc:3055] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.304857 30521 raft_consensus.cc:740] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:41.305624 30521 consensus_queue.cc:260] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.306103 30708 consensus_queue.cc:1048] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.306571 30521 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.309852 30708 raft_consensus.cc:493] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.310279 30708 raft_consensus.cc:515] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.312245 30708 leader_election.cc:290] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.314008 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:41.314893 30520 raft_consensus.cc:2393] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 114185d24edf4fb0809161989486a8c8 in current term 1: Already voted for candidate 4d4d910762234fb684b6fb15432253d1 in this term.
I20260709 13:10:41.318099 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1616b892bc4934bf8cf010cd52aed3" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:41.320276 30411 leader_election.cc:304] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 114185d24edf4fb0809161989486a8c8; no voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:41.321069 30709 raft_consensus.cc:3060] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.323081 30521 raft_consensus.cc:2468] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4d910762234fb684b6fb15432253d1 in term 2.
I20260709 13:10:41.324314 30337 leader_election.cc:304] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 114185d24edf4fb0809161989486a8c8
I20260709 13:10:41.325130 30689 raft_consensus.cc:2804] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.325620 30689 raft_consensus.cc:697] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:41.326359 30689 consensus_queue.cc:237] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.327620 30709 raft_consensus.cc:2749] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.333010 30269 catalog_manager.cc:5697] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 reported cstate change: term changed from 1 to 2, leader changed from eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3) to 4d4d910762234fb684b6fb15432253d1 (127.19.145.1). New cstate: current_term: 2 leader_uuid: "4d4d910762234fb684b6fb15432253d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.339625 30689 consensus_queue.cc:1048] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.345434 30691 raft_consensus.cc:993] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: : Instructing follower 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:41.345918 30690 raft_consensus.cc:1081] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Signalling peer 114185d24edf4fb0809161989486a8c8 to start an election
I20260709 13:10:41.348356 30445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d"
dest_uuid: "114185d24edf4fb0809161989486a8c8"
 from {username='slave'} at 127.0.0.1:52010
I20260709 13:10:41.348884 30445 raft_consensus.cc:493] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.349229 30445 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.351832 30690 consensus_queue.cc:1048] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.355566 30445 raft_consensus.cc:515] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.358482 30445 leader_election.cc:290] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.358678 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
I20260709 13:10:41.360069 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d123779ba71d4cf0ab0fe596e2448d6d" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:41.360531 30372 raft_consensus.cc:3055] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.360750 30372 raft_consensus.cc:740] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:41.361362 30372 consensus_queue.cc:260] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.362046 30372 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.368000 30372 raft_consensus.cc:2468] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114185d24edf4fb0809161989486a8c8 in term 2.
I20260709 13:10:41.368841 30411 leader_election.cc:304] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 114185d24edf4fb0809161989486a8c8, 4d4d910762234fb684b6fb15432253d1; no voters: eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:41.369532 30709 raft_consensus.cc:2804] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.370378 30709 raft_consensus.cc:697] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Becoming Leader. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:41.371198 30709 consensus_queue.cc:237] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.371878 30708 raft_consensus.cc:493] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.372361 30708 raft_consensus.cc:515] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:41.372988 30604 consensus_queue.cc:1048] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.375339 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" is_pre_election: true
I20260709 13:10:41.376547 30521 raft_consensus.cc:2393] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 114185d24edf4fb0809161989486a8c8 in current term 2: Already voted for candidate 4d4d910762234fb684b6fb15432253d1 in this term.
I20260709 13:10:41.375349 30708 leader_election.cc:290] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3:35211)
I20260709 13:10:41.382427 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9462a686c642f4a669cd5e40712a04" candidate_uuid: "114185d24edf4fb0809161989486a8c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4d910762234fb684b6fb15432253d1" is_pre_election: true
I20260709 13:10:41.382390 30690 consensus_queue.cc:1048] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.384738 30691 consensus_queue.cc:1048] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.384801 30411 leader_election.cc:304] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 114185d24edf4fb0809161989486a8c8; no voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:41.390892 30604 raft_consensus.cc:3060] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.390986 30708 consensus_queue.cc:1048] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.391892 30269 catalog_manager.cc:5697] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 reported cstate change: term changed from 1 to 2, leader changed from 4d4d910762234fb684b6fb15432253d1 (127.19.145.1) to 114185d24edf4fb0809161989486a8c8 (127.19.145.2). New cstate: current_term: 2 leader_uuid: "114185d24edf4fb0809161989486a8c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.400467 30604 raft_consensus.cc:2749] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:41.653728 30446 raft_consensus.cc:1275] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.654811 30689 consensus_queue.cc:1048] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.662177 30521 raft_consensus.cc:1275] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.663522 30747 consensus_queue.cc:1048] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.811292 30372 raft_consensus.cc:1275] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.812314 30709 consensus_queue.cc:1048] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.822770 30521 raft_consensus.cc:3060] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.830116 30521 raft_consensus.cc:1275] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 114185d24edf4fb0809161989486a8c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.831418 30708 consensus_queue.cc:1048] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.875912 30446 raft_consensus.cc:1275] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.877087 30747 consensus_queue.cc:1048] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.889107 30522 raft_consensus.cc:1275] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Refusing update from remote peer 4d4d910762234fb684b6fb15432253d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.890336 30690 consensus_queue.cc:1048] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.986877 30269 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57050:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:44.008833 30269 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57050:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:44.086416 20036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:44.119226 30785 tablet.cc:1724] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:44.155915 30762 log.cc:927] Time spent T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:44.180433 30806 tablet.cc:1724] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.176795 30805 tablet.cc:1724] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.183454 30785 tablet.cc:1724] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.192997 30809 tablet.cc:1724] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.193584 30810 tablet.cc:1724] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.185985 30784 tablet.cc:1724] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:44.203377 30412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:35211, user_credentials={real_user=slave}} blocked reactor thread for 69196.5us
I20260709 13:10:44.207214 30370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112"
dest_uuid: "4d4d910762234fb684b6fb15432253d1"
mode: GRACEFUL
new_leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
 from {username='slave'} at 127.0.0.1:53402
I20260709 13:10:44.207913 30370 raft_consensus.cc:606] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Received request to transfer leadership to TS eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:44.246424 30785 tablet.cc:1724] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.255913 30822 tablet.cc:1724] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:44.266036 30337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.145.3:35211, user_credentials={real_user=slave}} blocked reactor thread for 65578.5us
I20260709 13:10:44.223137 30823 tablet.cc:1724] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.274786 30444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b"
dest_uuid: "114185d24edf4fb0809161989486a8c8"
mode: GRACEFUL
new_leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
 from {username='slave'} at 127.0.0.1:57690
I20260709 13:10:44.275442 30444 raft_consensus.cc:606] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Received request to transfer leadership to TS eaf1885b8d53412a92eeb8d864dd8a22
I20260709 13:10:44.286733 20036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:44.287633 20036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:44.331668 30826 tablet.cc:1724] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.332736 30806 tablet.cc:1724] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.335161 30784 tablet.cc:1724] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.339994 30805 tablet.cc:1724] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.347139 30810 tablet.cc:1724] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.354176 30806 tablet.cc:1724] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.355815 30827 tablet.cc:1724] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.359434 30822 tablet.cc:1724] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.354971 30809 tablet.cc:1724] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.361871 30828 tablet.cc:1724] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.330781 30830 tablet.cc:1724] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.364802 30826 tablet.cc:1724] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.366639 30785 tablet.cc:1724] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.383066 30784 tablet.cc:1724] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.387487 30752 raft_consensus.cc:993] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: : Instructing follower eaf1885b8d53412a92eeb8d864dd8a22 to start an election
I20260709 13:10:44.388034 30752 raft_consensus.cc:1081] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Signalling peer eaf1885b8d53412a92eeb8d864dd8a22 to start an election
I20260709 13:10:44.389676 30517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
 from {username='slave'} at 127.0.0.1:54956
I20260709 13:10:44.390305 30517 raft_consensus.cc:493] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.390681 30517 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.398849 30822 tablet.cc:1724] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.403612 30517 raft_consensus.cc:515] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.404083 30828 tablet.cc:1724] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.411955 30830 tablet.cc:1724] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:44.420516 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:44.421103 30373 raft_consensus.cc:3055] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.421423 30373 raft_consensus.cc:740] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d4d910762234fb684b6fb15432253d1, State: Running, Role: LEADER
I20260709 13:10:44.421875 30517 leader_election.cc:290] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:44.422214 30373 consensus_queue.cc:260] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.423563 30373 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.425853 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4562e7c9d58c48bfb644efdcdceb5112" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:44.426474 30445 raft_consensus.cc:3060] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.434434 30373 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 2.
I20260709 13:10:44.435735 30485 leader_election.cc:304] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:44.436658 30829 raft_consensus.cc:2804] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.436751 30445 raft_consensus.cc:2468] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 2.
I20260709 13:10:44.437165 30829 raft_consensus.cc:697] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:44.438051 30829 consensus_queue.cc:237] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.445950 30266 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: soft_deleted_table [id=a166bf3971f2407db5a452564a3702d7] alter complete (version 1)
I20260709 13:10:44.454546 30266 catalog_manager.cc:5697] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 1 to 2, leader changed from 4d4d910762234fb684b6fb15432253d1 (127.19.145.1) to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 2 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.523730 30802 raft_consensus.cc:993] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: : Instructing follower eaf1885b8d53412a92eeb8d864dd8a22 to start an election
I20260709 13:10:44.524310 30803 raft_consensus.cc:1081] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Signalling peer eaf1885b8d53412a92eeb8d864dd8a22 to start an election
I20260709 13:10:44.525956 30517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b"
dest_uuid: "eaf1885b8d53412a92eeb8d864dd8a22"
 from {username='slave'} at 127.0.0.1:54958
I20260709 13:10:44.526427 30517 raft_consensus.cc:493] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.526746 30517 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.531754 30517 raft_consensus.cc:515] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.533499 30517 leader_election.cc:290] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 3 election: Requested vote from peers 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613), 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313)
I20260709 13:10:44.534380 30445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "114185d24edf4fb0809161989486a8c8"
I20260709 13:10:44.534389 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b771396bb9104a77b8364a3dea4cf59b" candidate_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d4d910762234fb684b6fb15432253d1"
I20260709 13:10:44.535000 30445 raft_consensus.cc:3055] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:44.535091 30373 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.535336 30445 raft_consensus.cc:740] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 114185d24edf4fb0809161989486a8c8, State: Running, Role: LEADER
I20260709 13:10:44.536156 30445 consensus_queue.cc:260] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.537034 30445 raft_consensus.cc:3060] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.539896 30373 raft_consensus.cc:2468] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 3.
I20260709 13:10:44.540928 30485 leader_election.cc:304] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4d910762234fb684b6fb15432253d1, eaf1885b8d53412a92eeb8d864dd8a22; no voters: 
I20260709 13:10:44.541574 30829 raft_consensus.cc:2804] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:44.541941 30445 raft_consensus.cc:2468] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaf1885b8d53412a92eeb8d864dd8a22 in term 3.
I20260709 13:10:44.541965 30829 raft_consensus.cc:697] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 3 LEADER]: Becoming Leader. State: Replica: eaf1885b8d53412a92eeb8d864dd8a22, State: Running, Role: LEADER
I20260709 13:10:44.542852 30829 consensus_queue.cc:237] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } }
I20260709 13:10:44.551213 30266 catalog_manager.cc:5697] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 reported cstate change: term changed from 2 to 3, leader changed from 114185d24edf4fb0809161989486a8c8 (127.19.145.2) to eaf1885b8d53412a92eeb8d864dd8a22 (127.19.145.3). New cstate: current_term: 3 leader_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaf1885b8d53412a92eeb8d864dd8a22" member_type: VOTER last_known_addr { host: "127.19.145.3" port: 35211 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.836040 30373 raft_consensus.cc:1275] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Refusing update from remote peer eaf1885b8d53412a92eeb8d864dd8a22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.837441 30829 consensus_queue.cc:1048] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.849121 30445 raft_consensus.cc:1275] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Refusing update from remote peer eaf1885b8d53412a92eeb8d864dd8a22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.850463 30835 consensus_queue.cc:1048] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.921811 30373 raft_consensus.cc:1275] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 3 FOLLOWER]: Refusing update from remote peer eaf1885b8d53412a92eeb8d864dd8a22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.923066 30835 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4d910762234fb684b6fb15432253d1" member_type: VOTER last_known_addr { host: "127.19.145.1" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.933331 30445 raft_consensus.cc:1275] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 3 FOLLOWER]: Refusing update from remote peer eaf1885b8d53412a92eeb8d864dd8a22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.934798 30829 consensus_queue.cc:1048] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114185d24edf4fb0809161989486a8c8" member_type: VOTER last_known_addr { host: "127.19.145.2" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.357983 20036 tablet_server.cc:179] TabletServer@127.19.145.1:0 shutting down...
I20260709 13:10:45.387423 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.388093 20036 tablet_replica.cc:333] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.388684 20036 raft_consensus.cc:2243] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.389143 20036 raft_consensus.cc:2272] T 5f4f5c435b124476b72659f891552e0f P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.391674 20036 tablet_replica.cc:333] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.392226 20036 raft_consensus.cc:2243] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.392652 20036 raft_consensus.cc:2272] T b4b347e4c3554d499d66de95654f416a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.394380 20036 tablet_replica.cc:333] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.395092 20036 raft_consensus.cc:2243] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.395852 20036 raft_consensus.cc:2272] T 7c9462a686c642f4a669cd5e40712a04 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.397451 20036 tablet_replica.cc:333] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.397972 20036 raft_consensus.cc:2243] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.398721 20036 raft_consensus.cc:2272] T eb1616b892bc4934bf8cf010cd52aed3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.400439 20036 tablet_replica.cc:333] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.401053 20036 raft_consensus.cc:2243] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.402349 20036 raft_consensus.cc:2272] T 63a12f4f60f34012bd7abb44fc2823f3 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.404520 20036 tablet_replica.cc:333] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.405203 20036 raft_consensus.cc:2243] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.405850 20036 raft_consensus.cc:2272] T 2b2d726e129a404f95cf8b12416fafec P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.407640 20036 tablet_replica.cc:333] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.408106 20036 raft_consensus.cc:2243] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.408726 20036 raft_consensus.cc:2272] T 2600e5efa9c542e1bfef48610290e26a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.410332 20036 tablet_replica.cc:333] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.410787 20036 raft_consensus.cc:2243] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.411111 20036 raft_consensus.cc:2272] T a0570e21b0e14c319ec354392cc153a4 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.412899 20036 tablet_replica.cc:333] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.413347 20036 raft_consensus.cc:2243] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.414000 20036 raft_consensus.cc:2272] T 5f9a2adcf22d4875838ac278aa142e2b P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.415611 20036 tablet_replica.cc:333] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.416129 20036 raft_consensus.cc:2243] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.416527 20036 raft_consensus.cc:2272] T 9c5cb83965af4da19eded8da4a2b5628 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.418169 20036 tablet_replica.cc:333] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.418682 20036 raft_consensus.cc:2243] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.419080 20036 raft_consensus.cc:2272] T e8adcbd8a1da4c17bd326e55477f0d58 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.421068 20036 tablet_replica.cc:333] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.421629 20036 raft_consensus.cc:2243] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.422122 20036 raft_consensus.cc:2272] T 1a26adb270484ddbac86569b8f488f19 P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.423875 20036 tablet_replica.cc:333] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.424446 20036 raft_consensus.cc:2243] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.425397 20036 raft_consensus.cc:2272] T 220ff2b761b5487faa43e301a3a4196d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.427218 20036 tablet_replica.cc:333] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.427790 20036 raft_consensus.cc:2243] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.428206 20036 raft_consensus.cc:2272] T d123779ba71d4cf0ab0fe596e2448d6d P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.430029 20036 tablet_replica.cc:333] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.430532 20036 raft_consensus.cc:2243] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.430936 20036 raft_consensus.cc:2272] T b771396bb9104a77b8364a3dea4cf59b P 4d4d910762234fb684b6fb15432253d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.433845 20036 tablet_replica.cc:333] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.434795 20036 raft_consensus.cc:2243] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.435335 20036 raft_consensus.cc:2272] T d1f134672ad04c9eb8dc17f94444feee P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.436991 20036 tablet_replica.cc:333] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.437471 20036 raft_consensus.cc:2243] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.437858 20036 raft_consensus.cc:2272] T 4562e7c9d58c48bfb644efdcdceb5112 P 4d4d910762234fb684b6fb15432253d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.440533 20036 tablet_replica.cc:333] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1: stopping tablet replica
I20260709 13:10:45.441015 20036 raft_consensus.cc:2243] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.441701 20036 raft_consensus.cc:2272] T b0a8004c62e045c8a3a5e180cdace92a P 4d4d910762234fb684b6fb15432253d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:45.453421 30485 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:10:45.456211 30485 consensus_peers.cc:597] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 -> Peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Couldn't send request to peer 4d4d910762234fb684b6fb15432253d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.481069 20036 tablet_server.cc:196] TabletServer@127.19.145.1:0 shutdown complete.
I20260709 13:10:45.509524 20036 tablet_server.cc:179] TabletServer@127.19.145.2:0 shutting down...
W20260709 13:10:45.522972 30488 consensus_peers.cc:597] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 -> Peer 114185d24edf4fb0809161989486a8c8 (127.19.145.2:35313): Couldn't send request to peer 114185d24edf4fb0809161989486a8c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:45.532305 30485 consensus_peers.cc:597] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 -> Peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Couldn't send request to peer 4d4d910762234fb684b6fb15432253d1. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.538810 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.539711 20036 tablet_replica.cc:333] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.540622 20036 raft_consensus.cc:2243] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.541250 20036 raft_consensus.cc:2272] T 7c9462a686c642f4a669cd5e40712a04 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.543242 20036 tablet_replica.cc:333] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.543951 20036 raft_consensus.cc:2243] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.544381 20036 raft_consensus.cc:2272] T 5f4f5c435b124476b72659f891552e0f P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.546093 20036 tablet_replica.cc:333] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.546662 20036 raft_consensus.cc:2243] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.547439 20036 raft_consensus.cc:2272] T b4b347e4c3554d499d66de95654f416a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.549117 20036 tablet_replica.cc:333] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.549629 20036 raft_consensus.cc:2243] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.550318 20036 raft_consensus.cc:2272] T a0570e21b0e14c319ec354392cc153a4 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.552162 20036 tablet_replica.cc:333] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.552769 20036 raft_consensus.cc:2243] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.553308 20036 raft_consensus.cc:2272] T eb1616b892bc4934bf8cf010cd52aed3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.554935 20036 tablet_replica.cc:333] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.555437 20036 raft_consensus.cc:2243] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.555781 20036 raft_consensus.cc:2272] T 63a12f4f60f34012bd7abb44fc2823f3 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.557435 20036 tablet_replica.cc:333] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.557889 20036 raft_consensus.cc:2243] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.558537 20036 raft_consensus.cc:2272] T d123779ba71d4cf0ab0fe596e2448d6d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.560231 20036 tablet_replica.cc:333] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.560729 20036 raft_consensus.cc:2243] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.561116 20036 raft_consensus.cc:2272] T b771396bb9104a77b8364a3dea4cf59b P 114185d24edf4fb0809161989486a8c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.563566 20036 tablet_replica.cc:333] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.564092 20036 raft_consensus.cc:2243] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.564782 20036 raft_consensus.cc:2272] T e8adcbd8a1da4c17bd326e55477f0d58 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.566581 20036 tablet_replica.cc:333] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.567126 20036 raft_consensus.cc:2243] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.567854 20036 raft_consensus.cc:2272] T 1a26adb270484ddbac86569b8f488f19 P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.569546 20036 tablet_replica.cc:333] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.570050 20036 raft_consensus.cc:2243] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.570447 20036 raft_consensus.cc:2272] T 220ff2b761b5487faa43e301a3a4196d P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.572175 20036 tablet_replica.cc:333] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.572651 20036 raft_consensus.cc:2243] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.573516 20036 raft_consensus.cc:2272] T d1f134672ad04c9eb8dc17f94444feee P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.575440 20036 tablet_replica.cc:333] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.575953 20036 raft_consensus.cc:2243] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.576327 20036 raft_consensus.cc:2272] T 4562e7c9d58c48bfb644efdcdceb5112 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.579690 20036 tablet_replica.cc:333] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.580173 20036 raft_consensus.cc:2243] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.580577 20036 raft_consensus.cc:2272] T 2600e5efa9c542e1bfef48610290e26a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.582170 20036 tablet_replica.cc:333] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.582686 20036 raft_consensus.cc:2243] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.583302 20036 raft_consensus.cc:2272] T 2b2d726e129a404f95cf8b12416fafec P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.585230 20036 tablet_replica.cc:333] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.585708 20036 raft_consensus.cc:2243] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.586431 20036 raft_consensus.cc:2272] T 9c5cb83965af4da19eded8da4a2b5628 P 114185d24edf4fb0809161989486a8c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.588169 20036 tablet_replica.cc:333] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.588631 20036 raft_consensus.cc:2243] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.589021 20036 raft_consensus.cc:2272] T 5f9a2adcf22d4875838ac278aa142e2b P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.590834 20036 tablet_replica.cc:333] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8: stopping tablet replica
I20260709 13:10:45.591454 20036 raft_consensus.cc:2243] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.591895 20036 raft_consensus.cc:2272] T b0a8004c62e045c8a3a5e180cdace92a P 114185d24edf4fb0809161989486a8c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.630527 20036 tablet_server.cc:196] TabletServer@127.19.145.2:0 shutdown complete.
W20260709 13:10:45.639982 30485 consensus_peers.cc:597] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 -> Peer 4d4d910762234fb684b6fb15432253d1 (127.19.145.1:38613): Couldn't send request to peer 4d4d910762234fb684b6fb15432253d1. Status: Network error: Client connection negotiation failed: client connection to 127.19.145.1:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.663025 20036 tablet_server.cc:179] TabletServer@127.19.145.3:0 shutting down...
I20260709 13:10:45.688098 20036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.688933 20036 tablet_replica.cc:333] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.689586 20036 raft_consensus.cc:2243] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.690024 20036 raft_consensus.cc:2272] T 7c9462a686c642f4a669cd5e40712a04 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.691895 20036 tablet_replica.cc:333] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.692402 20036 raft_consensus.cc:2243] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.693130 20036 raft_consensus.cc:2272] T 5f4f5c435b124476b72659f891552e0f P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.694906 20036 tablet_replica.cc:333] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.695482 20036 raft_consensus.cc:2243] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.695852 20036 raft_consensus.cc:2272] T b4b347e4c3554d499d66de95654f416a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.697463 20036 tablet_replica.cc:333] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.697948 20036 raft_consensus.cc:2243] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.698279 20036 raft_consensus.cc:2272] T a0570e21b0e14c319ec354392cc153a4 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.699988 20036 tablet_replica.cc:333] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.700435 20036 raft_consensus.cc:2243] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.700826 20036 raft_consensus.cc:2272] T b0a8004c62e045c8a3a5e180cdace92a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.702473 20036 tablet_replica.cc:333] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.702979 20036 raft_consensus.cc:2243] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.703455 20036 raft_consensus.cc:2272] T eb1616b892bc4934bf8cf010cd52aed3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.705075 20036 tablet_replica.cc:333] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.705579 20036 raft_consensus.cc:2243] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.706324 20036 raft_consensus.cc:2272] T 63a12f4f60f34012bd7abb44fc2823f3 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.708132 20036 tablet_replica.cc:333] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.708662 20036 raft_consensus.cc:2243] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.709354 20036 raft_consensus.cc:2272] T 4562e7c9d58c48bfb644efdcdceb5112 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.711557 20036 tablet_replica.cc:333] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.712177 20036 raft_consensus.cc:2243] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.712581 20036 raft_consensus.cc:2272] T d1f134672ad04c9eb8dc17f94444feee P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.714232 20036 tablet_replica.cc:333] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.714851 20036 raft_consensus.cc:2243] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.715296 20036 raft_consensus.cc:2272] T 2600e5efa9c542e1bfef48610290e26a P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.716900 20036 tablet_replica.cc:333] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.717389 20036 raft_consensus.cc:2243] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.717811 20036 raft_consensus.cc:2272] T 2b2d726e129a404f95cf8b12416fafec P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.719477 20036 tablet_replica.cc:333] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.719973 20036 raft_consensus.cc:2243] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.720355 20036 raft_consensus.cc:2272] T 5f9a2adcf22d4875838ac278aa142e2b P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.721976 20036 tablet_replica.cc:333] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.722443 20036 raft_consensus.cc:2243] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.722836 20036 raft_consensus.cc:2272] T 9c5cb83965af4da19eded8da4a2b5628 P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.724502 20036 tablet_replica.cc:333] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.724974 20036 raft_consensus.cc:2243] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.725370 20036 raft_consensus.cc:2272] T d123779ba71d4cf0ab0fe596e2448d6d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.726928 20036 tablet_replica.cc:333] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.727447 20036 raft_consensus.cc:2243] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.728132 20036 raft_consensus.cc:2272] T b771396bb9104a77b8364a3dea4cf59b P eaf1885b8d53412a92eeb8d864dd8a22 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.729979 20036 tablet_replica.cc:333] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.730492 20036 raft_consensus.cc:2243] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.730890 20036 raft_consensus.cc:2272] T e8adcbd8a1da4c17bd326e55477f0d58 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.732556 20036 tablet_replica.cc:333] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.733011 20036 raft_consensus.cc:2243] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.733419 20036 raft_consensus.cc:2272] T 1a26adb270484ddbac86569b8f488f19 P eaf1885b8d53412a92eeb8d864dd8a22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.734980 20036 tablet_replica.cc:333] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22: stopping tablet replica
I20260709 13:10:45.735463 20036 raft_consensus.cc:2243] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.735867 20036 raft_consensus.cc:2272] T 220ff2b761b5487faa43e301a3a4196d P eaf1885b8d53412a92eeb8d864dd8a22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.772713 20036 tablet_server.cc:196] TabletServer@127.19.145.3:0 shutdown complete.
I20260709 13:10:45.798476 20036 master.cc:562] Master@127.19.145.62:43531 shutting down...
I20260709 13:10:45.818763 20036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.819357 20036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.819703 20036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 991c46b8c2724c2eb5a5ab8615db490e: stopping tablet replica
I20260709 13:10:45.841166 20036 master.cc:584] Master@127.19.145.62:43531 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (10814 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23165 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (307670 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:45.892518 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 389 messages since previous log ~13 seconds ago
I20260709 13:10:45.892751 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 389 messages since previous log ~13 seconds ago
I20260709 13:10:45.892941 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 387 messages since previous log ~13 seconds ago
I20260709 13:10:45.893134 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:10:45.893311 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:10:45.893580 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~132 seconds ago
I20260709 13:10:45.893849 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 3 messages since previous log ~0 seconds ago
I20260709 13:10:45.894124 20036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 125 messages since previous log ~31 seconds ago
